00000001:02000400:2.0F:1788638830.171869:0:3299:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg618-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1788638847.991435:0:3518:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg618-server.virtnet: executing load_modules_local 00000001:01000000:0.0F:1788638850.028454:0:3580:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 651 MB/s 00000001:01000000:2.0:1788638850.278049:0:3580:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 551 MB/s 00000001:01000000:2.0:1788638850.534198:0:3580:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3597 MB/s 00000020:02000000:1.0F:1788638851.464054:0:3610:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_3_g980e1e2 00000400:02000000:2.0:1788638852.716975:0:3625:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.206.118@tcp [8/256/0/180] 00008000:02000000:3.0:1788638856.357065:0:3774:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1788638914.781354:0:5742:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg618-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788638929.211339:0:6492:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788638929.211346:0:6492:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788638929.211347:0:6492:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788638929.211493:0:6492:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000081d79bc7 00000080:02000400:3.0:1788638929.211504:0:6492:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1788638929.229799:0:6492:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1788638929.229812:0:6492:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788638929.230707:0:6492:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000009bbae8bf) 00000020:00000080:0.0:1788638929.230729:0:6492:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788638929.294306:0:6492:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788638929.294367:0:6492:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:3.0:1788638929.338287:0:6492:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788638929.338519:0:6492:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788638929.338527:0:6492:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788638929.338539:0:6492:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x25c454990262bc4f 00000020:01000004:3.0:1788638929.338546:0:6492:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788638929.338551:0:6492:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788638929.338556:0:6492:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000081d79bc7 from MGS 00000020:01000004:3.0:1788638929.338560:0:6492:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788638929.338581:0:6492:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000089a72f18) 00000020:00000080:3.0:1788638929.338593:0:6492:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788638929.338889:0:6492:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000081d79bc7 from MGS, refs=2 00080000:01000000:3.0:1788638929.338895:0:6492:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788638929.338900:0:6492:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x25c454990262bc5d 00000100:00100000:3.0:1788638929.339139:0:6492:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788638929.339285:0:6492:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788638929.339292:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788638929.341176:0:6492:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788638929.341190:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788638929.342442:0:6492:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788638929.342613:0:6492:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788638929.342736:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788638929.343438:0:6492:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788638929.343445:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788638929.343835:0:6492:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788638929.343840:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788638929.344592:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638929.344596:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638929.344597:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638929.345482:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638929.345486:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638929.345494:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638929.346174:0:6492:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788638929.347738:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1788638929.595829:0:6492:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3091 MB/s 00000001:01000000:1.0:1788638929.845726:0:6492:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4663 MB/s 00000001:01000000:2.0:1788638930.097866:0:6492:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 452 MB/s 00000001:01000000:0.0:1788638930.348830:0:6492:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 543 MB/s 00010000:00010000:3.0:1788638930.358973:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1788638930.370067:0:6492:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:2.0:1788638930.393830:0:6492:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788638930.394881:0:6507:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788638930.394929:0:6492:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788638930.394969:0:6492:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1788638930.395130:0:6492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788638930.395148:0:6492:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788638930.395737:0:6492:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788638930.395886:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788638930.395892:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788638930.398659:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788638930.398671:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788638930.403004:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788638930.403015:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788638930.403810:0:6492:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788638930.403837:0:6492:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.118@tcp' 00000020:01000004:3.0:1788638930.403839:0:6492:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788638930.403886:0:6492:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.118@tcp (typ=mgc) 00000020:00000080:3.0:1788638930.403898:0:6492:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.118@tcp (00000000215bdf45) 00000020:00000080:3.0:1788638930.403912:0:6492:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788638930.403979:0:6492:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000030ce05ab@MGC192.168.206.118@tcp: add connection 192.168.206.118@tcp at head 00000100:00080000:2.0:1788638930.404238:0:6512:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:3.0:1788638930.405080:0:6492:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.118@tcp-0 is initialized 00000040:01000000:3.0:1788638930.405089:0:6492:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.118@tcp ctxt 1 is initialized 10000000:01000000:3.0:1788638930.409588:0:6513:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788638930.409737:0:6492:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.118@tcp (uuid 01f1eef9-e690-4065-bf99-bf821af7b626) 00000020:00000080:2.0:1788638930.409758:0:6492:0:(genops.c:1385:class_connect()) connect: client 01f1eef9-e690-4065-bf99-bf821af7b626, cookie 0x25c454990262bc6b 00000100:00080000:2.0:1788638930.409770:0:6492:0:(import.c:545:import_select_connection()) MGC192.168.206.118@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788638930.409776:0:6492:0:(import.c:665:import_select_connection()) MGC192.168.206.118@tcp: import 0000000030ce05ab using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788638930.409816:0:6492:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ede276d9 x1875523772874880/t0(0) o250->MGC192.168.206.118@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788638930.409843:0:6492:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 01f1eef9-e690-4065-bf99-bf821af7b626->MGS 00000020:01000004:2.0:1788638930.409858:0:6492:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788638930.409863:0:6492:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788638930.409880:0:6492:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000003d438cc3) 00000020:00000080:2.0:1788638930.409892:0:6492:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788638930.410155:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ede276d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:01f1eef9-e690-4065-bf99-bf821af7b626:3640:1875523772874880:0@lo:250: 00000100:00100000:3.0:1788638930.410234:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638930.410395:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772874880 00000100:00100000:1.0:1788638930.410403:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772874880 00000100:00100000:1.0:1788638930.410443:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788638930.410458:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ed98a32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3640:x1875523772874880:12345-0@lo:250: 00010000:00080000:1.0:1788638930.410477:0:6508:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 01f1eef9-e690-4065-bf99-bf821af7b626@0@lo t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:1.0:1788638930.410502:0:6508:0:(genops.c:1385:class_connect()) connect: client 01f1eef9-e690-4065-bf99-bf821af7b626, cookie 0x25c454990262bc79 00000100:00080000:1.0:1788638930.410606:0:6508:0:(import.c:65:import_set_state_nolock()) 00000000d612f610 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788638930.410676:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ed98a32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+5:3640:x1875523772874880:12345-0@lo:250: Request processed in 217us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638930.410684:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788638930.411318:0:3640:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.206.118@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788638930.411327:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.206.118@tcp: connect to target with instance 0 00000100:00080000:3.0:1788638930.411333:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.206.118@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788638930.411338:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788638930.411340:0:3640:0:(import.c:65:import_set_state_nolock()) 0000000030ce05ab MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788638930.411343:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788638930.411357:0:3640:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788638930.411378:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ede276d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:01f1eef9-e690-4065-bf99-bf821af7b626:3640:1875523772874880:0@lo:250: 00000100:00100000:2.0:1788638930.435698:0:6492:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788638930.436156:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788638930.436163:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788638930.437036:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788638930.437045:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788638930.437491:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788638930.437498:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788638930.438392:0:6492:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788638930.438569:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788638930.438574:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788638930.439262:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788638930.439271:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788638930.507066:0:6492:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788638930.507261:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788638930.507268:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788638930.511257:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788638930.511270:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788638930.517032:0:6492:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788638930.517231:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788638930.517237:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788638930.518032:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788638930.518040:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788638930.518994:0:6492:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788638930.519172:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788638930.519178:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788638930.523571:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788638930.523590:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788638930.524539:0:6492:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788638930.524879:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788638930.524892:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788638930.525295:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788638930.525302:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788638930.558039:0:6492:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788638930.558269:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788638930.558276:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788638930.564843:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788638930.564864:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788638930.566469:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788638930.566485:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788638930.567879:0:6492:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788638930.567908:0:6492:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1788638930.567914:0:6492:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.118@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788638930.568010:0:6492:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.118@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788638930.568043:0:6492:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.118@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1788638930.568047:0:6492:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788638930.568049:0:6492:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788638930.568050:0:6492:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788638930.568051:0:6492:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788638930.568052:0:6492:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788638930.568053:0:6492:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788638930.568054:0:6492:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788638930.568056:0:6492:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788638930.568058:0:6492:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788638930.568059:0:6492:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788638930.568060:0:6492:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788638930.568061:0:6492:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788638930.568064:0:6492:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1788638930.568067:0:6492:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788638930.568068:0:6492:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788638930.568069:0:6492:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788638930.568070:0:6492:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788638930.568071:0:6492:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788638930.568077:0:6492:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788638930.568078:0:6492:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788638930.568079:0:6492:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788638930.568079:0:6492:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788638930.568080:0:6492:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788638930.568081:0:6492:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788638930.568082:0:6492:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788638930.568117:0:6492:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788638930.568133:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003a37f29f pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:6492:1875523772875008:0@lo:253: 00000100:00100000:0.0:1788638930.568210:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638930.568309:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 0000000067c2e6a0 going to sleep for 11 seconds 00000100:00100000:1.0:1788638930.568413:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772875008 00000100:00100000:1.0:1788638930.568421:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772875008 00000100:00100000:1.0:1788638930.568474:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788638930.568484:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096aad499 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+5:6492:x1875523772875008:12345-0@lo:253: 20000000:01000000:1.0:1788638930.568528:0:6510:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788638930.568531:0:6510:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1788638930.569521:0:6532:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788638930.569570:0:6510:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1788638930.569899:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788638930.575048:0:6533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1788638930.576370:0:6510:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788638930.576376:0:6510:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1788638930.576382:0:6510:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1788638930.576385:0:6510:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1788638930.576397:0:6510:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1788638930.576601:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788638930.576798:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1788638930.576815:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788638930.576844:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1788638930.576859:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1788638930.576874:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1788638930.576923:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1788638930.576932:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1788638930.576944:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1788638930.576950:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1788638930.576961:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1788638930.576966:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1788638930.576977:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1788638930.576989:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1788638930.577014:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788638930.577018:0:6510:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1788638930.577025:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788638930.577106:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1788638930.577118:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788638930.577132:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1788638930.577159:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1788638930.577174:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1788638930.577183:0:6510:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1788638930.577221:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1788638930.577231:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788638930.577244:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1788638930.577258:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1788638930.577272:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1788638930.577281:0:6510:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1788638930.577305:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1788638930.577313:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1788638930.577324:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1788638930.577338:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1788638930.577387:0:6510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1788638930.577405:0:6510:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788638930.577411:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1788638930.578187:0:6534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1788638930.578351:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1788638930.578370:0:6510:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.118@tcp for mdt 20000000:01000000:3.0:1788638930.578372:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.118@tcp (null) (null) (null) 00000040:00080000:3.0:1788638930.578385:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1788638930.578391:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788638930.578403:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1788638930.578408:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.206.118@tcp (null) (null) 00000040:00080000:3.0:1788638930.578419:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1788638930.578426:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788638930.578436:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1788638930.578462:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1788638930.578488:0:6510:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788638930.578491:0:6510:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788638930.578501:0:6510:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788638930.578551:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788638930.578553:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788638930.579105:0:6535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1788638930.579251:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1788638930.579272:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1788638930.579287:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:2.0:1788638930.579298:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788638930.579299:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788638930.579571:0:6536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1788638930.579907:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1788638930.579927:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1788638930.579941:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:3.0:1788638930.579950:0:6510:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788638930.579952:0:6510:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1788638930.579956:0:6510:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788638930.579958:0:6510:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788638930.579962:0:6510:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1788638930.579966:0:6510:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788638930.580227:0:6537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1788638930.580321:0:6510:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1788638930.590307:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1788638930.590345:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1788638930.590360:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1788638930.590379:0:6510:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788638930.590399:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000139271d4/0x25c454990262bc80 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638930.590414:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000139271d4/0x25c454990262bc80 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638930.590423:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000139271d4/0x25c454990262bc80 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638930.590429:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000139271d4/0x25c454990262bc80 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638930.590436:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000139271d4/0x25c454990262bc80 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638930.590465:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000139271d4/0x25c454990262bc80 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638930.590470:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000139271d4 already unused, calling callback (00000000d43fd8e0) 00010000:00010000:3.0:1788638930.590474:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000139271d4/0x25c454990262bc80 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638930.590480:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000139271d4/0x25c454990262bc80 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638930.590492:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000139271d4/0x25c454990262bc80 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638930.590498:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000139271d4/0x25c454990262bc80 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638930.590503:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000139271d4/0x25c454990262bc80 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788638930.590518:0:6510:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788638930.611316:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096aad499 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+5:6492:x1875523772875008:12345-0@lo:253: Request processed in 42825us (43099us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638930.611337:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788638930.611459:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003a37f29f pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:6492:1875523772875008:0@lo:253: 10000000:01000000:0.0:1788638930.611474:0:6492:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788638930.611477:0:6492:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788638930.611479:0:6492:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788638930.611480:0:6492:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788638930.611481:0:6492:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1788638930.611482:0:6492:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788638930.611483:0:6492:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788638930.611483:0:6492:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788638930.611485:0:6492:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788638930.611486:0:6492:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788638930.611487:0:6492:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788638930.611488:0:6492:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788638930.611510:0:6492:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000081d79bc7 from lustre-MDT0000 10000000:01000000:0.0:1788638930.611537:0:6492:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788638930.611540:0:6492:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788638930.611544:0:6492:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9ae342e50000 10000000:01000000:0.0:1788638930.611548:0:6492:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788638930.611554:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ae342e50000 from 1 10000000:01000000:0.0:1788638930.611557:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788638930.611589:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: 00000000aeb36e25/0x25c454990262bc87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638930.611920:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: 00000000aeb36e25/0x25c454990262bc87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638930.611930:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: 00000000aeb36e25/0x25c454990262bc87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638930.611958:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003a37f29f pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:6492:1875523772875136:0@lo:101: 00000100:00100000:0.0:1788638930.611998:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638930.612046:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c84543e4 going to sleep for 11 seconds 00000100:00100000:3.0:1788638930.612149:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772875136 00000100:00100000:3.0:1788638930.612156:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772875136 00000100:00100000:3.0:1788638930.612197:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788638930.612205:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ba53e576 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+5:6492:x1875523772875136:12345-0@lo:101: 00010000:00010000:3.0:1788638930.612216:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638930.612229:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001cf67eec/0x25c454990262bc8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262bc87 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638930.612258:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001cf67eec/0x25c454990262bc8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262bc87 expref: 6 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638930.612267:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001cf67eec/0x25c454990262bc8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262bc87 expref: 6 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638930.612275:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001cf67eec, rc 0) 00000100:00100000:3.0:1788638930.612333:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ba53e576 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+6:6492:x1875523772875136:12345-0@lo:101: Request processed in 129us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638930.612339:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788638930.612403:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003a37f29f pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:6492:1875523772875136:0@lo:101: 00010000:00010000:1.0:1788638930.612415:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: 00000000aeb36e25/0x25c454990262bc87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bc8e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638930.612423:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: 00000000aeb36e25/0x25c454990262bc87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262bc8e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638930.612509:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005409133e pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:6492:1875523772875264:0@lo:501: 00000100:00100000:1.0:1788638930.612534:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638930.612556:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 0000000011ad1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788638930.612999:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772875264 00000100:00100000:3.0:1788638930.613005:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772875264 00000100:00100000:3.0:1788638930.613037:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788638930.613044:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fdf419ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+6:6492:x1875523772875264:12345-0@lo:501: 00000100:00100000:3.0:1788638930.613123:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fdf419ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+6:6492:x1875523772875264:12345-0@lo:501: Request processed in 80us (588us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788638930.613129:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788638930.613245:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005409133e pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:6492:1875523772875264:0@lo:501: 10000000:01000000:1.0:1788638930.613272:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788638930.613292:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: 00000000aeb36e25/0x25c454990262bc87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bc8e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638930.613300:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: 00000000aeb36e25/0x25c454990262bc87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bc8e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638930.613308:0:6492:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ae3461e3800 10000000:01000000:1.0:1788638930.613312:0:6492:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788638930.613316:0:6492:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ae3461e3800 10000000:01000000:1.0:1788638930.613318:0:6492:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788638930.613320:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9ae3461e3800 from 1 10000000:01000000:1.0:1788638930.613322:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788638930.613344:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: 000000005ee0ddb5/0x25c454990262bc95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638930.613350:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: 000000005ee0ddb5/0x25c454990262bc95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638930.613358:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: 000000005ee0ddb5/0x25c454990262bc95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638930.613371:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005409133e pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:6492:1875523772875392:0@lo:101: 00000100:00100000:1.0:1788638930.613403:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638930.613426:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 0000000011ad1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788638930.613438:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772875392 00000100:00100000:1.0:1788638930.613441:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772875392 00000100:00100000:1.0:1788638930.613471:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788638930.613475:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000078f761f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+6:6492:x1875523772875392:12345-0@lo:101: 00010000:00010000:1.0:1788638930.613481:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638930.613490:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000038f91112/0x25c454990262bc9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262bc95 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638930.613504:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000038f91112/0x25c454990262bc9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262bc95 expref: 7 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638930.613510:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000038f91112/0x25c454990262bc9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262bc95 expref: 7 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638930.613516:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000038f91112, rc 0) 00000100:00100000:1.0:1788638930.613540:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000078f761f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+7:6492:x1875523772875392:12345-0@lo:101: Request processed in 64us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638930.613545:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788638930.613569:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005409133e pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:6492:1875523772875392:0@lo:101: 00010000:00010000:1.0:1788638930.613576:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: 000000005ee0ddb5/0x25c454990262bc95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bc9c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638930.613582:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: 000000005ee0ddb5/0x25c454990262bc95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262bc9c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638930.613591:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788638930.613594:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: 000000005ee0ddb5/0x25c454990262bc95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bc9c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638930.613603:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: 000000005ee0ddb5/0x25c454990262bc95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bc9c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638930.613608:0:6492:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788638930.613610:0:6492:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788638930.613707:0:6492:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ae3461e3800 10000000:01000000:1.0:1788638930.613711:0:6492:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788638930.613715:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788638930.613716:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788638930.613731:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: 0000000035243370/0x25c454990262bca3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638930.613737:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: 0000000035243370/0x25c454990262bca3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638930.613743:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: 0000000035243370/0x25c454990262bca3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638930.613755:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005409133e pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:6492:1875523772875520:0@lo:101: 00000100:00100000:1.0:1788638930.613780:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638930.613791:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 0000000011ad1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788638930.613832:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772875520 00000100:00100000:1.0:1788638930.613836:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772875520 00000100:00100000:1.0:1788638930.613851:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788638930.613856:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e0cb3d74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+7:6492:x1875523772875520:12345-0@lo:101: 00010000:00010000:1.0:1788638930.613862:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638930.613868:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008837df91/0x25c454990262bcaa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262bca3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638930.613890:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008837df91/0x25c454990262bcaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262bca3 expref: 8 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638930.613897:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008837df91/0x25c454990262bcaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262bca3 expref: 8 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638930.613903:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008837df91, rc 0) 00000100:00100000:1.0:1788638930.613928:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e0cb3d74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+8:6492:x1875523772875520:12345-0@lo:101: Request processed in 72us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638930.613934:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788638930.613974:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005409133e pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:6492:1875523772875520:0@lo:101: 00010000:00010000:1.0:1788638930.613983:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: 0000000035243370/0x25c454990262bca3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bcaa expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638930.613990:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: 0000000035243370/0x25c454990262bca3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262bcaa expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638930.614027:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005409133e pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:6492:1875523772875648:0@lo:501: 00000100:00100000:1.0:1788638930.614059:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638930.614072:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 0000000011ad1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788638930.614084:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772875648 00000100:00100000:1.0:1788638930.614086:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772875648 00000100:00100000:1.0:1788638930.614102:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788638930.614107:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019208ff8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+8:6492:x1875523772875648:12345-0@lo:501: 00000100:00100000:1.0:1788638930.614186:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019208ff8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+9:6492:x1875523772875648:12345-0@lo:501: Request processed in 78us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638930.614192:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788638930.614225:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005409133e pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:6492:1875523772875648:0@lo:501: 00000100:00100000:1.0:1788638930.614249:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005409133e pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:6492:1875523772875776:0@lo:503: 00000100:00100000:1.0:1788638930.614282:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638930.614294:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 0000000085639de1 going to sleep for 11 seconds 00000100:00100000:1.0:1788638930.614306:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772875776 00000100:00100000:1.0:1788638930.614309:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772875776 00000100:00100000:1.0:1788638930.614326:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788638930.614330:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cdf7e779 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+9:6492:x1875523772875776:12345-0@lo:503: 00000100:00100000:1.0:1788638930.614401:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cdf7e779 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+9:6492:x1875523772875776:12345-0@lo:503: Request processed in 70us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638930.614408:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788638930.614442:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005409133e pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:6492:1875523772875776:0@lo:503: 00000100:00100000:2.0:1788638930.617296:0:6538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c6b19880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:6538:1875523772875904:0@lo:502: 00000100:00100000:2.0:1788638930.617384:0:6538:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638930.617478:0:6538:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c62d59bc going to sleep for 11 seconds 00000100:00100000:1.0:1788638930.618777:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772875904 00000100:00100000:1.0:1788638930.618789:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772875904 00000100:00100000:1.0:1788638930.618890:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788638930.618900:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ea5287f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+9:6538:x1875523772875904:12345-0@lo:502: 00000100:00100000:1.0:1788638930.619060:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ea5287f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+9:6538:x1875523772875904:12345-0@lo:502: Request processed in 161us (1675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638930.619068:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788638930.619154:0:6538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c6b19880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:6538:1875523772875904:0@lo:502: 00000020:01000000:3.0:1788638930.619185:0:6538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788638930.619194:0:6538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638930.619196:0:6538:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788638930.619201:0:6538:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788638930.619204:0:6538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788638930.619217:0:6538:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000058732622) 00000020:00000080:3.0:1788638930.619231:0:6538:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788638930.619246:0:6538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788638930.619331:0:6538:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788638930.619341:0:6538:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x25c454990262bcb8 00000020:00000080:3.0:1788638930.619554:0:6538:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788638930.619558:0:6538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788638930.619562:0:6538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638930.619563:0:6538:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788638930.619566:0:6538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788638930.619570:0:6538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638930.619571:0:6538:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788638930.619573:0:6538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788638930.619579:0:6538:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000225110d4) 00000020:00000080:3.0:1788638930.619588:0:6538:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788638930.619592:0:6538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788638930.619593:0:6538:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788638930.619596:0:6538:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788638930.619602:0:6538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788638930.619687:0:6538:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000081d79bc7 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788638930.619705:0:6538:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000e93746cd) 00000020:00000080:3.0:1788638930.619713:0:6538:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788638930.619762:0:6538:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788638930.619767:0:6538:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x25c454990262bccd 00000020:00000080:3.0:1788638930.619897:0:6538:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788638930.619903:0:6538:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788638930.619908:0:6538:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x25c454990262bcd4 00080000:01000000:3.0:1788638930.619912:0:6538:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788638930.619915:0:6538:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x25c454990262bcdb 00080000:10000000:3.0:1788638930.620267:0:6538:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1788638930.620395:0:6538:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1788638930.632517:0:6538:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788638930.707568:0:6538:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788638930.707891:0:6538:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788638930.713476:0:6538:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788638930.713797:0:6538:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788638930.717136:0:6538:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000954d80ca) 00000020:00000080:2.0:1788638930.717160:0:6538:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788638930.717241:0:6538:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788638930.717248:0:6538:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x25c454990262bce9 00000020:00000080:1.0:1788638930.728969:0:6538:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1788638930.730108:0:6538:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:1.0:1788638930.738817:0:6538:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:1.0:1788638930.741134:0:6538:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:1.0:1788638930.748241:0:6538:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:1.0:1788638930.765483:0:6538:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:1.0:1788638930.768432:0:6538:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:1.0:1788638930.770584:0:6538:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x25c454990262bcf0 00000020:00000080:2.0:1788638930.772717:0:6538:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788638930.772731:0:6538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788638930.772738:0:6538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788638930.772740:0:6538:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788638930.772744:0:6538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788638930.772748:0:6538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788638930.772750:0:6538:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788638930.772753:0:6538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788638930.772754:0:6538:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788638930.772756:0:6538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788638930.772758:0:6538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788638930.772759:0:6538:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788638930.772761:0:6538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788638930.772765:0:6538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788638930.772766:0:6538:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788638930.772770:0:6538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788638930.772820:0:6538:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1788638930.772894:0:6538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000508d57d0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:6538:1875523772876032:0@lo:502: 00000100:00100000:2.0:1788638930.773076:0:6538:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638930.773124:0:6538:0:(client.c:2716:ptlrpc_set_wait()) set 000000006570d1b8 going to sleep for 11 seconds 00000100:00100000:0.0:1788638930.773208:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772876032 00000100:00100000:0.0:1788638930.773226:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772876032 00000100:00100000:0.0:1788638930.773273:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788638930.773282:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000650ffeec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+9:6538:x1875523772876032:12345-0@lo:502: 00000100:00100000:0.0:1788638930.773542:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000650ffeec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+9:6538:x1875523772876032:12345-0@lo:502: Request processed in 262us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638930.773550:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788638930.773655:0:6538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000508d57d0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:6538:1875523772876032:0@lo:502: 00000020:01000000:2.0:1788638930.773683:0:6538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788638930.773688:0:6538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788638930.773690:0:6538:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1788638930.773693:0:6538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1788638930.774251:0:6492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1788638930.774271:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788638930.774290:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: 0000000035243370/0x25c454990262bca3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bcaa expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638930.774428:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: 0000000035243370/0x25c454990262bca3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bcaa expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638930.774437:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ae3461e3800 from 1 10000000:01000000:0.0:1788638930.774440:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788638930.774489:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: 00000000ba7cc502/0x25c454990262bcf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638930.774496:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: 00000000ba7cc502/0x25c454990262bcf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638930.774504:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: 00000000ba7cc502/0x25c454990262bcf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638930.774518:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000583864ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:6492:1875523772876160:0@lo:101: 00000100:00100000:0.0:1788638930.774554:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638930.774590:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e1fed532 going to sleep for 11 seconds 00000100:00100000:2.0:1788638930.774670:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772876160 00000100:00100000:2.0:1788638930.774675:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772876160 00000100:00100000:2.0:1788638930.774708:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788638930.774715:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f3d894e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+9:6492:x1875523772876160:12345-0@lo:101: 00010000:00010000:2.0:1788638930.774730:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638930.774742:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d1b946ca/0x25c454990262bcfe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262bcf7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638930.774762:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d1b946ca/0x25c454990262bcfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262bcf7 expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638930.774771:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d1b946ca/0x25c454990262bcfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262bcf7 expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638930.774778:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d1b946ca, rc 0) 00000100:00100000:2.0:1788638930.774808:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f3d894e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+10:6492:x1875523772876160:12345-0@lo:101: Request processed in 94us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638930.774815:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788638930.775239:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000583864ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:6492:1875523772876160:0@lo:101: 00010000:00010000:0.0:1788638930.775253:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: 00000000ba7cc502/0x25c454990262bcf7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bcfe expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638930.775261:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: 00000000ba7cc502/0x25c454990262bcf7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262bcfe expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638930.776474:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000583864ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:6492:1875523772876288:0@lo:256: 00000100:00100000:0.0:1788638930.776536:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638930.776687:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772876288 00000100:00100000:2.0:1788638930.776694:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772876288 00000100:00100000:2.0:1788638930.776765:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788638930.776773:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007bd37b97 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+10:6492:x1875523772876288:12345-0@lo:256: 20000000:01000000:2.0:1788638930.776791:0:6511:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788638930.776796:0:6511:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788638930.776861:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007bd37b97 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+10:6492:x1875523772876288:12345-0@lo:256: Request processed in 88us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638930.776868:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788638930.777016:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e1fed532 going to sleep for 11 seconds 00000100:00100000:0.0:1788638930.777035:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000583864ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:6492:1875523772876288:0@lo:256: 10000000:01000000:0.0:1788638930.777603:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788638930.777648:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: 00000000ba7cc502/0x25c454990262bcf7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bcfe expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638930.777658:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: 00000000ba7cc502/0x25c454990262bcf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bcfe expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638930.777674:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae3461e3800 from 1 10000000:01000000:0.0:1788638930.777676:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788638930.777704:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: 000000008f02af0e/0x25c454990262bd05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638930.777710:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: 000000008f02af0e/0x25c454990262bd05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638930.777717:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: 000000008f02af0e/0x25c454990262bd05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638930.777732:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000583864ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:6492:1875523772876416:0@lo:101: 00000100:00100000:0.0:1788638930.777768:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638930.779057:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772876416 00000100:00100000:1.0:1788638930.779067:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772876416 00000100:00100000:0.0:1788638930.779203:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e1fed532 going to sleep for 11 seconds 00000100:00100000:3.0:1788638930.779484:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788638930.779494:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b62d637c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+10:6492:x1875523772876416:12345-0@lo:101: 00010000:00010000:3.0:1788638930.779508:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638930.779525:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000139271d4/0x25c454990262bd0c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262bd05 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638930.779566:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000139271d4/0x25c454990262bd0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262bd05 expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638930.779576:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000139271d4/0x25c454990262bd0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262bd05 expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638930.779585:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000139271d4, rc 0) 00000100:00100000:3.0:1788638930.779682:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b62d637c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+11:6492:x1875523772876416:12345-0@lo:101: Request processed in 190us (1913us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638930.779689:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788638930.779773:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000583864ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:6492:1875523772876416:0@lo:101: 00010000:00010000:0.0:1788638930.779790:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: 000000008f02af0e/0x25c454990262bd05 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bd0c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638930.779799:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: 000000008f02af0e/0x25c454990262bd05 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262bd0c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638930.779866:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000583864ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:6492:1875523772876544:0@lo:501: 00000100:00100000:0.0:1788638930.779909:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638930.780535:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e1fed532 going to sleep for 11 seconds 00000100:00100000:2.0:1788638930.780584:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772876544 00000100:00100000:2.0:1788638930.780591:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772876544 00000100:00100000:2.0:1788638930.780640:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788638930.780648:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000061d14283 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+11:6492:x1875523772876544:12345-0@lo:501: 00000100:00100000:2.0:1788638930.780973:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000061d14283 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+11:6492:x1875523772876544:12345-0@lo:501: Request processed in 325us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638930.780995:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788638930.781193:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000583864ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:6492:1875523772876544:0@lo:501: 00000100:00100000:0.0:1788638930.781376:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000583864ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:6492:1875523772876672:0@lo:503: 00000100:00100000:0.0:1788638930.781430:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638930.781505:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e1fed532 going to sleep for 11 seconds 00000100:00100000:1.0:1788638930.781549:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772876672 00000100:00100000:1.0:1788638930.781555:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772876672 00000100:00100000:1.0:1788638930.781657:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788638930.781664:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a011d1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+11:6492:x1875523772876672:12345-0@lo:503: 00000040:00080000:1.0:1788638930.781702:0:6508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788638930.781741:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a011d1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+11:6492:x1875523772876672:12345-0@lo:503: Request processed in 78us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638930.781748:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788638930.781821:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000583864ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:6492:1875523772876672:0@lo:503: 00000040:00080000:3.0:1788638930.783083:0:6542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1788638930.783495:0:6492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788638930.783788:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788638930.783808:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: 000000008f02af0e/0x25c454990262bd05 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bd0c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638930.783820:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: 000000008f02af0e/0x25c454990262bd05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bd0c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638930.783871:0:6492:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788638930.783883:0:6492:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ae3461e3800 10000000:01000000:0.0:1788638930.783886:0:6492:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ae3461e3800 10000000:01000000:0.0:1788638930.783890:0:6492:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788638930.783895:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ae3461e3800 from 1 10000000:01000000:0.0:1788638930.783898:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788638930.783929:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: 0000000089c81974/0x25c454990262bd13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638930.783937:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: 0000000089c81974/0x25c454990262bd13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638930.784164:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: 0000000089c81974/0x25c454990262bd13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638930.784186:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000583864ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:6492:1875523772876800:0@lo:101: 00000100:00100000:0.0:1788638930.784392:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638930.784438:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e1fed532 going to sleep for 11 seconds 00000100:00100000:2.0:1788638930.784519:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772876800 00000100:00100000:2.0:1788638930.784527:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772876800 00000100:00100000:2.0:1788638930.784573:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788638930.784580:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ecb69cb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+11:6492:x1875523772876800:12345-0@lo:101: 00010000:00010000:2.0:1788638930.784591:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638930.784603:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d1186958/0x25c454990262bd1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262bd13 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638930.784648:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d1186958/0x25c454990262bd1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262bd13 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638930.784660:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d1186958/0x25c454990262bd1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262bd13 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638930.784669:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d1186958, rc 0) 00000100:00100000:2.0:1788638930.784707:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ecb69cb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+12:6492:x1875523772876800:12345-0@lo:101: Request processed in 128us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638930.784713:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788638930.784801:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000583864ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:6492:1875523772876800:0@lo:101: 00010000:00010000:0.0:1788638930.784815:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: 0000000089c81974/0x25c454990262bd13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bd1a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638930.784823:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: 0000000089c81974/0x25c454990262bd13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262bd1a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638930.784890:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000583864ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:6492:1875523772876928:0@lo:501: 00000100:00100000:0.0:1788638930.784915:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638930.784944:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e1fed532 going to sleep for 11 seconds 00000100:00100000:2.0:1788638930.785092:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772876928 00000100:00100000:2.0:1788638930.785097:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772876928 00000100:00100000:2.0:1788638930.785121:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788638930.785127:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007abd1fb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+12:6492:x1875523772876928:12345-0@lo:501: 00000100:00100000:2.0:1788638930.785231:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007abd1fb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+12:6492:x1875523772876928:12345-0@lo:501: Request processed in 104us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638930.785237:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788638930.785395:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000583864ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:6492:1875523772876928:0@lo:501: 00000100:00100000:0.0:1788638930.785417:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000583864ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:6492:1875523772877056:0@lo:503: 00000100:00100000:0.0:1788638930.785463:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638930.785484:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e1fed532 going to sleep for 11 seconds 00000100:00100000:2.0:1788638930.785530:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772877056 00000100:00100000:2.0:1788638930.785533:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772877056 00000100:00100000:2.0:1788638930.785564:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788638930.785568:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b323a52 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+12:6492:x1875523772877056:12345-0@lo:503: 00000100:00100000:2.0:1788638930.785651:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b323a52 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+12:6492:x1875523772877056:12345-0@lo:503: Request processed in 83us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638930.785657:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788638930.785729:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000583864ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:6492:1875523772877056:0@lo:503: 00000100:00100000:1.0:1788638930.786389:0:6543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005409133e pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:6543:1875523772877184:0@lo:502: 00000100:00100000:1.0:1788638930.786433:0:6543:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638930.786472:0:6543:0:(client.c:2716:ptlrpc_set_wait()) set 0000000042cff59e going to sleep for 11 seconds 00000100:00100000:2.0:1788638930.786515:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772877184 00000100:00100000:2.0:1788638930.786520:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772877184 00000100:00100000:2.0:1788638930.786553:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788638930.786559:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000080249e71 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+12:6543:x1875523772877184:12345-0@lo:502: 00000100:00100000:2.0:1788638930.786664:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000080249e71 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+12:6543:x1875523772877184:12345-0@lo:502: Request processed in 104us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638930.786671:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788638930.786796:0:6543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005409133e pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:6543:1875523772877184:0@lo:502: 00000020:01000004:1.0:1788638930.786856:0:6543:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788638930.787034:0:6543:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000cfea8c1e) 00000020:00000080:1.0:1788638930.787053:0:6543:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1788638930.787162:0:6543:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000081d79bc7 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788638930.787167:0:6543:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000081d79bc7 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788638930.787169:0:6543:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000081d79bc7 4 00010000:00080000:1.0:1788638930.787200:0:6543:0:(ldlm_lib.c:102:import_set_conn()) imp 000000004197fc64@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.118@tcp at head 00010000:00010000:2.0:1788638930.791596:0:6543:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1788638930.791844:0:6543:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788638930.791899:0:6543:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788638930.791910:0:6543:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x25c454990262bd28 00000100:00080000:2.0:1788638930.791919:0:6543:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788638930.791924:0:6543:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000004197fc64 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788638930.796432:0:6543:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000508d57d0 x1875523772877312/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788638930.796470:0:6543:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788638930.796746:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000508d57d0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875523772877312:0@lo:38: 00000100:00100000:2.0:1788638930.796813:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638930.797082:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772877312 00000100:00100000:1.0:1788638930.797091:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772877312 00000100:00100000:1.0:1788638930.797130:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788638930.797137:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d9cab9d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875523772877312:12345-0@lo:38: 00000100:00100000:1.0:1788638930.797192:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d9cab9d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875523772877312:12345-0@lo:38: Request processed in 54us (379us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788638930.797208:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788638930.798074:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788638930.798085:0:3640:0:(import.c:65:import_set_state_nolock()) 000000004197fc64 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788638930.798090:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788638930.798093:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000508d57d0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875523772877312:0@lo:38: 00000100:00100000:0.0:1788638930.805564:0:6543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000583864ad pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:6543:1875523772877440:0@lo:502: 00000100:00100000:0.0:1788638930.805746:0:6543:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638930.805807:0:6543:0:(client.c:2716:ptlrpc_set_wait()) set 0000000085d71c4c going to sleep for 11 seconds 00000100:00100000:1.0:1788638930.805983:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772877440 00000100:00100000:1.0:1788638930.805991:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772877440 00000100:00100000:1.0:1788638930.806045:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788638930.806054:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e3c3cae7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+12:6543:x1875523772877440:12345-0@lo:502: 00000100:00100000:1.0:1788638930.806177:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e3c3cae7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+12:6543:x1875523772877440:12345-0@lo:502: Request processed in 124us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638930.806184:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788638930.806665:0:6543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000583864ad pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:6543:1875523772877440:0@lo:502: 00000040:00080000:0.0:1788638930.806703:0:6543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1788638930.806874:0:6492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1788638930.806975:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788638930.807025:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: 0000000089c81974/0x25c454990262bd13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bd1a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638930.807035:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: 0000000089c81974/0x25c454990262bd13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bd1a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788638930.807082:0:6492:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788638930.807085:0:6492:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788638930.807086:0:6492:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788638930.807087:0:6492:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788638930.807088:0:6492:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788638930.807089:0:6492:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788638930.807090:0:6492:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788638930.807091:0:6492:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788638930.807092:0:6492:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788638930.807094:0:6492:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788638930.807095:0:6492:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788638930.807096:0:6492:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788638930.807098:0:6492:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1788638930.807101:0:6492:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788638930.807102:0:6492:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788638930.807103:0:6492:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788638930.807108:0:6492:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788638930.807109:0:6492:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788638930.807109:0:6492:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788638930.807110:0:6492:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788638930.807111:0:6492:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788638930.807111:0:6492:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788638930.807112:0:6492:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788638930.807113:0:6492:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788638930.807114:0:6492:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788638930.807131:0:6492:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788638930.807141:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005409133e pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:6492:1875523772877568:0@lo:253: 00000100:00100000:1.0:1788638930.807183:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638930.807208:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 000000004ca8c651 going to sleep for 11 seconds 00000100:00100000:0.0:1788638930.807471:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772877568 00000100:00100000:0.0:1788638930.807478:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772877568 00000100:00100000:0.0:1788638930.807522:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788638930.807530:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000038076f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+12:6492:x1875523772877568:12345-0@lo:253: 20000000:01000000:0.0:1788638930.807551:0:6511:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788638930.807563:0:6511:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788638930.815589:0:6511:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788638930.815679:0:6511:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788638930.816186:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000038076f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+12:6492:x1875523772877568:12345-0@lo:253: Request processed in 8653us (8999us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638930.816199:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788638930.816418:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005409133e pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:6492:1875523772877568:0@lo:253: 10000000:01000000:1.0:1788638930.816431:0:6492:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788638930.816434:0:6492:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788638930.816435:0:6492:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788638930.816437:0:6492:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788638930.816438:0:6492:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788638930.816439:0:6492:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788638930.816440:0:6492:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788638930.816441:0:6492:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788638930.816452:0:6492:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788638930.816454:0:6492:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788638930.816455:0:6492:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788638930.816456:0:6492:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788638930.816457:0:6492:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788638930.816468:0:6492:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1788638930.820382:0:6532:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788638930.820391:0:6532:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788638930.820416:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000088232fc4/0x25c454990262bd2f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638930.820434:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d1b946ca/0x25c454990262bcfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262bcf7 expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638930.820441:0:6532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000088232fc4/0x25c454990262bd2f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638930.820496:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d1b946ca/0x25c454990262bcfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262bcf7 expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638930.820511:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d1b946ca/0x25c454990262bcfe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262bcf7 expref: 11 pid: 6510 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638930.820523:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000508d57d0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6532:1875523772877696:0@lo:104: 00000100:00100000:2.0:1788638930.820581:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638930.820647:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b9947af6 going to sleep for 11 seconds 00000100:00100000:0.0:1788638930.820795:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772877696 00000100:00100000:0.0:1788638930.820802:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772877696 00000100:00100000:0.0:1788638930.820841:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788638930.820848:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d8912d3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:01f1eef9-e690-4065-bf99-bf821af7b626+3:6532:x1875523772877696:12345-0@lo:104: 00010000:00010000:0.0:1788638930.820859:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: 00000000ba7cc502/0x25c454990262bcf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262bcfe expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638930.820930:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788638930.820936:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d8912d3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:01f1eef9-e690-4065-bf99-bf821af7b626+3:6532:x1875523772877696:12345-0@lo:104: Request processed in 89us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638930.820942:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788638930.820986:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000508d57d0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6532:1875523772877696:0@lo:104: 00010000:00010000:0.0:1788638930.821001:0:6532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000088232fc4/0x25c454990262bd2f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638930.823195:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638930.823206:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: 00000000ba7cc502/0x25c454990262bcf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262bcfe expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638930.823283:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ba7cc502 already unused, calling callback (0000000071159a97) 10000000:00010000:2.0:1788638930.823287:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: 00000000ba7cc502/0x25c454990262bcf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262bcfe expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638930.823306:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: 00000000ba7cc502/0x25c454990262bcf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262bcfe expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788638930.823333:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: 00000000ba7cc502/0x25c454990262bcf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262bcfe expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638930.823339:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788638930.823391:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: 00000000ba7cc502/0x25c454990262bcf7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bcfe expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638930.823398:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788638930.823419:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: 00000000ba7cc502/0x25c454990262bcf7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bcfe expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638930.823425:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: 00000000ba7cc502/0x25c454990262bcf7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bcfe expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638930.823456:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638930.823458:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638930.823460:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638930.823522:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bd8cb8d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01f1eef9-e690-4065-bf99-bf821af7b626:3642:1875523772877824:0@lo:103: 00000100:00100000:2.0:1788638930.823573:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638930.824397:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772877824 00000100:00100000:3.0:1788638930.824405:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772877824 00010000:00010000:3.0:1788638930.824429:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d1b946ca/0x25c454990262bcfe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262bcf7 expref: 12 pid: 6510 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638930.824474:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788638930.824482:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db57498b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+12:3642:x1875523772877824:12345-0@lo:103: 00010000:00010000:3.0:1788638930.824493:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638930.824497:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d1b946ca/0x25c454990262bcfe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262bcf7 expref: 12 pid: 6510 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638930.824508:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d1b946ca/0x25c454990262bcfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262bcf7 expref: 12 pid: 6510 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638930.824520:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d1b946ca/0x25c454990262bcfe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262bcf7 expref: 12 pid: 6510 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638930.824532:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000088232fc4/0x25c454990262bd2f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638930.824545:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000088232fc4/0x25c454990262bd2f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788638930.824558:0:6500:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004167981s 00010000:00010000:3.0:1788638930.824562:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000088232fc4/0x25c454990262bd2f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638930.824568:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000088232fc4/0x25c454990262bd2f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638930.824574:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000088232fc4/0x25c454990262bd2f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638930.824578:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000088232fc4/0x25c454990262bd2f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638930.824584:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000088232fc4 already unused, calling callback (00000000d43fd8e0) 00010000:00010000:3.0:1788638930.824586:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000088232fc4/0x25c454990262bd2f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638930.824593:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000088232fc4/0x25c454990262bd2f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1788638930.825367:0:6492:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:1.0:1788638930.825535:0:6492:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788638930.825763:0:6492:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:1.0:1788638930.825917:0:6492:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788638930.826116:0:6492:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:1.0:1788638930.826266:0:6492:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1788638930.827172:0:6492:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:1.0:1788638930.827510:0:6492:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1788638930.827803:0:6492:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:1.0:1788638930.828198:0:6492:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1788638930.828416:0:6492:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:1.0:1788638930.828597:0:6492:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00010000:00010000:0.0:1788638930.829380:0:6532:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000088232fc4/0x25c454990262bd2f lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638930.829394:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000088232fc4/0x25c454990262bd2f lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638930.829452:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000088232fc4/0x25c454990262bd2f lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638930.829462:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000088232fc4/0x25c454990262bd2f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638930.829481:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788638930.829601:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db57498b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+11:3642:x1875523772877824:12345-0@lo:103: Request processed in 5116us (6024us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638930.829642:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788638930.830207:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bd8cb8d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01f1eef9-e690-4065-bf99-bf821af7b626:3642:1875523772877824:0@lo:103: 40000000:02000000:2.0:1788638930.832817:0:6492:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1788638930.849494:0:6492:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1788638930.849817:0:6549:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788638930.851819:0:6492:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788638930.852071:0:6492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788638930.852755:0:6492:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788638930.852774:0:6492:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788638930.853015:0:6492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:3.0:1788638930.853314:0:6548:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1788638930.853319:0:6548:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:2.0:1788638930.856111:0:6492:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788638930.857292:0:6492:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788638930.857414:0:6492:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788638930.857680:0:6492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788638930.858151:0:6492:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:2.0:1788638930.859589:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1788638930.859835:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1788638930.860159:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1788638930.860497:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1788638930.861087:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00000040:00080000:3.0:1788638930.861411:0:6549:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:2.0:1788638930.861574:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1788638930.864497:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1788638930.864886:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1788638930.865043:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1788638930.865164:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1788638930.865540:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1788638930.865755:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1788638930.865913:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1788638930.866045:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1788638930.866192:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1788638930.866769:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1788638930.867195:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1788638930.868477:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1788638930.869117:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1788638930.869453:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1788638930.869586:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1788638930.870550:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1788638930.871549:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1788638930.875493:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00000040:00080000:0.0:1788638930.876583:0:6549:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788638930.876670:0:6549:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788638930.876674:0:6549:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:3.0:1788638930.877286:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1788638930.877564:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1788638930.878018:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1788638930.878146:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1788638930.878441:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788638930.878597:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788638930.878863:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788638930.879161:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788638930.879497:0:6492:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1788638930.882818:0:6492:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788638930.882855:0:6492:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaea581933988 00100000:10000000:3.0:1788638930.882863:0:6492:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788638930.883860:0:6492:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788638930.883884:0:6492:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.118@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788638930.883905:0:6492:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788638930.883921:0:6492:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1788638930.884820:0:6492:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788638930.885001:0:6492:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1788638931.385664:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638932.405157:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638933.431511:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638934.452781:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638935.484708:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788638935.699475:0:6793:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg618-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1788638936.248900:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788638936.248910:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788638936.248913:0:37:0:(import.c:65:import_set_state_nolock()) 000000004197fc64 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788638936.248926:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000004197fc64 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:3.0:1788638936.248952:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000028bea65e x1875523772878080/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788638936.248978:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b5e1bd76 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523772877952:0@lo:400: 00000100:00100000:3.0:1788638936.248983:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000028bea65e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875523772878080:0@lo:38: 00000100:00100000:3.0:1788638936.249306:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638936.249637:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772878080 00000100:00100000:0.0:1788638936.249646:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772878080 00000100:00100000:0.0:1788638936.249690:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788638936.249696:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000feb56199 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875523772878080:12345-0@lo:38: 00010000:00080000:0.0:1788638936.249719:0:6518:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 195 last 0 00000020:00000080:0.0:1788638936.249754:0:6518:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x25c454990262bd36 00000004:00100000:0.0:1788638936.249795:0:6518:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788638936.249920:0:6518:0:(import.c:65:import_set_state_nolock()) 00000000db93b2ec : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788638936.250002:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000feb56199 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875523772878080:12345-0@lo:38: Request processed in 304us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638936.250009:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788638936.250054:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000028bea65e x1875523772878080/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788638946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788638936.250068:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788638936.250075:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788638936.250080:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788638936.250081:0:3640:0:(import.c:65:import_set_state_nolock()) 000000004197fc64 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788638936.250087:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000028bea65e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875523772878080:0@lo:38: 00000100:00100000:2.0:1788638936.251397:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638936.251528:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772877952 00000100:00100000:1.0:1788638936.251536:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772877952 00000100:00100000:1.0:1788638936.251576:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788638936.251583:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007f2a55ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+11:3643:x1875523772877952:12345-0@lo:400: 00000100:00100000:1.0:1788638936.258138:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007f2a55ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+11:3643:x1875523772877952:12345-0@lo:400: Request processed in 6548us (6736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638936.258153:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788638936.263089:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b5e1bd76 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523772877952:0@lo:400: 00010000:00010000:1.0:1788638936.502866:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788638936.558919:0:6845:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788638936.559093:0:6845:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788638937.538696:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638938.549047:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788638939.556076:0:6947:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788638939.556250:0:6947:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788638939.579161:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788638940.340698:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788638940.340706:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ae3461e3800 from 3 10000000:01000000:0.0:1788638940.340711:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788638940.340753:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: 00000000ead9f13a/0x25c454990262bd3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638940.340765:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: 00000000ead9f13a/0x25c454990262bd3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638940.340782:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: 00000000ead9f13a/0x25c454990262bd3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638940.340803:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000583864ad pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772878208:0@lo:101: 00000100:00100000:0.0:1788638940.340864:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638940.341000:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 0000000056db732f going to sleep for 11 seconds 00000100:00100000:2.0:1788638940.341128:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772878208 00000100:00100000:2.0:1788638940.341136:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772878208 00000100:00100000:2.0:1788638940.341193:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788638940.341201:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000266c4471 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+11:6513:x1875523772878208:12345-0@lo:101: 00010000:00010000:2.0:1788638940.341214:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638940.341227:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000012ddb085/0x25c454990262bd44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262bd3d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638940.341249:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000012ddb085/0x25c454990262bd44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262bd3d expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638940.341258:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000012ddb085/0x25c454990262bd44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262bd3d expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638940.341266:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000012ddb085, rc 0) 00000100:00100000:2.0:1788638940.341311:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000266c4471 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+12:6513:x1875523772878208:12345-0@lo:101: Request processed in 111us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638940.341317:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788638940.341750:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000583864ad pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772878208:0@lo:101: 00010000:00010000:0.0:1788638940.341765:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: 00000000ead9f13a/0x25c454990262bd3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bd44 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638940.341773:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: 00000000ead9f13a/0x25c454990262bd3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262bd44 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638940.341890:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000583864ad pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772878336:0@lo:256: 00000100:00100000:0.0:1788638940.342006:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638940.342047:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 0000000056db732f going to sleep for 11 seconds 00000100:00100000:3.0:1788638940.342146:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772878336 00000100:00100000:3.0:1788638940.342152:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772878336 00000100:00100000:3.0:1788638940.342187:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788638940.342193:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045d5b6a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+12:6513:x1875523772878336:12345-0@lo:256: 20000000:01000000:3.0:1788638940.342208:0:6510:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788638940.342223:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788638940.342226:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1788638940.342300:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045d5b6a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+12:6513:x1875523772878336:12345-0@lo:256: Request processed in 107us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638940.342308:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788638940.342387:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000583864ad pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772878336:0@lo:256: 10000000:01000000:0.0:1788638940.342986:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788638940.342994:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: 00000000ead9f13a/0x25c454990262bd3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bd44 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638940.343004:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: 00000000ead9f13a/0x25c454990262bd3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bd44 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638940.597860:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638941.365242:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000056c12339 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875523772878592:0@lo:400: 00000100:00100000:1.0:1788638941.365330:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638941.365490:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005409133e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01f1eef9-e690-4065-bf99-bf821af7b626:3644:1875523772878464:0@lo:400: 00000100:00100000:2.0:1788638941.365536:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638941.365588:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772878464 00000100:00100000:0.0:1788638941.365601:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772878464 00000100:00100000:0.0:1788638941.365673:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788638941.365680:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000258c8443 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+12:3644:x1875523772878464:12345-0@lo:400: 00000100:00100000:0.0:1788638941.365733:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000258c8443 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+12:3644:x1875523772878464:12345-0@lo:400: Request processed in 54us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638941.365739:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788638941.365835:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005409133e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01f1eef9-e690-4065-bf99-bf821af7b626:3644:1875523772878464:0@lo:400: 00000100:00100000:3.0:1788638941.366126:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772878592 00000100:00100000:3.0:1788638941.366132:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772878592 00000100:00100000:3.0:1788638941.366168:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788638941.366173:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000088247761 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875523772878592:12345-0@lo:400: 00000100:00100000:3.0:1788638941.366224:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000088247761 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875523772878592:12345-0@lo:400: Request processed in 51us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638941.366240:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788638941.366419:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000056c12339 x1875523772878592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638941.366431:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000056c12339 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875523772878592:0@lo:400: 00010000:00010000:3.0:1788638941.621432:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638942.648027:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638943.669091:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638944.702434:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638945.717127:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638946.484790:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788638946.484813:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000056c12339 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772878720:0@lo:400: 00000100:00100000:1.0:1788638946.484875:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638946.485044:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788638946.485053:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c4d42836 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875523772878848:0@lo:400: 00000100:00100000:2.0:1788638946.485083:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638946.485112:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772878720 00000100:00100000:2.0:1788638946.485118:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772878720 00000100:00100000:2.0:1788638946.485156:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788638946.485163:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000701f44e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+12:3641:x1875523772878720:12345-0@lo:400: 00000100:00100000:2.0:1788638946.485207:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000701f44e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+12:3641:x1875523772878720:12345-0@lo:400: Request processed in 44us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638946.485214:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788638946.485262:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000056c12339 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772878720:0@lo:400: 00000100:00100000:1.0:1788638946.485610:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772878848 00000100:00100000:1.0:1788638946.485638:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772878848 00000100:00100000:2.0:1788638946.485773:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788638946.485780:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bd8cb8d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875523772878848:12345-0@lo:400: 00000100:00100000:2.0:1788638946.485820:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bd8cb8d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875523772878848:12345-0@lo:400: Request processed in 41us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638946.485826:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788638946.485851:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c4d42836 x1875523772878848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638946.485863:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c4d42836 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875523772878848:0@lo:400: 00010000:00010000:0.0:1788638946.740706:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638947.766366:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638948.795301:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788638949.027181:0:7445:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788638949.027186:0:7445:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788638949.027187:0:7445:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788638949.027342:0:7445:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000022cc2117 00000020:01000004:2.0:1788638949.027369:0:7445:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1788638949.027384:0:7445:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788638949.027396:0:7445:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (0000000092653340) 00000020:00000080:2.0:1788638949.027410:0:7445:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788638949.095578:0:7445:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:1.0:1788638949.096060:0:7445:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:2.0:1788638949.154575:0:7445:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788638949.155243:0:7445:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1788638949.155255:0:7445:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788638949.155265:0:7445:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x25c454990262bd52 00000020:01000004:0.0:1788638949.155272:0:7445:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788638949.155291:0:7445:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.118@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788638949.155294:0:7445:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.118@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788638949.155300:0:7445:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1788638949.155323:0:7445:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1788638949.155327:0:7445:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.118@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1788638949.181051:0:7445:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.118@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788638949.181227:0:7445:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.206.118@tcp, index=0001, flags=0x20061 00000020:01000004:0.0:1788638949.181232:0:7445:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788638949.181233:0:7445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788638949.181235:0:7445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788638949.181236:0:7445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788638949.181237:0:7445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788638949.181238:0:7445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788638949.181239:0:7445:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788638949.181241:0:7445:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788638949.181242:0:7445:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788638949.181244:0:7445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788638949.181245:0:7445:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788638949.181253:0:7445:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:0.0:1788638949.181255:0:7445:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788638949.181256:0:7445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788638949.181257:0:7445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788638949.181258:0:7445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788638949.181259:0:7445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788638949.181260:0:7445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788638949.181260:0:7445:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788638949.181261:0:7445:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788638949.181262:0:7445:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788638949.181263:0:7445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788638949.181263:0:7445:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788638949.181287:0:7445:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788638949.181303:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000583864ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:7445:1875523772878976:0@lo:253: 00000100:00100000:0.0:1788638949.181389:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638949.181534:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b16b6916 going to sleep for 11 seconds 00000100:00100000:2.0:1788638949.181576:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772878976 00000100:00100000:2.0:1788638949.181585:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772878976 00000100:00100000:2.0:1788638949.181667:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788638949.181676:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000667fd6ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+12:7445:x1875523772878976:12345-0@lo:253: 20000000:01000000:2.0:1788638949.181705:0:6511:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788638949.181709:0:6511:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:2.0:1788638949.181714:0:6511:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:2.0:1788638949.181717:0:6511:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:2.0:1788638949.181760:0:6511:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:2.0:1788638949.182234:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788638949.182382:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1788638949.182396:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788638949.182414:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1788638949.182431:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1788638949.182452:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1788638949.182507:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:2.0:1788638949.182516:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:2.0:1788638949.182528:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:2.0:1788638949.182534:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:2.0:1788638949.182545:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:2.0:1788638949.182549:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:2.0:1788638949.182560:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1788638949.182572:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1788638949.182822:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:2.0:1788638949.182832:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.118@tcp (null) (null) (null) 00000040:00080000:2.0:1788638949.182844:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:2.0:1788638949.182979:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788638949.183009:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:2.0:1788638949.183016:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.206.118@tcp (null) (null) 00000040:00080000:2.0:1788638949.183027:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:2.0:1788638949.183032:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1788638949.183043:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1788638949.183059:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1788638949.183070:0:6511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1788638949.183149:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:2.0:1788638949.183158:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:2.0:1788638949.183170:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1788638949.183185:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1788638949.183199:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:2.0:1788638949.183204:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:2.0:1788638949.183218:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1788638949.183238:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1788638949.183243:0:6511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:2.0:1788638949.183263:0:6511:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788638949.183270:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:2.0:1788638949.184478:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1788638949.185021:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1788638949.185059:0:6511:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.118@tcp for mdt 20000000:01000000:3.0:1788638949.185061:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.118@tcp (null) (null) (null) 00000040:00080000:3.0:1788638949.185077:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1788638949.185085:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788638949.185098:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1788638949.185103:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.206.118@tcp (null) (null) 00000040:00080000:3.0:1788638949.185119:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1788638949.185126:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:3.0:1788638949.185139:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:3.0:1788638949.185155:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:3.0:1788638949.185221:0:6511:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:3.0:1788638949.185230:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:0.0:1788638949.185583:0:7452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:3.0:1788638949.185906:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1788638949.185922:0:6511:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.206.118@tcp for mdt 20000000:01000000:3.0:1788638949.185924:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.118@tcp (null) (null) (null) 00000040:00080000:3.0:1788638949.185939:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1788638949.185945:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788638949.185957:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1788638949.185962:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.206.118@tcp (null) (null) 00000040:00080000:3.0:1788638949.185974:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1788638949.185981:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:3.0:1788638949.185992:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1788638949.186005:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:3.0:1788638949.186021:0:6511:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788638949.186024:0:6511:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788638949.186027:0:6511:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788638949.186068:0:6511:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788638949.186071:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788638949.186389:0:7453:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1788638949.186409:0:7453:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1788638949.186424:0:7453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1788638949.186564:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:3.0:1788638949.186584:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:3.0:1788638949.186599:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:3.0:1788638949.186643:0:6511:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788638949.186646:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788638949.187020:0:7454:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1788638949.187039:0:7454:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1788638949.187053:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:3.0:1788638949.187191:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1788638949.187210:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1788638949.187226:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:3.0:1788638949.187237:0:6511:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788638949.187238:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788638949.188211:0:7455:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1788638949.188242:0:7455:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1788638949.188258:0:7455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1788638949.188458:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1788638949.188479:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1788638949.188502:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1788638949.188517:0:6511:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788638949.188519:0:6511:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788638949.188524:0:6511:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1788638949.188529:0:6511:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788638949.189377:0:7456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:3.0:1788638949.189509:0:6511:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788638949.200007:0:6511:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788638949.200035:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000009dddeee0/0x25c454990262bd59 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638949.200053:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001cf67eec/0x25c454990262bc8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262bc87 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638949.200060:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008837df91/0x25c454990262bcaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262bca3 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638949.200065:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d1186958/0x25c454990262bd1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262bd13 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638949.200071:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000009dddeee0/0x25c454990262bd59 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638949.200128:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d1186958/0x25c454990262bd1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262bd13 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638949.200140:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d1186958/0x25c454990262bd1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262bd13 expref: 12 pid: 6510 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638949.200153:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ea377bf pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1875523772879104:0@lo:104: 00000100:00100000:3.0:1788638949.200211:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788638949.200276:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008837df91/0x25c454990262bcaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262bca3 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638949.200284:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008837df91/0x25c454990262bcaa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262bca3 expref: 12 pid: 6510 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638949.200291:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f26aef06 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1875523772879232:0@lo:104: 00000100:00100000:3.0:1788638949.200312:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788638949.200337:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000001cf67eec/0x25c454990262bc8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262bc87 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638949.200355:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000001cf67eec/0x25c454990262bc8e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262bc87 expref: 12 pid: 6511 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638949.200363:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000050298195 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1875523772879360:0@lo:104: 00000100:00100000:3.0:1788638949.200382:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638949.200393:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set 0000000036096f68 going to sleep for 11 seconds 00000100:00100000:0.0:1788638949.200483:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772879104 00000100:00100000:0.0:1788638949.200490:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772879104 00000100:00100000:0.0:1788638949.200526:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772879232 00000100:00100000:0.0:1788638949.200529:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772879232 00000100:00100000:0.0:1788638949.200539:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772879360 00000100:00100000:0.0:1788638949.200542:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772879360 00000100:00100000:0.0:1788638949.200554:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788638949.200561:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008307515f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+5:6511:x1875523772879104:12345-0@lo:104: 00010000:00010000:0.0:1788638949.200580:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: 0000000089c81974/0x25c454990262bd13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262bd1a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.200794:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788638949.200800:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008307515f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+5:6511:x1875523772879104:12345-0@lo:104: Request processed in 240us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638949.200808:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788638949.200826:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788638949.200831:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7ce8359 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+4:6511:x1875523772879232:12345-0@lo:104: 00010000:00010000:0.0:1788638949.200838:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: 0000000035243370/0x25c454990262bca3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262bcaa expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.200883:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788638949.200888:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7ce8359 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+4:6511:x1875523772879232:12345-0@lo:104: Request processed in 58us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638949.200894:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788638949.200906:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788638949.200912:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001bcc7bc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+3:6511:x1875523772879360:12345-0@lo:104: 00010000:00010000:0.0:1788638949.200918:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: 00000000aeb36e25/0x25c454990262bc87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262bc8e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.200944:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788638949.200947:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001bcc7bc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+3:6511:x1875523772879360:12345-0@lo:104: Request processed in 37us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638949.200953:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788638949.200983:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788638949.200987:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: 0000000089c81974/0x25c454990262bd13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262bd1a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.201000:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000089c81974 already unused, calling callback (0000000071159a97) 10000000:00010000:0.0:1788638949.201003:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: 0000000089c81974/0x25c454990262bd13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262bd1a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.201010:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: 0000000089c81974/0x25c454990262bd13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262bd1a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788638949.201015:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: 0000000089c81974/0x25c454990262bd13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262bd1a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638949.201019:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788638949.201045:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: 0000000089c81974/0x25c454990262bd13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bd1a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.201052:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788638949.201069:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: 0000000089c81974/0x25c454990262bd13 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bd1a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.201074:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: 0000000089c81974/0x25c454990262bd13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bd1a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.201084:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788638949.201086:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: 0000000035243370/0x25c454990262bca3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262bcaa expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.201091:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000035243370 already unused, calling callback (0000000071159a97) 10000000:00010000:0.0:1788638949.201093:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: 0000000035243370/0x25c454990262bca3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262bcaa expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.201108:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: 0000000035243370/0x25c454990262bca3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262bcaa expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788638949.201113:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: 0000000035243370/0x25c454990262bca3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262bcaa expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638949.201118:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788638949.201131:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: 0000000035243370/0x25c454990262bca3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bcaa expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.201137:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788638949.201151:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: 0000000035243370/0x25c454990262bca3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bcaa expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.201157:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: 0000000035243370/0x25c454990262bca3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bcaa expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.201166:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638949.201168:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: 00000000aeb36e25/0x25c454990262bc87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262bc8e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.201173:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000aeb36e25 already unused, calling callback (0000000071159a97) 10000000:00010000:0.0:1788638949.201175:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: 00000000aeb36e25/0x25c454990262bc87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262bc8e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.201180:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: 00000000aeb36e25/0x25c454990262bc87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262bc8e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788638949.201184:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: 00000000aeb36e25/0x25c454990262bc87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262bc8e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638949.201195:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788638949.201208:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: 00000000aeb36e25/0x25c454990262bc87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bc8e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.201213:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788638949.201217:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: 00000000aeb36e25/0x25c454990262bc87 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bc8e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.201222:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: 00000000aeb36e25/0x25c454990262bc87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bc8e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.201234:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638949.201235:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638949.201237:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638949.201243:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638949.201254:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788638949.201265:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000781cfcb5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523772879488:0@lo:103: 00000100:00100000:0.0:1788638949.201294:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638949.201328:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000031995bb2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01f1eef9-e690-4065-bf99-bf821af7b626:3642:1875523772879744:0@lo:103: 00000100:00100000:0.0:1788638949.201360:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638949.201380:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788638949.201385:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c1986416 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01f1eef9-e690-4065-bf99-bf821af7b626:3642:1875523772879616:0@lo:103: 00000100:00100000:0.0:1788638949.201404:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638949.201431:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772879488 00000100:00100000:0.0:1788638949.201435:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772879488 00010000:00010000:0.0:1788638949.201451:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d1186958/0x25c454990262bd1a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262bd13 expref: 13 pid: 6510 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638949.201465:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772879744 00000100:00100000:0.0:1788638949.201475:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772879744 00010000:00010000:0.0:1788638949.201485:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000001cf67eec/0x25c454990262bc8e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262bc87 expref: 14 pid: 6511 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638949.201495:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772879616 00000100:00100000:0.0:1788638949.201497:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772879616 00010000:00010000:0.0:1788638949.201503:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008837df91/0x25c454990262bcaa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262bca3 expref: 15 pid: 6510 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638949.201513:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788638949.201517:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000552f99b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+15:3643:x1875523772879488:12345-0@lo:103: 00010000:00010000:0.0:1788638949.201526:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638949.201529:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d1186958/0x25c454990262bd1a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262bd13 expref: 15 pid: 6510 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.201538:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d1186958/0x25c454990262bd1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262bd13 expref: 15 pid: 6510 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.201552:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788638949.201578:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000552f99b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+15:3643:x1875523772879488:12345-0@lo:103: Request processed in 61us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638949.201584:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788638949.201596:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788638949.201601:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c8c1613 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+14:3642:x1875523772879744:12345-0@lo:103: 00010000:00010000:0.0:1788638949.201608:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638949.201611:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000001cf67eec/0x25c454990262bc8e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262bc87 expref: 14 pid: 6511 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.201645:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000001cf67eec/0x25c454990262bc8e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262bc87 expref: 14 pid: 6511 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.201665:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788638949.201691:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c8c1613 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+14:3642:x1875523772879744:12345-0@lo:103: Request processed in 91us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638949.201697:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788638949.201709:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788638949.201713:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d53e815c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+13:3642:x1875523772879616:12345-0@lo:103: 00010000:00010000:0.0:1788638949.201731:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638949.201735:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008837df91/0x25c454990262bcaa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262bca3 expref: 13 pid: 6510 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.201742:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008837df91/0x25c454990262bcaa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262bca3 expref: 13 pid: 6510 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.201751:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000009dddeee0/0x25c454990262bd59 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.201757:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009dddeee0/0x25c454990262bd59 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.201768:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009dddeee0/0x25c454990262bd59 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.201774:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009dddeee0/0x25c454990262bd59 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.201780:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000009dddeee0/0x25c454990262bd59 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.201785:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000009dddeee0/0x25c454990262bd59 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.201795:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009dddeee0 already unused, calling callback (00000000d43fd8e0) 00010000:00010000:0.0:1788638949.201798:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000009dddeee0/0x25c454990262bd59 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.201805:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000009dddeee0/0x25c454990262bd59 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.201812:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000009dddeee0/0x25c454990262bd59 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.201821:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788638949.201846:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d53e815c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+13:3642:x1875523772879616:12345-0@lo:103: Request processed in 132us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638949.201853:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788638949.201883:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000781cfcb5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523772879488:0@lo:103: 00000100:00100000:0.0:1788638949.201908:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c1986416 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01f1eef9-e690-4065-bf99-bf821af7b626:3642:1875523772879616:0@lo:103: 00000100:00100000:0.0:1788638949.201914:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000031995bb2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01f1eef9-e690-4065-bf99-bf821af7b626:3642:1875523772879744:0@lo:103: 00010000:00010000:3.0:1788638949.202007:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d1186958/0x25c454990262bd1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262bd13 expref: 12 pid: 6510 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638949.202018:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ea377bf pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1875523772879104:0@lo:104: 00010000:00010000:3.0:1788638949.202035:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008837df91/0x25c454990262bcaa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262bca3 expref: 11 pid: 6510 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638949.202042:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f26aef06 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1875523772879232:0@lo:104: 00010000:00010000:3.0:1788638949.202049:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001cf67eec/0x25c454990262bc8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262bc87 expref: 10 pid: 6511 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638949.202056:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000050298195 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1875523772879360:0@lo:104: 00010000:00010000:3.0:1788638949.202069:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000009dddeee0/0x25c454990262bd59 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638949.202077:0:6511:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000009dddeee0/0x25c454990262bd59 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638949.202082:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000009dddeee0/0x25c454990262bd59 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638949.202086:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009dddeee0/0x25c454990262bd59 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788638949.202100:0:6511:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788638949.204322:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000667fd6ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+9:7445:x1875523772878976:12345-0@lo:253: Request processed in 22644us (22929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638949.204336:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788638949.204435:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000583864ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:7445:1875523772878976:0@lo:253: 10000000:01000000:0.0:1788638949.204450:0:7445:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788638949.204452:0:7445:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788638949.204454:0:7445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788638949.204456:0:7445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788638949.204457:0:7445:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:0.0:1788638949.204458:0:7445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788638949.204459:0:7445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788638949.204460:0:7445:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788638949.204462:0:7445:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788638949.204463:0:7445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788638949.204475:0:7445:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788638949.204494:0:7445:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000022cc2117 from lustre-MDT0001 10000000:01000000:0.0:1788638949.204520:0:7445:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1788638949.204523:0:7445:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788638949.204529:0:7445:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ae342e50000 local copy 10000000:01000000:0.0:1788638949.204533:0:7445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788638949.204565:0:7445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: 00000000ba7cc502/0x25c454990262bd60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.204575:0:7445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.118@tcp lock: 00000000ba7cc502/0x25c454990262bd60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.204582:0:7445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: 00000000ba7cc502/0x25c454990262bd60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638949.204597:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000583864ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:7445:1875523772879872:0@lo:101: 00000100:00100000:0.0:1788638949.204823:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638949.204901:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 0000000072752b85 going to sleep for 11 seconds 00000100:00100000:3.0:1788638949.205130:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772879872 00000100:00100000:3.0:1788638949.205137:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772879872 00000100:00100000:3.0:1788638949.205208:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788638949.205216:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ca663de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+9:7445:x1875523772879872:12345-0@lo:101: 00010000:00010000:3.0:1788638949.205229:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638949.205247:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006dd6ae8b/0x25c454990262bd67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262bd60 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638949.205268:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006dd6ae8b/0x25c454990262bd67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262bd60 expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638949.205277:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006dd6ae8b/0x25c454990262bd67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262bd60 expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638949.205286:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006dd6ae8b, rc 0) 00000100:00100000:3.0:1788638949.205330:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ca663de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+10:7445:x1875523772879872:12345-0@lo:101: Request processed in 115us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638949.205336:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788638949.205406:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000583864ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:7445:1875523772879872:0@lo:101: 00010000:00010000:1.0:1788638949.205418:0:7445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: 00000000ba7cc502/0x25c454990262bd60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x25c454990262bd67 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.205426:0:7445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: 00000000ba7cc502/0x25c454990262bd60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x25c454990262bd67 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638949.205523:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022d4ba8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:7445:1875523772880000:0@lo:501: 00000100:00100000:1.0:1788638949.205550:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638949.205799:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 0000000074cf9026 going to sleep for 11 seconds 00000100:00100000:0.0:1788638949.206011:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772880000 00000100:00100000:0.0:1788638949.206016:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772880000 00000100:00100000:0.0:1788638949.206040:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788638949.206047:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab0f606a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+10:7445:x1875523772880000:12345-0@lo:501: 00000100:00100000:0.0:1788638949.206124:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab0f606a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+10:7445:x1875523772880000:12345-0@lo:501: Request processed in 78us (573us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788638949.206131:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788638949.206225:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022d4ba8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:7445:1875523772880000:0@lo:501: 10000000:01000000:1.0:1788638949.206239:0:7445:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.118@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788638949.206257:0:7445:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.118@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788638949.206262:0:7445:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: 00000000ba7cc502/0x25c454990262bd60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x25c454990262bd67 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.206269:0:7445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: 00000000ba7cc502/0x25c454990262bd60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x25c454990262bd67 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.206275:0:7445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: 00000000ba7cc502/0x25c454990262bd60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x25c454990262bd67 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.206291:0:7445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788638949.206316:0:7445:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ae3506e9000 10000000:01000000:1.0:1788638949.206322:0:7445:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788638949.206326:0:7445:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9ae342e50000 10000000:01000000:1.0:1788638949.206328:0:7445:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788638949.206331:0:7445:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9ae342e50000 from 1 10000000:01000000:1.0:1788638949.206333:0:7445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788638949.206371:0:7445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: 000000009d4fbd00/0x25c454990262bd6e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.206379:0:7445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: 000000009d4fbd00/0x25c454990262bd6e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.206386:0:7445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: 000000009d4fbd00/0x25c454990262bd6e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638949.206398:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022d4ba8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:7445:1875523772880128:0@lo:101: 00000100:00100000:1.0:1788638949.206424:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638949.206439:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ed4926d1 going to sleep for 11 seconds 00000100:00100000:3.0:1788638949.206498:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772880128 00000100:00100000:3.0:1788638949.206503:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772880128 00000100:00100000:3.0:1788638949.206525:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788638949.206531:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b129243b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+10:7445:x1875523772880128:12345-0@lo:101: 00010000:00010000:3.0:1788638949.206538:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638949.206548:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000432dd7c4/0x25c454990262bd75 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262bd6e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638949.206562:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000432dd7c4/0x25c454990262bd75 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262bd6e expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638949.206570:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000432dd7c4/0x25c454990262bd75 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262bd6e expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638949.206576:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000432dd7c4, rc 0) 00000100:00100000:3.0:1788638949.206632:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b129243b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+11:7445:x1875523772880128:12345-0@lo:101: Request processed in 85us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638949.206647:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788638949.206723:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022d4ba8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:7445:1875523772880128:0@lo:101: 00010000:00010000:1.0:1788638949.206746:0:7445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: 000000009d4fbd00/0x25c454990262bd6e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bd75 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.206754:0:7445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: 000000009d4fbd00/0x25c454990262bd6e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262bd75 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638949.206768:0:7445:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788638949.206783:0:7445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: 000000009d4fbd00/0x25c454990262bd6e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bd75 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.206790:0:7445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: 000000009d4fbd00/0x25c454990262bd6e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bd75 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638949.206798:0:7445:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ae3506e9000 10000000:01000000:1.0:1788638949.206802:0:7445:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788638949.206804:0:7445:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9ae3506e9000 from 1 10000000:01000000:1.0:1788638949.206806:0:7445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788638949.206827:0:7445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: 000000009551e5a0/0x25c454990262bd7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.206834:0:7445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: 000000009551e5a0/0x25c454990262bd7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.206840:0:7445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: 000000009551e5a0/0x25c454990262bd7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638949.207019:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022d4ba8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:7445:1875523772880256:0@lo:101: 00000100:00100000:1.0:1788638949.207049:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638949.207078:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ed4926d1 going to sleep for 11 seconds 00000100:00100000:3.0:1788638949.207123:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772880256 00000100:00100000:3.0:1788638949.207128:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772880256 00000100:00100000:3.0:1788638949.207148:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788638949.207153:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea70e529 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+11:7445:x1875523772880256:12345-0@lo:101: 00010000:00010000:3.0:1788638949.207160:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638949.207168:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ee84197d/0x25c454990262bd83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262bd7c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638949.207182:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ee84197d/0x25c454990262bd83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262bd7c expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638949.207188:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ee84197d/0x25c454990262bd83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262bd7c expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638949.207194:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ee84197d, rc 0) 00000100:00100000:3.0:1788638949.207232:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea70e529 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+12:7445:x1875523772880256:12345-0@lo:101: Request processed in 79us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638949.207237:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788638949.207302:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022d4ba8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:7445:1875523772880256:0@lo:101: 00010000:00010000:1.0:1788638949.207311:0:7445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: 000000009551e5a0/0x25c454990262bd7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bd83 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.207318:0:7445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: 000000009551e5a0/0x25c454990262bd7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262bd83 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638949.207329:0:7445:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788638949.207342:0:7445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: 000000009551e5a0/0x25c454990262bd7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bd83 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.207358:0:7445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: 000000009551e5a0/0x25c454990262bd7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bd83 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638949.207364:0:7445:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788638949.207367:0:7445:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788638949.207371:0:7445:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ae3506e9000 10000000:01000000:1.0:1788638949.207374:0:7445:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788638949.207382:0:7445:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1788638949.207384:0:7445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788638949.207406:0:7445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: 000000001ee18b68/0x25c454990262bd8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.207412:0:7445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: 000000001ee18b68/0x25c454990262bd8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.207419:0:7445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: 000000001ee18b68/0x25c454990262bd8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638949.207430:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022d4ba8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:7445:1875523772880384:0@lo:101: 00000100:00100000:1.0:1788638949.207455:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638949.207466:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ed4926d1 going to sleep for 11 seconds 00000100:00100000:3.0:1788638949.207516:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772880384 00000100:00100000:3.0:1788638949.207520:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772880384 00000100:00100000:3.0:1788638949.207537:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788638949.207542:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000948a0f4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+12:7445:x1875523772880384:12345-0@lo:101: 00010000:00010000:3.0:1788638949.207549:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638949.207555:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000066430cc2/0x25c454990262bd91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262bd8a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638949.207569:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000066430cc2/0x25c454990262bd91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262bd8a expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638949.207583:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000066430cc2/0x25c454990262bd91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262bd8a expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638949.207589:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000066430cc2, rc 0) 00000100:00100000:3.0:1788638949.207647:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000948a0f4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+13:7445:x1875523772880384:12345-0@lo:101: Request processed in 105us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638949.207653:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788638949.207719:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022d4ba8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:7445:1875523772880384:0@lo:101: 00010000:00010000:1.0:1788638949.207731:0:7445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: 000000001ee18b68/0x25c454990262bd8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bd91 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.207749:0:7445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: 000000001ee18b68/0x25c454990262bd8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262bd91 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638949.207817:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022d4ba8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:7445:1875523772880512:0@lo:501: 00000100:00100000:1.0:1788638949.207841:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638949.208017:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ed4926d1 going to sleep for 11 seconds 00010000:00010000:1.0:1788638949.208110:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788638949.208115:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: 00000000ba7cc502/0x25c454990262bd60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x25c454990262bd67 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.208121:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ba7cc502 already unused, calling callback (0000000071159a97) 10000000:00010000:1.0:1788638949.208131:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: 00000000ba7cc502/0x25c454990262bd60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x25c454990262bd67 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.208138:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: 00000000ba7cc502/0x25c454990262bd60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x25c454990262bd67 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788638949.208144:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: 00000000ba7cc502/0x25c454990262bd60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x25c454990262bd67 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638949.208149:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788638949.208168:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: 00000000ba7cc502/0x25c454990262bd60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x25c454990262bd67 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.208174:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788638949.208192:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: 00000000ba7cc502/0x25c454990262bd60 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x25c454990262bd67 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.208198:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: 00000000ba7cc502/0x25c454990262bd60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x25c454990262bd67 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.208210:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638949.208211:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638949.208212:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638949.208219:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788638949.208228:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000085668b71 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01f1eef9-e690-4065-bf99-bf821af7b626:3644:1875523772880640:0@lo:103: 00000100:00100000:1.0:1788638949.208255:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638949.208409:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772880512 00000100:00100000:2.0:1788638949.208415:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772880512 00000100:00100000:3.0:1788638949.208463:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788638949.208471:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000051c07654 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+13:7445:x1875523772880512:12345-0@lo:501: 00000100:00100000:3.0:1788638949.208572:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000051c07654 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+13:7445:x1875523772880512:12345-0@lo:501: Request processed in 102us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638949.208579:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788638949.208670:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022d4ba8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:7445:1875523772880512:0@lo:501: 00000100:00100000:1.0:1788638949.208696:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022d4ba8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:7445:1875523772880768:0@lo:503: 00000100:00100000:1.0:1788638949.208731:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638949.208756:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ed4926d1 going to sleep for 11 seconds 00000100:00100000:3.0:1788638949.208882:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772880768 00000100:00100000:3.0:1788638949.208887:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772880768 00000100:00100000:3.0:1788638949.208905:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788638949.208910:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005fae95fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+13:7445:x1875523772880768:12345-0@lo:503: 00000100:00100000:3.0:1788638949.208985:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005fae95fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+13:7445:x1875523772880768:12345-0@lo:503: Request processed in 74us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638949.208991:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788638949.209119:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022d4ba8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:7445:1875523772880768:0@lo:503: 00000040:00080000:1.0:1788638949.209331:0:7445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788638949.209413:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022d4ba8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:7445:1875523772880896:0@lo:502: 00000100:00100000:1.0:1788638949.209449:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638949.209473:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ed4926d1 going to sleep for 11 seconds 00000100:00100000:3.0:1788638949.209521:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772880896 00000100:00100000:3.0:1788638949.209525:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772880896 00000100:00100000:3.0:1788638949.209545:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788638949.209551:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000008455a29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+13:7445:x1875523772880896:12345-0@lo:502: 00000100:00100000:3.0:1788638949.209675:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000008455a29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+13:7445:x1875523772880896:12345-0@lo:502: Request processed in 124us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638949.209682:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788638949.209787:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022d4ba8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:7445:1875523772880896:0@lo:502: 00000040:00080000:1.0:1788638949.210090:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788638949.210116:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:1.0:1788638949.210133:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:1.0:1788638949.210146:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:1.0:1788638949.210158:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:1.0:1788638949.210168:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:1.0:1788638949.210182:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:1.0:1788638949.210195:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:1.0:1788638949.210208:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:1.0:1788638949.210220:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:1.0:1788638949.210232:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:1.0:1788638949.210245:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:1.0:1788638949.210260:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:1.0:1788638949.210273:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:1.0:1788638949.210286:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:1.0:1788638949.210297:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:1.0:1788638949.210309:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:1.0:1788638949.210321:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:1.0:1788638949.210334:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:1.0:1788638949.210363:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:1.0:1788638949.210378:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:1.0:1788638949.210390:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:1.0:1788638949.210401:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:1.0:1788638949.210423:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022d4ba8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:7445:1875523772881024:0@lo:502: 00000100:00100000:1.0:1788638949.210467:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638949.210491:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ed4926d1 going to sleep for 11 seconds 00000100:00100000:3.0:1788638949.210559:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772881024 00000100:00100000:3.0:1788638949.210563:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772881024 00000100:00100000:3.0:1788638949.210584:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788638949.210589:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000da6cb4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+13:7445:x1875523772881024:12345-0@lo:502: 00000100:00100000:3.0:1788638949.210691:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000da6cb4ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+13:7445:x1875523772881024:12345-0@lo:502: Request processed in 101us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638949.210697:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788638949.210921:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022d4ba8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:7445:1875523772881024:0@lo:502: 00000040:00080000:1.0:1788638949.210968:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:1.0:1788638949.210975:0:7445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:1.0:1788638949.211643:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788638949.211653:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788638949.211655:0:7457:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788638949.211660:0:7457:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1788638949.211663:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788638949.211675:0:7457:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (0000000021e4b2b2) 00000020:00000080:1.0:1788638949.211701:0:7457:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:1.0:1788638949.211706:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788638949.211982:0:7457:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788638949.211992:0:7457:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x25c454990262bd9f 00000020:00000080:1.0:1788638949.212205:0:7457:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788638949.212209:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788638949.212213:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788638949.212214:0:7457:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788638949.212217:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788638949.212220:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788638949.212221:0:7457:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1788638949.212224:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788638949.212230:0:7457:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (000000009187f1ec) 00000020:00000080:1.0:1788638949.212240:0:7457:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:1.0:1788638949.212244:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788638949.212245:0:7457:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1788638949.212248:0:7457:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1788638949.212254:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788638949.212297:0:7457:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000022cc2117 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1788638949.212320:0:7457:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000740810d1) 00000020:00000080:1.0:1788638949.212329:0:7457:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:1.0:1788638949.212419:0:7457:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788638949.212425:0:7457:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x25c454990262bdb4 00000020:00000080:1.0:1788638949.212521:0:7457:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1788638949.212528:0:7457:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788638949.212532:0:7457:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x25c454990262bdbb 00080000:01000000:1.0:1788638949.212538:0:7457:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788638949.212541:0:7457:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x25c454990262bdc2 00080000:10000000:1.0:1788638949.213109:0:7457:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1788638949.213229:0:7457:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00000100:00100000:2.0:1788638949.224161:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772880640 00000100:00100000:2.0:1788638949.224177:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772880640 00000100:00100000:2.0:1788638949.224246:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788638949.224255:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000037014a13 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+13:3644:x1875523772880640:12345-0@lo:103: 00010000:00010000:2.0:1788638949.224270:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638949.224287:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006dd6ae8b/0x25c454990262bd67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c454990262bd60 expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638949.224303:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788638949.224397:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000037014a13 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+12:3644:x1875523772880640:12345-0@lo:103: Request processed in 144us (16141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638949.224405:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788638949.224445:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000085668b71 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01f1eef9-e690-4065-bf99-bf821af7b626:3644:1875523772880640:0@lo:103: 00010000:00010000:2.0:1788638949.334118:0:7457:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:2.0:1788638949.334366:0:7457:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1788638949.341823:0:7457:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788638949.342241:0:7457:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788638949.361339:0:7457:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788638949.361360:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788638949.361367:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638949.361369:0:7457:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788638949.361372:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788638949.361377:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638949.361379:0:7457:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788638949.361382:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788638949.361387:0:7457:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.118@tcp to nid 0x20000c0a8ce76 (192.168.206.118@tcp) 00000020:00000080:3.0:1788638949.361412:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788638949.361424:0:7457:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (0000000051cf2002) 00000020:00000080:3.0:1788638949.361452:0:7457:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788638949.361458:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788638949.361529:0:7457:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788638949.361536:0:7457:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788638949.361542:0:7457:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x25c454990262bdd0 00010000:00080000:3.0:1788638949.361570:0:7457:0:(ldlm_lib.c:102:import_set_conn()) imp 000000001ceefbaa@lustre-MDT0000-osp-MDT0001: add connection 192.168.206.118@tcp at head 00010000:00010000:3.0:1788638949.366172:0:7457:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:2.0:1788638949.368360:0:7457:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788638949.368374:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788638949.368421:0:7457:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788638949.368443:0:7457:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x25c454990262bdd7 00000100:00080000:2.0:1788638949.368454:0:7457:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788638949.368459:0:7457:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 000000001ceefbaa using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788638949.368493:0:7457:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000090d6bfb9 x1875523772881152/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788638949.368520:0:7457:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1788638949.368582:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788638949.368586:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788638949.368588:0:7457:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1788638949.368590:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788638949.368593:0:7457:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788638949.368595:0:7457:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788638949.368596:0:7457:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788638949.368597:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788638949.368600:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788638949.368601:0:7457:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788638949.368603:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788638949.368608:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788638949.368609:0:7457:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1788638949.368645:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788638949.368687:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000050298195 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875523772881280:0@lo:400: 00000100:00100000:2.0:1788638949.368758:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:01000000:2.0:1788638949.368832:0:7457:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788638949.368849:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788638949.368853:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788638949.368854:0:7457:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1788638949.368857:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788638949.368859:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788638949.368861:0:7457:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788638949.368863:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788638949.368865:0:7457:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788638949.368903:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788638949.368906:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788638949.368907:0:7457:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788638949.368910:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:3.0:1788638949.369031:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772881280 00000100:00100000:3.0:1788638949.369039:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772881280 00000100:00100000:3.0:1788638949.369082:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788638949.369089:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e6f301d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875523772881280:12345-0@lo:400: 00000100:00100000:3.0:1788638949.369139:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e6f301d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875523772881280:12345-0@lo:400: Request processed in 51us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638949.369154:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000000:3.0:1788638949.369177:0:7445:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:3.0:1788638949.369221:0:7445:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788638949.369241:0:7445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: 000000001ee18b68/0x25c454990262bd8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bd91 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638949.369251:0:7445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: 000000001ee18b68/0x25c454990262bd8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bd91 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638949.369256:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000090d6bfb9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523772881152:0@lo:38: 10000000:01000000:3.0:1788638949.369259:0:7445:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ae3506e9000 from 1 10000000:01000000:3.0:1788638949.369261:0:7445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788638949.369282:0:7445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: 000000009dddeee0/0x25c454990262bdde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638949.369289:0:7445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: 000000009dddeee0/0x25c454990262bdde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638949.369290:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788638949.369298:0:7445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: 000000009dddeee0/0x25c454990262bdde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638949.369310:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f26aef06 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:7445:1875523772881408:0@lo:101: 00000100:00100000:3.0:1788638949.369337:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638949.369361:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 000000002c265f5c going to sleep for 11 seconds 00010000:00080000:2.0:1788638949.369427:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000050298195 x1875523772881280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638949.369439:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000050298195 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875523772881280:0@lo:400: 00000100:00100000:2.0:1788638949.369465:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772881152 00000100:00100000:2.0:1788638949.369468:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772881152 00000100:00100000:2.0:1788638949.369494:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788638949.369498:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031995bb2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875523772881152:12345-0@lo:38: 00010000:00080000:2.0:1788638949.369514:0:6521:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:2.0:1788638949.369540:0:6521:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x25c454990262bde5 00000004:00100000:2.0:1788638949.369553:0:6521:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788638949.369558:0:6521:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1788638949.369654:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772881408 00000100:00100000:2.0:1788638949.369658:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772881408 00000100:00100000:2.0:1788638949.369689:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788638949.369694:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee438306 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+12:7445:x1875523772881408:12345-0@lo:101: 00010000:00010000:2.0:1788638949.369702:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638949.369712:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000e2c2ce3/0x25c454990262bdec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262bdde expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638949.369730:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000e2c2ce3/0x25c454990262bdec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262bdde expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638949.369840:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000e2c2ce3/0x25c454990262bdec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262bdde expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638949.369849:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000e2c2ce3, rc 0) 00000100:00100000:2.0:1788638949.370028:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee438306 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+13:7445:x1875523772881408:12345-0@lo:101: Request processed in 334us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638949.370035:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788638949.376285:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f26aef06 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:7445:1875523772881408:0@lo:101: 00010000:00010000:3.0:1788638949.376647:0:7445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: 000000009dddeee0/0x25c454990262bdde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bdec expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638949.376661:0:7445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: 000000009dddeee0/0x25c454990262bdde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262bdec expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638949.378082:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f26aef06 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:7445:1875523772881536:0@lo:256: 00000100:00100000:3.0:1788638949.378146:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638949.378196:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 000000002c265f5c going to sleep for 11 seconds 00000100:00100000:2.0:1788638949.379180:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772881536 00000100:00100000:2.0:1788638949.379191:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772881536 00000100:00100000:2.0:1788638949.379235:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788638949.379243:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007aca6dbe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+13:7445:x1875523772881536:12345-0@lo:256: 20000000:01000000:2.0:1788638949.379264:0:6508:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788638949.379283:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788638949.379286:0:6508:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788638949.379395:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007aca6dbe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+13:7445:x1875523772881536:12345-0@lo:256: Request processed in 153us (1248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638949.379403:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788638949.382093:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f26aef06 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:7445:1875523772881536:0@lo:256: 10000000:01000000:3.0:1788638949.382747:0:7445:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788638949.382769:0:7445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: 000000009dddeee0/0x25c454990262bdde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bdec expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638949.382781:0:7445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: 000000009dddeee0/0x25c454990262bdde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bdec expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788638949.382789:0:7445:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae3506e9000 from 1 10000000:01000000:3.0:1788638949.382792:0:7445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788638949.382826:0:7445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: 000000001cf67eec/0x25c454990262bdf3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638949.382833:0:7445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: 000000001cf67eec/0x25c454990262bdf3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638949.382841:0:7445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: 000000001cf67eec/0x25c454990262bdf3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638949.382859:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f26aef06 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:7445:1875523772881664:0@lo:101: 00000100:00100000:3.0:1788638949.383035:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638949.383072:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 000000002c265f5c going to sleep for 11 seconds 00000100:00100000:2.0:1788638949.383271:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772881664 00000100:00100000:2.0:1788638949.383279:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772881664 00000100:00100000:2.0:1788638949.383320:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788638949.383337:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084c74373 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+13:7445:x1875523772881664:12345-0@lo:101: 00010000:00010000:2.0:1788638949.383360:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638949.383373:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d1186958/0x25c454990262bdfa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262bdf3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638949.383394:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d1186958/0x25c454990262bdfa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262bdf3 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638949.383404:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d1186958/0x25c454990262bdfa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262bdf3 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638949.383412:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d1186958, rc 0) 00000100:00100000:2.0:1788638949.383452:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084c74373 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+14:7445:x1875523772881664:12345-0@lo:101: Request processed in 116us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638949.383458:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788638949.383513:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f26aef06 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:7445:1875523772881664:0@lo:101: 00010000:00010000:2.0:1788638949.383526:0:7445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: 000000001cf67eec/0x25c454990262bdf3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bdfa expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638949.383535:0:7445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: 000000001cf67eec/0x25c454990262bdf3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262bdfa expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638949.383645:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002475338c pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:7445:1875523772881792:0@lo:501: 00000100:00100000:2.0:1788638949.383670:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638949.383688:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 0000000022a8be9b going to sleep for 11 seconds 00000100:00100000:3.0:1788638949.384033:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772881792 00000100:00100000:3.0:1788638949.384038:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772881792 00000100:00100000:3.0:1788638949.384077:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788638949.384084:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0d9b293 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+14:7445:x1875523772881792:12345-0@lo:501: 00000100:00100000:3.0:1788638949.384171:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0d9b293 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+14:7445:x1875523772881792:12345-0@lo:501: Request processed in 88us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638949.384178:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788638949.384875:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002475338c pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:7445:1875523772881792:0@lo:501: 00000100:00100000:2.0:1788638949.385078:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002475338c pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:7445:1875523772881920:0@lo:503: 00000100:00100000:2.0:1788638949.385131:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638949.385152:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 0000000022a8be9b going to sleep for 11 seconds 00000100:00080000:1.0:1788638949.385395:0:6521:0:(import.c:65:import_set_state_nolock()) 0000000075131a66 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788638949.385453:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031995bb2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1875523772881152:12345-0@lo:38: Request processed in 15953us (16162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638949.385466:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788638949.385540:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772881920 00000100:00100000:3.0:1788638949.385546:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772881920 00000100:00100000:3.0:1788638949.385580:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788638949.385587:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ace932a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+14:7445:x1875523772881920:12345-0@lo:503: 00000040:00080000:3.0:1788638949.385646:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788638949.385685:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ace932a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+14:7445:x1875523772881920:12345-0@lo:503: Request processed in 99us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638949.385691:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788638949.385870:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788638949.386009:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1788638949.386017:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788638949.386023:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788638949.386025:0:3640:0:(import.c:65:import_set_state_nolock()) 000000001ceefbaa lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788638949.386037:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000090d6bfb9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523772881152:0@lo:38: 00000100:00100000:2.0:1788638949.386070:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002475338c pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:7445:1875523772881920:0@lo:503: 00000040:00080000:2.0:1788638949.386288:0:7445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788638949.386330:0:7445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:2.0:1788638949.386412:0:7445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788638949.386483:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002475338c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772882048:0@lo:41: 00000100:00100000:2.0:1788638949.386517:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638949.386564:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772882048 00000100:00100000:2.0:1788638949.386570:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772882048 00000100:00100000:2.0:1788638949.386592:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788638949.386597:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000090d6bfb9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3641:x1875523772882048:12345-0@lo:41: 00000004:00000024:2.0:1788638949.387850:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1788638949.388007:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000090d6bfb9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3641:x1875523772882048:12345-0@lo:41: Request processed in 1407us (1487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638949.388016:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788638949.388069:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002475338c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772882048:0@lo:41: 00000040:00080000:1.0:1788638949.391514:0:7462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:2.0:1788638949.392055:0:7445:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1788638949.392091:0:7445:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788638949.392105:0:7445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: 000000001cf67eec/0x25c454990262bdf3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bdfa expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638949.392134:0:7445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: 000000001cf67eec/0x25c454990262bdf3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bdfa expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638949.392188:0:7445:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788638949.392191:0:7445:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ae3506e9000 10000000:01000000:2.0:1788638949.392194:0:7445:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ae3506e9000 10000000:01000000:2.0:1788638949.392198:0:7445:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788638949.392204:0:7445:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ae3506e9000 from 1 10000000:01000000:2.0:1788638949.392206:0:7445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788638949.392242:0:7445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: 00000000a30f2ed1/0x25c454990262be01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638949.392249:0:7445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: 00000000a30f2ed1/0x25c454990262be01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638949.392258:0:7445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: 00000000a30f2ed1/0x25c454990262be01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638949.392281:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002475338c pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:7445:1875523772882176:0@lo:101: 00000100:00100000:2.0:1788638949.392343:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638949.392427:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 0000000019717281 going to sleep for 11 seconds 00000100:00100000:0.0:1788638949.396949:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772882176 00000100:00100000:0.0:1788638949.396964:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772882176 00000100:00100000:0.0:1788638949.397027:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788638949.397047:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007593718f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+14:7445:x1875523772882176:12345-0@lo:101: 00010000:00010000:0.0:1788638949.397063:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638949.397083:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000aeb36e25/0x25c454990262be08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262be01 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.397108:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000aeb36e25/0x25c454990262be08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262be01 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.397118:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000aeb36e25/0x25c454990262be08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262be01 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.397126:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000aeb36e25, rc 0) 00000100:00100000:0.0:1788638949.397244:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007593718f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+15:7445:x1875523772882176:12345-0@lo:101: Request processed in 199us (4901us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638949.397251:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788638949.403157:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002475338c pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:7445:1875523772882176:0@lo:101: 00010000:00010000:2.0:1788638949.403189:0:7445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: 00000000a30f2ed1/0x25c454990262be01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262be08 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638949.403202:0:7445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: 00000000a30f2ed1/0x25c454990262be01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262be08 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638949.403342:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002475338c pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:7445:1875523772882304:0@lo:501: 00000100:00100000:3.0:1788638949.405410:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638949.405502:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 0000000019717281 going to sleep for 11 seconds 00000100:00100000:1.0:1788638949.409008:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772882304 00000100:00100000:1.0:1788638949.409025:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772882304 00000100:00100000:1.0:1788638949.409092:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788638949.409102:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000062cdee4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+15:7445:x1875523772882304:12345-0@lo:501: 00000100:00100000:1.0:1788638949.409277:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000062cdee4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+15:7445:x1875523772882304:12345-0@lo:501: Request processed in 176us (3869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638949.409285:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788638949.409331:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002475338c pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:7445:1875523772882304:0@lo:501: 00000100:00100000:3.0:1788638949.409389:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ea377bf pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:7445:1875523772882432:0@lo:503: 00000100:00100000:3.0:1788638949.409444:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638949.409486:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 00000000821a31a6 going to sleep for 11 seconds 00000100:00100000:0.0:1788638949.409535:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772882432 00000100:00100000:0.0:1788638949.409540:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772882432 00000100:00100000:0.0:1788638949.409603:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788638949.409610:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003c4c123f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+15:7445:x1875523772882432:12345-0@lo:503: 00000100:00100000:0.0:1788638949.409725:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003c4c123f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+15:7445:x1875523772882432:12345-0@lo:503: Request processed in 115us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638949.409732:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788638949.411405:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ea377bf pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:7445:1875523772882432:0@lo:503: 00000040:00080000:1.0:1788638949.411709:0:7445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788638949.413050:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022d4ba8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:7445:1875523772882560:0@lo:502: 00000100:00100000:1.0:1788638949.413119:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638949.413203:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 0000000053f5c97b going to sleep for 11 seconds 00000100:00100000:0.0:1788638949.415543:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772882560 00000100:00100000:0.0:1788638949.415557:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772882560 00000100:00100000:0.0:1788638949.415635:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788638949.415645:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ce7bb93f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+15:7445:x1875523772882560:12345-0@lo:502: 00000100:00100000:0.0:1788638949.416108:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ce7bb93f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+15:7445:x1875523772882560:12345-0@lo:502: Request processed in 465us (2988us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638949.416129:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788638949.416218:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022d4ba8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:7445:1875523772882560:0@lo:502: 00000040:00080000:1.0:1788638949.416444:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788638949.416476:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788638949.416490:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788638949.416501:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788638949.416513:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788638949.416533:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788638949.416549:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788638949.416563:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788638949.416576:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788638949.416589:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788638949.416602:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788638949.416771:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788638949.416805:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788638949.416821:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788638949.416834:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788638949.416848:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788638949.416863:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788638949.416876:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788638949.416889:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788638949.416902:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788638949.417040:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788638949.417056:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788638949.417071:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788638949.417087:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788638949.417102:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1788638949.417135:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1788638949.417151:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1788638949.417166:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:1.0:1788638949.417200:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022d4ba8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:7445:1875523772882688:0@lo:502: 00000100:00100000:1.0:1788638949.417408:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638949.417496:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 0000000053f5c97b going to sleep for 11 seconds 00000100:00100000:2.0:1788638949.417737:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772882688 00000100:00100000:2.0:1788638949.417744:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772882688 00000100:00100000:2.0:1788638949.418062:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788638949.418072:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000013bb3b2c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+15:7445:x1875523772882688:12345-0@lo:502: 00000100:00100000:2.0:1788638949.418186:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000013bb3b2c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+15:7445:x1875523772882688:12345-0@lo:502: Request processed in 116us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638949.418203:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788638949.418282:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022d4ba8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:7445:1875523772882688:0@lo:502: 00000040:00080000:1.0:1788638949.418335:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1788638949.418359:0:7445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1788638949.419482:0:7463:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1788638949.419507:0:7463:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000cd73841c) 00000020:00000080:1.0:1788638949.419528:0:7463:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1788638949.419609:0:7463:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000022cc2117 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788638949.419639:0:7463:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000022cc2117 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788638949.419642:0:7463:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000022cc2117 3 00010000:00080000:1.0:1788638949.419675:0:7463:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b2d1b55f@lustre-MDT0000-lwp-MDT0001: add connection 192.168.206.118@tcp at head 00010000:00010000:1.0:1788638949.423393:0:7463:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:1.0:1788638949.423605:0:7463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1788638949.423672:0:7463:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788638949.423691:0:7463:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x25c454990262be16 00000100:00080000:1.0:1788638949.423702:0:7463:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788638949.423707:0:7463:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000b2d1b55f using connection 192.168.206.118@tcp/0@lo 00000100:00100000:1.0:1788638949.423743:0:7463:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000022d4ba8f x1875523772882816/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788638949.426107:0:7463:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788638949.426336:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022d4ba8f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875523772882816:0@lo:38: 00000100:00100000:3.0:1788638949.426416:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638949.430037:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772882816 00000100:00100000:1.0:1788638949.430049:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772882816 00000100:00100000:1.0:1788638949.430126:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788638949.430143:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007fe0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875523772882816:12345-0@lo:38: 00010000:00080000:1.0:1788638949.430171:0:6516:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:1.0:1788638949.431209:0:6516:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x25c454990262be1d 00000004:00100000:1.0:1788638949.431240:0:6516:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788638949.431285:0:6516:0:(import.c:65:import_set_state_nolock()) 00000000885dcaaa : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788638949.431374:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007fe0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875523772882816:12345-0@lo:38: Request processed in 1230us (4957us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638949.431383:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788638949.431864:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000022d4ba8f x1875523772882816/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788638959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638949.431876:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788638949.431884:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1788638949.431890:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788638949.431901:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788638949.431903:0:3640:0:(import.c:65:import_set_state_nolock()) 00000000b2d1b55f lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788638949.431919:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022d4ba8f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875523772882816:0@lo:38: 00000040:00080000:0.0:1788638949.433027:0:7463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1788638949.433137:0:7445:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1788638949.433166:0:7445:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788638949.433179:0:7445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: 00000000a30f2ed1/0x25c454990262be01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262be08 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.433199:0:7445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: 00000000a30f2ed1/0x25c454990262be01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262be08 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788638949.433397:0:7445:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788638949.433399:0:7445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788638949.433401:0:7445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788638949.433402:0:7445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788638949.433403:0:7445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788638949.433404:0:7445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788638949.433406:0:7445:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788638949.433407:0:7445:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788638949.433409:0:7445:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788638949.433410:0:7445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788638949.433411:0:7445:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788638949.433414:0:7445:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:0.0:1788638949.433417:0:7445:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788638949.433418:0:7445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788638949.433419:0:7445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788638949.433420:0:7445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788638949.433421:0:7445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788638949.433422:0:7445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788638949.433423:0:7445:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788638949.433423:0:7445:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788638949.433425:0:7445:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788638949.433425:0:7445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788638949.433426:0:7445:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788638949.433451:0:7445:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788638949.433465:0:7445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c1986416 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:7445:1875523772882944:0@lo:253: 00000100:00100000:0.0:1788638949.433531:0:7445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638949.433575:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772882944 00000100:00100000:0.0:1788638949.433582:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772882944 00000100:00100000:0.0:1788638949.433642:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788638949.433651:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cdfbc9f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+15:7445:x1875523772882944:12345-0@lo:253: 20000000:01000000:0.0:1788638949.433676:0:6508:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788638949.433689:0:6508:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 40000000:00080000:3.0:1788638949.434090:0:7464:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000100:00100000:1.0:1788638949.436152:0:7445:0:(client.c:2716:ptlrpc_set_wait()) set 0000000084de886b going to sleep for 11 seconds 00000001:00100000:0.0:1788638949.439465:0:6494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1788638949.442325:0:6508:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788638949.442358:0:6508:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1788638949.442579:0:6532:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788638949.442584:0:6532:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788638949.442604:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000089c81974/0x25c454990262be24 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.442709:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000012ddb085/0x25c454990262bd44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262bd3d expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.442716:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000e2c2ce3/0x25c454990262bdec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262bdde expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.442723:0:6532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000089c81974/0x25c454990262be24 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638949.443209:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cdfbc9f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+15:7445:x1875523772882944:12345-0@lo:253: Request processed in 9557us (9676us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638949.443219:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788638949.443386:0:7445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c1986416 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:7445:1875523772882944:0@lo:253: 10000000:01000000:2.0:1788638949.443402:0:7445:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788638949.443406:0:7445:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788638949.443407:0:7445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788638949.443409:0:7445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788638949.443410:0:7445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788638949.443411:0:7445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788638949.443412:0:7445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788638949.443414:0:7445:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788638949.443415:0:7445:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788638949.443417:0:7445:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788638949.443418:0:7445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788638949.443419:0:7445:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788638949.443435:0:7445:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1788638949.444418:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000e2c2ce3/0x25c454990262bdec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262bdde expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.444436:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000e2c2ce3/0x25c454990262bdec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262bdde expref: 14 pid: 6511 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638949.444449:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000781cfcb5 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6532:1875523772883072:0@lo:104: 00000100:00100000:0.0:1788638949.444488:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788638949.444560:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000012ddb085/0x25c454990262bd44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262bd3d expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.444568:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000012ddb085/0x25c454990262bd44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262bd3d expref: 14 pid: 6511 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638949.444576:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000095909143 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6532:1875523772883200:0@lo:104: 00000100:00100000:0.0:1788638949.444595:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638949.444609:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set 000000005054cdab going to sleep for 11 seconds 00000100:00100000:1.0:1788638949.445922:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772883072 00000100:00100000:1.0:1788638949.445931:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772883072 00000100:00100000:1.0:1788638949.445964:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772883200 00000100:00100000:1.0:1788638949.445968:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772883200 00000100:00100000:1.0:1788638949.445983:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788638949.445990:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b20aa24 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+4:6532:x1875523772883072:12345-0@lo:104: 00010000:00010000:1.0:1788638949.446003:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: 000000009dddeee0/0x25c454990262bdde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262bdec expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.446073:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788638949.446079:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b20aa24 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+4:6532:x1875523772883072:12345-0@lo:104: Request processed in 90us (1591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638949.446086:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788638949.446100:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788638949.446106:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bfc8ef29 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+3:6532:x1875523772883200:12345-0@lo:104: 00010000:00010000:1.0:1788638949.446112:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: 00000000ead9f13a/0x25c454990262bd3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262bd44 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.446143:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788638949.446147:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bfc8ef29 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+3:6532:x1875523772883200:12345-0@lo:104: Request processed in 43us (1552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638949.446153:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788638949.446172:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788638949.446186:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: 000000009dddeee0/0x25c454990262bdde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262bdec expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.446205:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009dddeee0 already unused, calling callback (0000000071159a97) 10000000:00010000:1.0:1788638949.446208:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: 000000009dddeee0/0x25c454990262bdde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262bdec expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.446215:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: 000000009dddeee0/0x25c454990262bdde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262bdec expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788638949.446221:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: 000000009dddeee0/0x25c454990262bdde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262bdec expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638949.446430:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788638949.446468:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: 000000009dddeee0/0x25c454990262bdde lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bdec expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.446475:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788638949.446492:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: 000000009dddeee0/0x25c454990262bdde lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bdec expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.446498:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: 000000009dddeee0/0x25c454990262bdde lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bdec expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.446511:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788638949.446513:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: 00000000ead9f13a/0x25c454990262bd3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262bd44 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.446518:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ead9f13a already unused, calling callback (0000000071159a97) 10000000:00010000:1.0:1788638949.446520:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: 00000000ead9f13a/0x25c454990262bd3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262bd44 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.446536:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: 00000000ead9f13a/0x25c454990262bd3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262bd44 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788638949.446541:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: 00000000ead9f13a/0x25c454990262bd3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262bd44 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638949.446546:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788638949.446561:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: 00000000ead9f13a/0x25c454990262bd3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bd44 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.446566:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788638949.446580:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: 00000000ead9f13a/0x25c454990262bd3d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bd44 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.446586:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: 00000000ead9f13a/0x25c454990262bd3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bd44 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.446601:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638949.446602:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638949.446604:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638949.446610:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638949.446646:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009f9d9bce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01f1eef9-e690-4065-bf99-bf821af7b626:3642:1875523772883328:0@lo:103: 00000100:00100000:1.0:1788638949.446680:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638949.446716:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a6992602 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523772883456:0@lo:103: 00000100:00100000:1.0:1788638949.446742:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638949.447178:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772883328 00000100:00100000:1.0:1788638949.447184:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772883328 00010000:00010000:1.0:1788638949.447581:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000e2c2ce3/0x25c454990262bdec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262bdde expref: 15 pid: 6511 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638949.447647:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772883456 00000100:00100000:1.0:1788638949.447651:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772883456 00010000:00010000:1.0:1788638949.447663:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000012ddb085/0x25c454990262bd44 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262bd3d expref: 16 pid: 6511 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638949.447676:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788638949.447681:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d49c1da2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01f1eef9-e690-4065-bf99-bf821af7b626+16:3642:x1875523772883328:12345-0@lo:103: 00010000:00010000:1.0:1788638949.447692:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638949.447696:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000e2c2ce3/0x25c454990262bdec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262bdde expref: 16 pid: 6511 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.447705:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000e2c2ce3/0x25c454990262bdec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262bdde expref: 16 pid: 6511 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.447720:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788638949.447934:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000e2c2ce3/0x25c454990262bdec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262bdde expref: 16 pid: 6511 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638949.447947:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000781cfcb5 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6532:1875523772883072:0@lo:104: 00000100:00100000:0.0:1788638949.447958:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000095909143 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6532:1875523772883200:0@lo:104: 00010000:00010000:0.0:1788638949.447976:0:6532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000089c81974/0x25c454990262be24 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638949.448329:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d49c1da2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01f1eef9-e690-4065-bf99-bf821af7b626+15:3642:x1875523772883328:12345-0@lo:103: Request processed in 646us (1648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638949.448337:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788638949.448749:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788638949.449516:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000df340cd6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01f1eef9-e690-4065-bf99-bf821af7b626+14:3643:x1875523772883456:12345-0@lo:103: 00010000:00010000:1.0:1788638949.449534:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638949.449540:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000012ddb085/0x25c454990262bd44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262bd3d expref: 14 pid: 6511 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.449552:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000012ddb085/0x25c454990262bd44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262bd3d expref: 14 pid: 6511 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.449566:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000012ddb085/0x25c454990262bd44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262bd3d expref: 14 pid: 6511 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.449594:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000089c81974/0x25c454990262be24 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.449602:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000089c81974/0x25c454990262be24 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788638949.449638:0:6502:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007054721s 00010000:00010000:1.0:1788638949.449642:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000089c81974/0x25c454990262be24 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.449649:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000089c81974/0x25c454990262be24 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.449654:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000089c81974/0x25c454990262be24 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.449660:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000089c81974/0x25c454990262be24 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.449666:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000089c81974 already unused, calling callback (00000000d43fd8e0) 00010000:00010000:1.0:1788638949.449669:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000089c81974/0x25c454990262be24 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.449677:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000089c81974/0x25c454990262be24 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.449695:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000089c81974/0x25c454990262be24 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.449705:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638949.450320:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000df340cd6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01f1eef9-e690-4065-bf99-bf821af7b626+13:3643:x1875523772883456:12345-0@lo:103: Request processed in 1021us (3034us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638949.450328:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788638949.450425:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a6992602 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523772883456:0@lo:103: 00000100:00100000:1.0:1788638949.450454:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009f9d9bce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01f1eef9-e690-4065-bf99-bf821af7b626:3642:1875523772883328:0@lo:103: 00010000:00010000:0.0:1788638949.451086:0:6532:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000089c81974/0x25c454990262be24 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.451097:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000089c81974/0x25c454990262be24 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.451103:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000089c81974/0x25c454990262be24 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1788638949.460801:0:7445:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:2.0:1788638949.464558:0:7445:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788638949.468465:0:7445:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1788638949.471012:0:7445:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788638949.471593:0:7445:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1788638949.472117:0:7445:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1788638949.474869:0:7445:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1788638949.475108:0:7445:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1788638949.475366:0:7445:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:1.0:1788638949.475525:0:7445:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1788638949.475721:0:7445:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:1.0:1788638949.475904:0:7445:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:3.0:1788638949.479837:0:7445:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1788638949.480131:0:7468:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1788638949.480136:0:7468:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788638949.480456:0:7469:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:3.0:1788638949.480501:0:7469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ff14feb0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7469:1875523772883584:0@lo:700: 00000100:00100000:3.0:1788638949.480555:0:7469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638949.480608:0:7469:0:(client.c:2716:ptlrpc_set_wait()) set 0000000087755817 going to sleep for 11 seconds 00000100:00100000:2.0:1788638949.480696:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772883584 00000100:00100000:2.0:1788638949.480710:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772883584 00000100:00100000:2.0:1788638949.480753:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788638949.480770:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000381b865a pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7469:x1875523772883584:12345-0@lo:700: 00000040:01000000:1.0:1788638949.481586:0:7445:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1788638949.484064:0:7470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c83a3d34 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1875523772883712:0@lo:1000: 00000100:00100000:2.0:1788638949.484126:0:7470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638949.484211:0:7470:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f47cd69e going to sleep for 11 seconds 00000040:01000000:1.0:1788638949.484829:0:7445:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1788638949.484966:0:7445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788638949.485425:0:7445:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788638949.485433:0:7445:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1788638949.485559:0:7445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788638949.486574:0:7445:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788638949.487126:0:7445:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788638949.487157:0:7445:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1788638949.487323:0:7445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 10000000:01000000:0.0:1788638949.487822:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788638949.487826:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ae3506e9000 from 4 10000000:01000000:0.0:1788638949.487830:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788638949.487873:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: 0000000089c81974/0x25c454990262be2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.487899:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: 0000000089c81974/0x25c454990262be2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.487918:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: 0000000089c81974/0x25c454990262be2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638949.487939:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000095909143 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772883840:0@lo:101: 00000100:00100000:0.0:1788638949.487997:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638949.488039:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 000000005054cdab going to sleep for 11 seconds 00000100:00100000:2.0:1788638949.488388:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772883840 00000100:00100000:2.0:1788638949.488397:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772883840 00000100:00100000:2.0:1788638949.488452:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788638949.488459:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000695af569 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+13:6513:x1875523772883840:12345-0@lo:101: 00010000:00010000:2.0:1788638949.488471:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638949.488482:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003181a630/0x25c454990262be32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262be2b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638949.488501:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003181a630/0x25c454990262be32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262be2b expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638949.488511:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003181a630/0x25c454990262be32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262be2b expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638949.488519:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003181a630, rc 0) 00000100:00100000:2.0:1788638949.488556:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000695af569 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+14:6513:x1875523772883840:12345-0@lo:101: Request processed in 97us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638949.488563:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788638949.488672:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772883712 00000100:00100000:3.0:1788638949.488677:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772883712 00000100:00100000:3.0:1788638949.488738:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788638949.488745:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c415ca5c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7470:x1875523772883712:12345-0@lo:1000: 00000100:00100000:3.0:1788638949.489074:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c415ca5c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7470:x1875523772883712:12345-0@lo:1000: Request processed in 330us (4949us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638949.489081:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788638949.489145:0:7470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c83a3d34 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1875523772883712:0@lo:1000: 00000040:01000000:2.0:1788638949.489176:0:7470:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:2.0:1788638949.489213:0:7470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c83a3d34 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1875523772883968:0@lo:700: 00000100:00100000:2.0:1788638949.489240:0:7470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638949.489266:0:7470:0:(client.c:2716:ptlrpc_set_wait()) set 00000000db497eb5 going to sleep for 11 seconds 00000100:00100000:0.0:1788638949.489419:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772883968 00000100:00100000:0.0:1788638949.489424:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772883968 00000100:00100000:0.0:1788638949.489456:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788638949.489462:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034308add pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7470:x1875523772883968:12345-0@lo:700: 00000100:00100000:0.0:1788638949.489506:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034308add pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7470:x1875523772883968:12345-0@lo:700: Request processed in 45us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638949.489513:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788638949.489539:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000095909143 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772883840:0@lo:101: 00010000:00010000:0.0:1788638949.489552:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: 0000000089c81974/0x25c454990262be2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262be32 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.489561:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: 0000000089c81974/0x25c454990262be2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262be32 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638949.489602:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000095909143 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772884096:0@lo:256: 00000100:00100000:0.0:1788638949.489659:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638949.489683:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 000000005054cdab going to sleep for 11 seconds 00000100:00100000:0.0:1788638949.489696:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772884096 00000100:00100000:0.0:1788638949.489704:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772884096 00000100:00100000:0.0:1788638949.489726:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788638949.489731:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e6246df9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+14:6513:x1875523772884096:12345-0@lo:256: 20000000:01000000:0.0:1788638949.489743:0:6508:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788638949.489769:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788638949.489772:0:6508:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788638949.490078:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e6246df9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+14:6513:x1875523772884096:12345-0@lo:256: Request processed in 346us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638949.490085:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788638949.490116:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000095909143 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772884096:0@lo:256: 10000000:01000000:0.0:1788638949.490156:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788638949.490162:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: 0000000089c81974/0x25c454990262be2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262be32 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.490169:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: 0000000089c81974/0x25c454990262be2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262be32 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638949.490178:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788638949.490180:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ae3461e3800 from 21 10000000:01000000:0.0:1788638949.490183:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788638949.490276:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: 00000000c22da064/0x25c454990262be39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.490283:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: 00000000c22da064/0x25c454990262be39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.490290:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: 00000000c22da064/0x25c454990262be39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638949.490302:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000095909143 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772884224:0@lo:101: 00000100:00100000:0.0:1788638949.490334:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638949.490363:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 000000005054cdab going to sleep for 11 seconds 00000100:00100000:0.0:1788638949.490378:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772884224 00000100:00100000:0.0:1788638949.490382:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772884224 00000100:00100000:0.0:1788638949.490405:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788638949.490411:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000530b0768 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+14:6513:x1875523772884224:12345-0@lo:101: 00010000:00010000:0.0:1788638949.490418:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638949.490429:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ead9f13a/0x25c454990262be40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262be39 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.490445:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ead9f13a/0x25c454990262be40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262be39 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.490454:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ead9f13a/0x25c454990262be40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262be39 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.490461:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ead9f13a, rc 0) 00000100:00100000:0.0:1788638949.490490:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000530b0768 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+15:6513:x1875523772884224:12345-0@lo:101: Request processed in 80us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638949.490496:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788638949.490523:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000095909143 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772884224:0@lo:101: 00010000:00010000:0.0:1788638949.490532:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: 00000000c22da064/0x25c454990262be39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262be40 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.490540:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: 00000000c22da064/0x25c454990262be39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262be40 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638949.490585:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000095909143 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772884352:0@lo:501: 00000100:00100000:0.0:1788638949.490639:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638949.490653:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 000000005054cdab going to sleep for 11 seconds 00000100:00100000:0.0:1788638949.490664:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772884352 00000100:00100000:0.0:1788638949.490667:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772884352 00000100:00100000:0.0:1788638949.490687:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788638949.490692:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c7e2e6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+15:6513:x1875523772884352:12345-0@lo:501: 00000100:00100000:2.0:1788638949.491283:0:7470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c83a3d34 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1875523772883968:0@lo:700: 00000100:00100000:2.0:1788638949.491330:0:7470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c83a3d34 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7470:1875523772884480:0@lo:900: 00000100:00100000:2.0:1788638949.491374:0:7470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638949.491391:0:7470:0:(client.c:2716:ptlrpc_set_wait()) set 00000000db497eb5 going to sleep for 11 seconds 00080000:10000000:1.0:1788638949.492724:0:7445:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000100:00100000:0.0:1788638949.495125:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c7e2e6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+15:6513:x1875523772884352:12345-0@lo:501: Request processed in 4426us (4480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638949.495139:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788638949.495578:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000095909143 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772884352:0@lo:501: 00000100:00100000:3.0:1788638949.495653:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009d4fdde8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772884608:0@lo:503: 00000100:00100000:3.0:1788638949.495711:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638949.495744:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 00000000953c48de going to sleep for 11 seconds 00000100:00100000:0.0:1788638949.495929:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772884480 00000100:00100000:0.0:1788638949.495936:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772884480 00000100:00100000:0.0:1788638949.495976:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788638949.495984:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cfeedf21 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7470:x1875523772884480:12345-0@lo:900: 00000100:00100000:0.0:1788638949.496041:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cfeedf21 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7470:x1875523772884480:12345-0@lo:900: Request processed in 58us (4667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638949.496047:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 40000000:02000000:0.0:1788638949.496074:0:6523:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:2.0:1788638949.496305:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772884608 00000100:00100000:2.0:1788638949.496310:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772884608 00000100:00100000:2.0:1788638949.496338:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788638949.496354:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b67fc309 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+15:6513:x1875523772884608:12345-0@lo:503: 00000100:00100000:2.0:1788638949.496450:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b67fc309 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+15:6513:x1875523772884608:12345-0@lo:503: Request processed in 107us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638949.496457:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788638949.496500:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009d4fdde8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772884608:0@lo:503: 00010000:00080000:3.0:1788638949.497329:0:7470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c83a3d34 x1875523772884480/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788638965 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638949.497352:0:7470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c83a3d34 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7470:1875523772884480:0@lo:900: 00000100:00100000:3.0:1788638949.497439:0:7470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000056cee6e4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1875523772884736:0@lo:1000: 00000100:00100000:3.0:1788638949.497486:0:7470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638949.497510:0:7470:0:(client.c:2716:ptlrpc_set_wait()) set 000000007c9d5b89 going to sleep for 11 seconds 00000100:00100000:2.0:1788638949.497949:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772884736 00000100:00100000:2.0:1788638949.497956:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772884736 00000100:00100000:2.0:1788638949.497993:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788638949.498000:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d8ab07e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7470:x1875523772884736:12345-0@lo:1000: 00000100:00100000:2.0:1788638949.498064:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d8ab07e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7470:x1875523772884736:12345-0@lo:1000: Request processed in 65us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638949.498071:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788638949.498552:0:7470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000056cee6e4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1875523772884736:0@lo:1000: 00000004:00080000:3.0:1788638949.498600:0:7470:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000088175f8b with version 0 00000020:00100000:3.0:1788638949.498640:0:7470:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788638949.498646:0:7470:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000056cee6e4 x1875523772884992/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788638949.498661:0:7470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000056cee6e4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1875523772884992:0@lo:1000: 00000100:00100000:3.0:1788638949.498694:0:7470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638949.498715:0:7470:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bfe95fb4 going to sleep for 11 seconds 00000100:00100000:2.0:1788638949.499038:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772884992 00000100:00100000:2.0:1788638949.499044:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772884992 00000100:00100000:2.0:1788638949.499080:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788638949.499086:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006dce3adc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7470:x1875523772884992:12345-0@lo:1000: 00100000:10000000:1.0:1788638949.500889:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1788638949.501038:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1788638949.501173:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1788638949.501329:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1788638949.501513:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1788638949.501767:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1788638949.501890:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1788638949.502029:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1788638949.502179:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1788638949.505380:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1788638949.505606:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1788638949.511512:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1788638949.511714:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1788638949.511844:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1788638949.511962:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1788638949.512094:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1788638949.513226:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1788638949.513391:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1788638949.513523:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1788638949.513746:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00000100:00100000:0.0:1788638949.514594:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000381b865a pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7469:x1875523772883584:12345-0@lo:700: Request processed in 33821us (34034us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638949.514611:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788638949.515032:0:7471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000781cfcb5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:7471:1875523772885120:0@lo:502: 00000100:00100000:0.0:1788638949.515078:0:7471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638949.515110:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772885120 00000100:00100000:0.0:1788638949.515116:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772885120 00000100:00100000:0.0:1788638949.515150:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788638949.515157:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007e79efd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+15:7471:x1875523772885120:12345-0@lo:502: 00100000:10000000:1.0:1788638949.515593:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1788638949.515770:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00000100:00100000:0.0:1788638949.516119:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007e79efd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+15:7471:x1875523772885120:12345-0@lo:502: Request processed in 962us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638949.516132:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788638949.516186:0:7471:0:(client.c:2716:ptlrpc_set_wait()) set 0000000036140259 going to sleep for 11 seconds 00000100:00100000:0.0:1788638949.516216:0:7471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000781cfcb5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:7471:1875523772885120:0@lo:502: 00000100:00100000:0.0:1788638949.516260:0:7471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000781cfcb5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:7471:1875523772885248:0@lo:502: 00000100:00100000:0.0:1788638949.516288:0:7471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638949.516306:0:7471:0:(client.c:2716:ptlrpc_set_wait()) set 0000000036140259 going to sleep for 11 seconds 00100000:10000000:1.0:1788638949.516749:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1788638949.517358:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1788638949.517485:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1788638949.517648:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00000100:00100000:2.0:1788638949.518263:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772885248 00000100:00100000:2.0:1788638949.518274:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772885248 00000100:00100000:2.0:1788638949.518315:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788638949.518331:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f1a8e8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+15:7471:x1875523772885248:12345-0@lo:502: 00000100:00100000:2.0:1788638949.518467:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f1a8e8e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+15:7471:x1875523772885248:12345-0@lo:502: Request processed in 137us (2177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638949.518475:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788638949.518668:0:7471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000781cfcb5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:7471:1875523772885248:0@lo:502: 00000040:00080000:0.0:1788638949.518700:0:7471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00100000:10000000:1.0:1788638949.519022:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1788638949.519185:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00000020:01000000:2.0:1788638949.519393:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1788638949.519414:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788638949.519422:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: 00000000c22da064/0x25c454990262be39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262be40 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638949.519432:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: 00000000c22da064/0x25c454990262be39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262be40 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638949.519440:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788638949.519442:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ae3461e3800 from 4 10000000:01000000:2.0:1788638949.519445:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788638949.519471:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: 0000000004ba1b72/0x25c454990262be47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638949.519478:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: 0000000004ba1b72/0x25c454990262be47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638949.519486:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: 0000000004ba1b72/0x25c454990262be47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638949.519502:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bc0e3ce6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772885376:0@lo:101: 00000100:00100000:2.0:1788638949.519538:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638949.519566:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 0000000091e4a112 going to sleep for 11 seconds 00000100:00100000:2.0:1788638949.519580:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772885376 00000100:00100000:2.0:1788638949.519584:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772885376 00000100:00100000:2.0:1788638949.519609:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00100000:10000000:1.0:1788638949.519935:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1788638949.520070:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1788638949.520210:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1788638949.520378:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1788638949.520573:0:7445:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1788638949.521097:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000082bf482c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+15:6513:x1875523772885376:12345-0@lo:101: 00010000:00010000:2.0:1788638949.521110:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638949.521124:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d1b946ca/0x25c454990262be4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262be47 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638949.521148:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d1b946ca/0x25c454990262be4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262be47 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638949.521159:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d1b946ca/0x25c454990262be4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262be47 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638949.521167:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d1b946ca, rc 0) 00000100:00100000:2.0:1788638949.521232:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000082bf482c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+16:6513:x1875523772885376:12345-0@lo:101: Request processed in 141us (1694us total) trans 0 rc 0/0 00010000:00080000:3.0:1788638949.521371:0:7469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ff14feb0 x1875523772883584/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788638965 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638949.521386:0:7469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ff14feb0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7469:1875523772883584:0@lo:700: 40000000:02000000:3.0:1788638949.521397:0:7469:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000001:00080000:1.0:1788638949.529550:0:7445:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788638949.529587:0:7445:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffaea58557b988 00100000:10000000:1.0:1788638949.529595:0:7445:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1788638949.533579:0:7445:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788638949.533609:0:7445:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.118@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788638949.533657:0:7445:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788638949.533680:0:7445:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1788638949.534433:0:7445:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788638949.534643:0:7445:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:1.0:1788638949.539790:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bc0e3ce6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772885376:0@lo:101: 00010000:00010000:1.0:1788638949.539818:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: 0000000004ba1b72/0x25c454990262be47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262be4e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.539831:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: 0000000004ba1b72/0x25c454990262be47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262be4e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638949.539911:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009f9d9bce pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772885504:0@lo:256: 00000100:00100000:1.0:1788638949.539969:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638949.540011:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 000000007fc630af going to sleep for 11 seconds 00000100:00100000:2.0:1788638949.540924:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788638949.540963:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772885504 00000100:00100000:2.0:1788638949.540968:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772885504 00000100:00100000:2.0:1788638949.541006:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788638949.541013:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd8b7099 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+16:6513:x1875523772885504:12345-0@lo:256: 20000000:01000000:2.0:1788638949.541031:0:6510:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788638949.541044:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788638949.541046:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000001:00080000:3.0:1788638949.548565:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:1.0:1788638949.551323:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006dce3adc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7470:x1875523772884992:12345-0@lo:1000: Request processed in 52232us (52623us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788638949.551338:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:1.0:1788638949.551410:0:7470:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1788638949.551414:0:7470:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788638949.551429:0:7470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000056cee6e4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1875523772884992:0@lo:1000: 00000100:00100000:1.0:1788638949.551519:0:7470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a6992602 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1875523772885632:0@lo:1000: 00000100:00100000:1.0:1788638949.551557:0:7470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638949.551586:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772885632 00000100:00100000:1.0:1788638949.551598:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772885632 00000100:00100000:1.0:1788638949.551657:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788638949.551664:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000037014a13 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7470:x1875523772885632:12345-0@lo:1000: 00000100:00100000:1.0:1788638949.551723:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000037014a13 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7470:x1875523772885632:12345-0@lo:1000: Request processed in 59us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638949.551729:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788638949.551768:0:7470:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bb2c2e6c going to sleep for 11 seconds 00000100:00100000:1.0:1788638949.553996:0:7470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a6992602 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1875523772885632:0@lo:1000: 00000040:00080000:1.0:1788638949.554028:0:7470:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1788638949.554065:0:7470:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000006ccd85d8 with version 1 00000004:00080000:1.0:1788638949.554093:0:7460:0:(osp_trans.c:1336:osp_get_next_request()) ou 0000000040571528 version 1 rpc_version 1 00000020:00100000:1.0:1788638949.554113:0:7460:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788638949.554119:0:7460:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000a6992602 x1875523772885888/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788638949.554137:0:7460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a6992602 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7460:1875523772885888:0@lo:1000: 00000100:00100000:1.0:1788638949.554187:0:7460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638949.555925:0:7460:0:(client.c:2716:ptlrpc_set_wait()) set 000000003eeee850 going to sleep for 11 seconds 00000100:00100000:1.0:1788638949.555956:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772885888 00000100:00100000:1.0:1788638949.555964:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772885888 00000100:00100000:1.0:1788638949.556007:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788638949.556015:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d49c1da2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7460:x1875523772885888:12345-0@lo:1000: 00000040:00080000:1.0:1788638949.568784:0:7470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788638949.572953:0:7470:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000001:00080000:1.0:1788638949.580512:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:1.0:1788638949.580647:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d49c1da2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7460:x1875523772885888:12345-0@lo:1000: Request processed in 24630us (26456us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788638949.580658:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:1.0:1788638949.580720:0:7460:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1788638949.580724:0:7460:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788638949.580741:0:7460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a6992602 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7460:1875523772885888:0@lo:1000: 00000100:00100000:3.0:1788638949.593604:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd8b7099 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+16:6513:x1875523772885504:12345-0@lo:256: Request processed in 52586us (53630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638949.593638:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788638949.594699:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009f9d9bce pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772885504:0@lo:256: 10000000:01000000:3.0:1788638949.594757:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788638949.594766:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: 0000000004ba1b72/0x25c454990262be47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262be4e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638949.594777:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: 0000000004ba1b72/0x25c454990262be47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262be4e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788638949.594786:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788638949.594795:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1788638949.594798:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788638949.594828:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: 000000007181c2a9/0x25c454990262be55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638949.594835:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: 000000007181c2a9/0x25c454990262be55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638949.594843:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: 000000007181c2a9/0x25c454990262be55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638949.594940:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ff14feb0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772886016:0@lo:101: 00000100:00100000:3.0:1788638949.594986:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638949.597194:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 000000002c265f5c going to sleep for 11 seconds 00000100:00100000:2.0:1788638949.602444:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772886016 00000100:00100000:2.0:1788638949.602458:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772886016 00000040:00080000:0.0:1788638949.617735:0:7469:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788638949.626102:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788638949.626115:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000986c9bf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+16:6513:x1875523772886016:12345-0@lo:101: 00010000:00010000:2.0:1788638949.626132:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638949.626149:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000088232fc4/0x25c454990262be5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262be55 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638949.626204:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000088232fc4/0x25c454990262be5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262be55 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638949.626215:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000088232fc4/0x25c454990262be5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262be55 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638949.626223:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000088232fc4, rc 0) 00000100:00100000:2.0:1788638949.626288:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000986c9bf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+17:6513:x1875523772886016:12345-0@lo:101: Request processed in 176us (31303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638949.626295:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788638949.626338:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ff14feb0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772886016:0@lo:101: 00010000:00010000:2.0:1788638949.626366:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: 000000007181c2a9/0x25c454990262be55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262be5c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638949.626375:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: 000000007181c2a9/0x25c454990262be55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262be5c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638949.626442:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000093e83720 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772886144:0@lo:501: 00000100:00100000:2.0:1788638949.626475:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638949.626509:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 000000006874b919 going to sleep for 11 seconds 00000100:00100000:2.0:1788638949.626525:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772886144 00000100:00100000:2.0:1788638949.626530:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772886144 00000100:00100000:2.0:1788638949.626549:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788638949.626555:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087faf45f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+17:6513:x1875523772886144:12345-0@lo:501: 00000100:00100000:2.0:1788638949.626677:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087faf45f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+17:6513:x1875523772886144:12345-0@lo:501: Request processed in 122us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638949.626684:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788638949.626721:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000093e83720 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772886144:0@lo:501: 00000100:00100000:2.0:1788638949.626747:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000093e83720 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772886272:0@lo:503: 00000100:00100000:2.0:1788638949.626783:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638949.626795:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 000000006874b919 going to sleep for 11 seconds 00000100:00100000:2.0:1788638949.626807:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772886272 00000100:00100000:2.0:1788638949.626810:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772886272 00000100:00100000:2.0:1788638949.626826:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788638949.626831:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e4ae769 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+17:6513:x1875523772886272:12345-0@lo:503: 00000100:00100000:2.0:1788638949.626919:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e4ae769 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+17:6513:x1875523772886272:12345-0@lo:503: Request processed in 87us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638949.626925:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788638949.626961:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000093e83720 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772886272:0@lo:503: 00000040:00080000:0.0:1788638949.629953:0:7469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788638949.630045:0:7469:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788638949.630049:0:7469:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000100:00100000:1.0:1788638949.635751:0:7476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a6992602 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:7476:1875523772886400:0@lo:502: 00000100:00100000:1.0:1788638949.635831:0:7476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638949.635887:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772886400 00000100:00100000:1.0:1788638949.635894:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772886400 00000100:00100000:1.0:1788638949.635936:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788638949.635944:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000426a8dff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+17:7476:x1875523772886400:12345-0@lo:502: 00000100:00100000:1.0:1788638949.636053:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000426a8dff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+17:7476:x1875523772886400:12345-0@lo:502: Request processed in 110us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638949.636061:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788638949.636108:0:7476:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bb2c2e6c going to sleep for 11 seconds 00000100:00100000:1.0:1788638949.636129:0:7476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a6992602 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:7476:1875523772886400:0@lo:502: 00000020:01000000:1.0:1788638949.636156:0:7476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788638949.636167:0:7476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788638949.636169:0:7476:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788638949.636174:0:7476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788638949.636177:0:7476:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.118@tcp to nid 0x20000c0a8ce76 (192.168.206.118@tcp) 00000020:00000080:1.0:1788638949.636201:0:7476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788638949.636215:0:7476:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000adb78caf) 00000020:00000080:1.0:1788638949.636235:0:7476:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:1.0:1788638949.636240:0:7476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788638949.636309:0:7476:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788638949.636314:0:7476:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788638949.636320:0:7476:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x25c454990262be6a 00010000:00080000:1.0:1788638949.636358:0:7476:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000d448ce58@lustre-MDT0001-osp-MDT0000: add connection 192.168.206.118@tcp at head 00010000:00010000:1.0:1788638949.661231:0:7476:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:1.0:1788638949.670992:0:7476:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788638949.671007:0:7476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788638949.671048:0:7476:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788638949.671068:0:7476:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x25c454990262be71 00000100:00080000:1.0:1788638949.671078:0:7476:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788638949.671083:0:7476:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000d448ce58 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:1.0:1788638949.671117:0:7476:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a6992602 x1875523772886528/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788638949.671146:0:7476:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:1.0:1788638949.671217:0:7476:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1788638949.671484:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a6992602 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523772886528:0@lo:38: 00000100:00100000:2.0:1788638949.671563:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638949.674005:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772886528 00000100:00100000:1.0:1788638949.674022:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772886528 00000100:00100000:1.0:1788638949.674073:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788638949.674082:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000093e83720 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875523772886528:12345-0@lo:38: 00010000:00080000:1.0:1788638949.674123:0:6522:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:1.0:1788638949.674163:0:6522:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x25c454990262be78 00000004:00100000:1.0:1788638949.674178:0:6522:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788638949.674183:0:6522:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1788638949.679165:0:7481:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@000000005d0d581d x1875523772886656/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638949.679180:0:7481:0:(client.c:2716:ptlrpc_set_wait()) set 000000000cf27bf7 going to sleep for 0 seconds 00000020:01000000:1.0:1788638949.683826:0:7476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788638949.683836:0:7476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788638949.683838:0:7476:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1788638949.683842:0:7476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788638949.683861:0:7476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788638949.683863:0:7476:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788638949.683867:0:7476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788638949.683868:0:7476:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788638949.683909:0:7476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005b05fd81 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:7476:1875523772886784:0@lo:502: 00000100:00100000:1.0:1788638949.683982:0:7476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638949.684018:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772886784 00000100:00100000:1.0:1788638949.684032:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772886784 00000100:00100000:1.0:1788638949.684073:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788638949.684081:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d86cb6b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+17:7476:x1875523772886784:12345-0@lo:502: 00000100:00100000:1.0:1788638949.684186:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d86cb6b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+17:7476:x1875523772886784:12345-0@lo:502: Request processed in 105us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638949.684194:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788638949.684246:0:7476:0:(client.c:2716:ptlrpc_set_wait()) set 0000000049be543a going to sleep for 11 seconds 00000100:00100000:1.0:1788638949.684266:0:7476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005b05fd81 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:7476:1875523772886784:0@lo:502: 00000020:01000000:1.0:1788638949.684290:0:7476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788638949.684294:0:7476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788638949.684295:0:7476:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788638949.684298:0:7476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1788638949.684340:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1788638949.684370:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788638949.684378:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: 000000007181c2a9/0x25c454990262be55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262be5c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.684388:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: 000000007181c2a9/0x25c454990262be55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262be5c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638949.684397:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788638949.684399:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ae342e50000 from 1 10000000:01000000:1.0:1788638949.684401:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788638949.684424:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: 00000000aafee9b0/0x25c454990262be7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.684431:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: 00000000aafee9b0/0x25c454990262be7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638949.684440:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: 00000000aafee9b0/0x25c454990262be7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638949.684458:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005b05fd81 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772886912:0@lo:101: 00000100:00100000:1.0:1788638949.684484:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638949.684508:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 0000000049be543a going to sleep for 11 seconds 00000100:00100000:0.0:1788638949.684613:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772886912 00000100:00100000:0.0:1788638949.684633:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772886912 00000100:00100000:0.0:1788638949.684661:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788638949.684667:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cc50aa7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+17:6513:x1875523772886912:12345-0@lo:101: 00010000:00010000:0.0:1788638949.684676:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638949.684691:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ba7cc502/0x25c454990262be86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262be7f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.684711:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ba7cc502/0x25c454990262be86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262be7f expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.684730:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ba7cc502/0x25c454990262be86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262be7f expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.684737:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ba7cc502, rc 0) 00000100:00100000:0.0:1788638949.684776:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cc50aa7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+18:6513:x1875523772886912:12345-0@lo:101: Request processed in 110us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638949.684781:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788638949.684816:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005b05fd81 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772886912:0@lo:101: 00010000:00010000:0.0:1788638949.684827:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: 00000000aafee9b0/0x25c454990262be7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262be86 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.684834:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: 00000000aafee9b0/0x25c454990262be7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262be86 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638949.684879:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000781cfcb5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772887040:0@lo:501: 00000100:00100000:0.0:1788638949.684904:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638949.684918:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 0000000036140259 going to sleep for 11 seconds 00000100:00100000:0.0:1788638949.684930:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772887040 00000100:00100000:0.0:1788638949.684933:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772887040 00000100:00100000:0.0:1788638949.684967:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788638949.684973:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c4d04a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+18:6513:x1875523772887040:12345-0@lo:501: 00000100:00100000:0.0:1788638949.685031:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c4d04a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+18:6513:x1875523772887040:12345-0@lo:501: Request processed in 58us (127us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788638949.685038:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788638949.685070:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000781cfcb5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772887040:0@lo:501: 10000000:01000000:0.0:1788638949.685090:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788638949.685099:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: 00000000aafee9b0/0x25c454990262be7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262be86 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638949.685105:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: 00000000aafee9b0/0x25c454990262be7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262be86 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788638949.695364:0:6522:0:(import.c:65:import_set_state_nolock()) 00000000dad1c16c : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788638949.695460:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000093e83720 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1875523772886528:12345-0@lo:38: Request processed in 21376us (23895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638949.695470:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788638949.695527:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788638949.695536:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788638949.695544:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788638949.695549:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788638949.695551:0:3640:0:(import.c:65:import_set_state_nolock()) 00000000d448ce58 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1788638949.695571:0:3640:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000000cf27bf7): req@000000005d0d581d x1875523772886656/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638949.695586:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a6992602 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523772886528:0@lo:38: 00000100:00100000:2.0:1788638949.697124:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788638949.697145:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009afcbeb0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772887168:0@lo:41: 00000100:00100000:2.0:1788638949.697202:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638949.697249:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772887168 00000100:00100000:2.0:1788638949.697254:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772887168 00000100:00100000:2.0:1788638949.697292:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788638949.697299:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc0e3ce6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1875523772887168:12345-0@lo:41: 00000004:00000024:2.0:1788638949.697327:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1788638949.697379:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc0e3ce6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1875523772887168:12345-0@lo:41: Request processed in 80us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638949.697392:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788638949.697433:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009afcbeb0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772887168:0@lo:41: 00000100:00100000:2.0:1788638949.697481:0:7481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638949.697494:0:7481:0:(client.c:2716:ptlrpc_set_wait()) set 000000000cf27bf7 going to sleep for 11 seconds 00000100:00100000:2.0:1788638949.697506:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772886656 00000100:00100000:2.0:1788638949.697509:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772886656 00000100:00100000:2.0:1788638949.697528:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788638949.697533:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009afcbeb0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7481:x1875523772886656:12345-0@lo:1000: 00000100:00100000:2.0:1788638949.697592:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009afcbeb0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7481:x1875523772886656:12345-0@lo:1000: Request processed in 59us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638949.697599:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788638949.697650:0:7481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005d0d581d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7481:1875523772886656:0@lo:1000: 00000040:01000000:2.0:1788638949.697679:0:7481:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788638949.697708:0:7481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005d0d581d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7481:1875523772887296:0@lo:1000: 00000100:00100000:2.0:1788638949.697734:0:7481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638949.697746:0:7481:0:(client.c:2716:ptlrpc_set_wait()) set 000000000cf27bf7 going to sleep for 11 seconds 00000100:00100000:2.0:1788638949.697769:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772887296 00000100:00100000:2.0:1788638949.697772:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772887296 00000100:00100000:2.0:1788638949.697790:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788638949.697795:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c83a3d34 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7481:x1875523772887296:12345-0@lo:1000: 00000100:00100000:2.0:1788638949.697889:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c83a3d34 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7481:x1875523772887296:12345-0@lo:1000: Request processed in 93us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638949.697895:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788638949.697918:0:7481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005d0d581d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7481:1875523772887296:0@lo:1000: 00000100:00100000:2.0:1788638949.697948:0:7481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005d0d581d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7481:1875523772887424:0@lo:700: 00000100:00100000:2.0:1788638949.697980:0:7481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638949.698003:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772887424 00000100:00100000:0.0:1788638949.698007:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772887424 00000100:00100000:0.0:1788638949.698036:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788638949.698042:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db57498b pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7481:x1875523772887424:12345-0@lo:700: 00000100:00100000:2.0:1788638949.698075:0:7481:0:(client.c:2716:ptlrpc_set_wait()) set 000000009cb4939a going to sleep for 11 seconds 00000100:00100000:0.0:1788638949.708105:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db57498b pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7481:x1875523772887424:12345-0@lo:700: Request processed in 10055us (10116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638949.708120:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788638949.709369:0:7481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005d0d581d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7481:1875523772887424:0@lo:700: 00000100:00100000:0.0:1788638949.709969:0:7481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000781cfcb5 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7481:1875523772887552:0@lo:1000: 00000100:00100000:0.0:1788638949.710029:0:7481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638949.710063:0:7481:0:(client.c:2716:ptlrpc_set_wait()) set 0000000072752b85 going to sleep for 11 seconds 00000100:00100000:0.0:1788638949.710161:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772887552 00000100:00100000:0.0:1788638949.713458:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772887552 00000100:00100000:0.0:1788638949.713525:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788638949.713534:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc83b5c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7481:x1875523772887552:12345-0@lo:1000: 00000100:00100000:0.0:1788638949.713659:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc83b5c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7481:x1875523772887552:12345-0@lo:1000: Request processed in 126us (3630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638949.713666:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788638949.713714:0:7481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000781cfcb5 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7481:1875523772887552:0@lo:1000: 00000004:00080000:0.0:1788638949.713773:0:7481:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000036140259 with version 0 00000020:00100000:0.0:1788638949.713794:0:7481:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788638949.713805:0:7481:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000781cfcb5 x1875523772887808/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788638949.713823:0:7481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000781cfcb5 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7481:1875523772887808:0@lo:1000: 00000100:00100000:0.0:1788638949.713973:0:7481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638949.713996:0:7481:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ac69d1ce going to sleep for 11 seconds 00000100:00100000:0.0:1788638949.714009:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772887808 00000100:00100000:0.0:1788638949.714013:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772887808 00000100:00100000:0.0:1788638949.714035:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788638949.714040:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000012b00cb2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7481:x1875523772887808:12345-0@lo:1000: 00000001:00080000:1.0:1788638949.721571:0:7446:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:1.0:1788638949.721585:0:7446:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788638949.721825:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000012b00cb2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7481:x1875523772887808:12345-0@lo:1000: Request processed in 7782us (7850us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788638949.721836:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00080000:1.0:1788638949.722010:0:7481:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1788638949.722014:0:7481:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788638949.722034:0:7481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000781cfcb5 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7481:1875523772887808:0@lo:1000: 00000100:00100000:1.0:1788638949.722115:0:7481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a6992602 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7481:1875523772887936:0@lo:1000: 00000100:00100000:1.0:1788638949.722152:0:7481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638949.722192:0:7481:0:(client.c:2716:ptlrpc_set_wait()) set 0000000008031067 going to sleep for 11 seconds 00000100:00100000:0.0:1788638949.722607:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772887936 00000100:00100000:0.0:1788638949.722630:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772887936 00000100:00100000:0.0:1788638949.722667:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788638949.722674:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024b8e887 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7481:x1875523772887936:12345-0@lo:1000: 00000100:00100000:0.0:1788638949.722741:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024b8e887 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7481:x1875523772887936:12345-0@lo:1000: Request processed in 68us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638949.722748:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788638949.722773:0:7481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a6992602 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7481:1875523772887936:0@lo:1000: 00000040:00080000:0.0:1788638949.722789:0:7481:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1788638949.722816:0:7481:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000023e6438 with version 1 00000004:00080000:1.0:1788638949.724984:0:7479:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000003eeee850 version 1 rpc_version 1 00000020:00100000:1.0:1788638949.725023:0:7479:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788638949.725038:0:7479:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000ff077ba4 x1875523772888192/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788638949.725059:0:7479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ff077ba4 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7479:1875523772888192:0@lo:1000: 00000100:00100000:1.0:1788638949.725113:0:7479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638949.725149:0:7479:0:(client.c:2716:ptlrpc_set_wait()) set 00000000451a2f4e going to sleep for 11 seconds 00000100:00100000:1.0:1788638949.725166:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772888192 00000100:00100000:1.0:1788638949.725171:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772888192 00000100:00100000:1.0:1788638949.725205:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788638949.725212:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000591e02db pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7479:x1875523772888192:12345-0@lo:1000: 00000040:00080000:0.0:1788638949.729894:0:7481:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788638949.729966:0:7481:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788638949.729971:0:7481:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:2.0:1788638949.755168:0:7446:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:0.0:1788638949.756777:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000591e02db pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7479:x1875523772888192:12345-0@lo:1000: Request processed in 31561us (31660us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788638949.756803:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:0.0:1788638949.758322:0:7479:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1788638949.758330:0:7479:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788638949.758361:0:7479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ff077ba4 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7479:1875523772888192:0@lo:1000: 00010000:00010000:3.0:1788638949.812724:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638950.841295:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638951.860818:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638952.886102:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638953.909177:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638954.677056:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000028108a10 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875523772888448:0@lo:400: 00000100:00100000:1.0:1788638954.677135:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638954.677193:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788638954.677199:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ad95b2a6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01f1eef9-e690-4065-bf99-bf821af7b626:3642:1875523772888320:0@lo:400: 00000100:00100000:1.0:1788638954.677226:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638954.677247:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ff077ba4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772888832:0@lo:400: 00000100:00100000:1.0:1788638954.677271:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638954.677296:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005557b9a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772888576:0@lo:400: 00000100:00100000:1.0:1788638954.677330:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638954.677347:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788638954.677352:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000012aeeba5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875523772888704:0@lo:400: 00000100:00100000:1.0:1788638954.677390:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638954.677424:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772888448 00000100:00100000:1.0:1788638954.677431:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772888448 00000100:00100000:1.0:1788638954.677468:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772888704 00000100:00100000:1.0:1788638954.677471:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772888704 00000100:00100000:1.0:1788638954.677503:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788638954.677510:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a6992602 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875523772888448:12345-0@lo:400: 00000100:00100000:1.0:1788638954.677568:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a6992602 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875523772888448:12345-0@lo:400: Request processed in 59us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638954.677575:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788638954.677590:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788638954.677595:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000022d4ba8f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875523772888704:12345-0@lo:400: 00000100:00100000:1.0:1788638954.677644:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000022d4ba8f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875523772888704:12345-0@lo:400: Request processed in 49us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638954.677650:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788638954.677667:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772888320 00000100:00100000:1.0:1788638954.677670:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772888320 00000100:00100000:1.0:1788638954.677691:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788638954.677696:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000be6277a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+18:3642:x1875523772888320:12345-0@lo:400: 00000100:00100000:1.0:1788638954.677725:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000be6277a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+18:3642:x1875523772888320:12345-0@lo:400: Request processed in 29us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638954.677730:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:1.0:1788638954.677769:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000012aeeba5 x1875523772888704/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638954.677783:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000012aeeba5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875523772888704:0@lo:400: 00000100:00100000:1.0:1788638954.677809:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ad95b2a6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01f1eef9-e690-4065-bf99-bf821af7b626:3642:1875523772888320:0@lo:400: 00010000:00080000:1.0:1788638954.677817:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000028108a10 x1875523772888448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638954.677825:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000028108a10 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875523772888448:0@lo:400: 00000100:00100000:0.0:1788638954.677924:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772888832 00000100:00100000:0.0:1788638954.677928:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772888832 00000100:00100000:0.0:1788638954.677947:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772888576 00000100:00100000:0.0:1788638954.677949:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772888576 00000100:00100000:0.0:1788638954.677959:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788638954.677964:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b05fd81 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772888832:12345-0@lo:400: 00000100:00100000:0.0:1788638954.678015:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b05fd81 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772888832:12345-0@lo:400: Request processed in 51us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638954.678022:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788638954.678034:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788638954.678039:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f9d9bce pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772888576:12345-0@lo:400: 00000100:00100000:0.0:1788638954.678072:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f9d9bce pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772888576:12345-0@lo:400: Request processed in 34us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638954.678078:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788638954.678108:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005557b9a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772888576:0@lo:400: 00000100:00100000:0.0:1788638954.679555:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788638954.679573:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002440ae0a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772888960:0@lo:41: 00000100:00100000:0.0:1788638954.679654:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638954.679700:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772888960 00000100:00100000:0.0:1788638954.679706:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772888960 00000100:00100000:0.0:1788638954.679744:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788638954.679751:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084ba0891 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772888960:12345-0@lo:41: 00000004:00000024:0.0:1788638954.679794:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1788638954.679852:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084ba0891 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772888960:12345-0@lo:41: Request processed in 101us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638954.679858:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788638954.679898:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002440ae0a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772888960:0@lo:41: 00000100:00100000:1.0:1788638954.681788:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ff077ba4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772888832:0@lo:400: 00010000:00010000:1.0:1788638954.939968:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788638955.131594:0:7720:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg618-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788638955.192005:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788638955.192029:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002440ae0a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772889088:0@lo:41: 00000100:00100000:0.0:1788638955.192091:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638955.192162:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772889088 00000100:00100000:0.0:1788638955.192169:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772889088 00000100:00100000:0.0:1788638955.192227:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788638955.192235:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bfc2a9cb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772889088:12345-0@lo:41: 00000004:00000024:0.0:1788638955.192265:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1788638955.192312:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bfc2a9cb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772889088:12345-0@lo:41: Request processed in 78us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638955.192330:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788638955.192374:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002440ae0a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772889088:0@lo:41: 00010000:00010000:3.0:1788638955.960842:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788638956.155263:0:7772:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788638956.156561:0:7772:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788638956.983200:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638958.006235:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638959.028791:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788638959.094121:0:7874:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788638959.096509:0:7874:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788638959.799890:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788638959.799911:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ff077ba4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772889216:0@lo:41: 00000100:00100000:1.0:1788638959.799972:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638959.800027:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772889216 00000100:00100000:1.0:1788638959.800035:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772889216 00000100:00100000:1.0:1788638959.800073:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788638959.800081:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000028108a10 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772889216:12345-0@lo:41: 00000004:00000024:1.0:1788638959.800123:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1788638959.800321:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000028108a10 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772889216:12345-0@lo:41: Request processed in 240us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638959.800328:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788638959.800374:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ff077ba4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772889216:0@lo:41: 00000100:00100000:2.0:1788638959.801402:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002475338c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772889344:0@lo:400: 00000100:00100000:2.0:1788638959.801451:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638959.801487:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788638959.801492:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000508d57d0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875523772889472:0@lo:400: 00000100:00100000:2.0:1788638959.801517:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638959.801925:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ede276d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772889728:0@lo:400: 00000100:00100000:3.0:1788638959.801962:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638959.801983:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788638959.801988:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c6b19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875523772889600:0@lo:400: 00000100:00100000:3.0:1788638959.802009:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638959.802090:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772889472 00000100:00100000:1.0:1788638959.802106:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772889472 00000100:00100000:0.0:1788638959.802873:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772889344 00000100:00100000:0.0:1788638959.802881:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772889344 00000100:00100000:0.0:1788638959.802918:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788638959.802925:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ed98a32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+18:3641:x1875523772889344:12345-0@lo:400: 00000100:00100000:0.0:1788638959.802985:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ed98a32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+18:3641:x1875523772889344:12345-0@lo:400: Request processed in 61us (1534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638959.802993:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788638959.803504:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772889600 00000100:00100000:1.0:1788638959.803510:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772889600 00000100:00100000:1.0:1788638959.803533:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788638959.803539:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d0d581d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875523772889472:12345-0@lo:400: 00000100:00100000:1.0:1788638959.803580:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d0d581d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875523772889472:12345-0@lo:400: Request processed in 41us (2062us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638959.803586:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788638959.803600:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788638959.803604:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c88e972a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875523772889600:12345-0@lo:400: 00000100:00100000:1.0:1788638959.803656:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c88e972a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875523772889600:12345-0@lo:400: Request processed in 51us (1646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638959.803661:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788638959.803707:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000c6b19880 x1875523772889600/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638959.803720:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c6b19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875523772889600:0@lo:400: 00000100:00100000:1.0:1788638959.803920:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772889728 00000100:00100000:1.0:1788638959.803925:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772889728 00000100:00100000:1.0:1788638959.803958:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788638959.803963:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e8a50194 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772889728:12345-0@lo:400: 00000100:00100000:1.0:1788638959.804001:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e8a50194 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772889728:12345-0@lo:400: Request processed in 38us (2039us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638959.804007:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788638959.804030:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ede276d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772889728:0@lo:400: 00010000:00080000:2.0:1788638959.805007:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000508d57d0 x1875523772889472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638959.805020:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000508d57d0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875523772889472:0@lo:400: 00000100:00100000:2.0:1788638959.805031:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002475338c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772889344:0@lo:400: 00010000:00010000:3.0:1788638960.053989:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788638960.116991:0:7922:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff6fb1e8d0 20000000:00000080:2.0:1788638960.117007:0:7922:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ae36df3ec00 uarg=0000000000000000 20000000:01000000:2.0:1788638960.117048:0:7922:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788638960.117055:0:7922:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788638960.117059:0:7922:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788638960.117129:0:7922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1788638960.117140:0:7922:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1788638960.121537:0:7922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788638960.121903:0:7922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788638960.121934:0:7922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1788638960.121951:0:7922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1788638960.121975:0:7922:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788638960.121993:0:7922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000012df6312/0x25c454990262be8d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638960.122010:0:7922:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000139271d4/0x25c454990262bd0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262bd05 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638960.122017:0:7922:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d1186958/0x25c454990262bdfa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262bdf3 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638960.122023:0:7922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000012df6312/0x25c454990262be8d lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638960.122060:0:7922:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d1186958/0x25c454990262bdfa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262bdf3 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638960.122073:0:7922:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d1186958/0x25c454990262bdfa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262bdf3 expref: 17 pid: 6511 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638960.122086:0:7922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002475338c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7922:1875523772889856:0@lo:104: 00000100:00100000:2.0:1788638960.122156:0:7922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788638960.122257:0:7922:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000139271d4/0x25c454990262bd0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262bd05 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638960.122266:0:7922:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000139271d4/0x25c454990262bd0c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262bd05 expref: 17 pid: 6510 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638960.122274:0:7922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000508d57d0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7922:1875523772889984:0@lo:104: 00000100:00100000:2.0:1788638960.122306:0:7922:0:(client.c:2716:ptlrpc_set_wait()) set 00000000626b0f92 going to sleep for 11 seconds 00000100:00100000:1.0:1788638960.122914:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788638960.122935:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638960.124002:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772889856 00000100:00100000:1.0:1788638960.124012:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772889856 00000100:00100000:3.0:1788638960.124972:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772889984 00000100:00100000:3.0:1788638960.124980:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772889984 00000100:00100000:3.0:1788638960.125009:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788638960.125015:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005128b44a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+4:7922:x1875523772889856:12345-0@lo:104: 00010000:00010000:3.0:1788638960.125041:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: 000000001cf67eec/0x25c454990262bdf3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262bdfa expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638960.125220:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788638960.125226:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005128b44a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+4:7922:x1875523772889856:12345-0@lo:104: Request processed in 211us (3069us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638960.125233:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788638960.125268:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788638960.125274:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff077ba4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+3:7922:x1875523772889984:12345-0@lo:104: 00010000:00010000:3.0:1788638960.125281:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: 000000008f02af0e/0x25c454990262bd05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262bd0c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638960.125324:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788638960.125328:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff077ba4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+3:7922:x1875523772889984:12345-0@lo:104: Request processed in 56us (2394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638960.125334:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1788638960.125351:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788638960.125355:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: 000000001cf67eec/0x25c454990262bdf3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262bdfa expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638960.125362:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001cf67eec already unused, calling callback (0000000071159a97) 10000000:00010000:3.0:1788638960.125365:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: 000000001cf67eec/0x25c454990262bdf3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262bdfa expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638960.125372:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: 000000001cf67eec/0x25c454990262bdf3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262bdfa expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788638960.125378:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: 000000001cf67eec/0x25c454990262bdf3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262bdfa expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788638960.125390:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788638960.125420:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: 000000001cf67eec/0x25c454990262bdf3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bdfa expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638960.125426:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788638960.125445:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: 000000001cf67eec/0x25c454990262bdf3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bdfa expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638960.125451:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: 000000001cf67eec/0x25c454990262bdf3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bdfa expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638960.125460:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788638960.125462:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: 000000008f02af0e/0x25c454990262bd05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262bd0c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638960.125468:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008f02af0e already unused, calling callback (0000000071159a97) 10000000:00010000:3.0:1788638960.125470:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: 000000008f02af0e/0x25c454990262bd05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262bd0c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638960.125475:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: 000000008f02af0e/0x25c454990262bd05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262bd0c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788638960.125480:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: 000000008f02af0e/0x25c454990262bd05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262bd0c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788638960.125485:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788638960.125495:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: 000000008f02af0e/0x25c454990262bd05 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bd0c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638960.125501:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788638960.125510:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: 000000008f02af0e/0x25c454990262bd05 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bd0c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638960.125517:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: 000000008f02af0e/0x25c454990262bd05 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bd0c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638960.125530:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638960.125532:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638960.125533:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638960.125547:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008307515f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772890112:0@lo:103: 00000100:00100000:3.0:1788638960.125582:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638960.125613:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788638960.125641:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c7ce8359 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772890240:0@lo:103: 00000100:00100000:3.0:1788638960.125661:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788638960.125724:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638960.125786:0:7922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002475338c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7922:1875523772889856:0@lo:104: 00000100:00100000:2.0:1788638960.125867:0:7922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000508d57d0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7922:1875523772889984:0@lo:104: 00010000:00010000:2.0:1788638960.125892:0:7922:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000012df6312/0x25c454990262be8d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638960.125986:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772890112 00000100:00100000:1.0:1788638960.125992:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772890112 00010000:00010000:1.0:1788638960.126012:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d1186958/0x25c454990262bdfa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262bdf3 expref: 18 pid: 6511 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638960.126090:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772890240 00000100:00100000:1.0:1788638960.126094:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772890240 00010000:00010000:1.0:1788638960.126106:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000139271d4/0x25c454990262bd0c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262bd05 expref: 19 pid: 6510 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638960.126207:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788638960.126215:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001bcc7bc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01f1eef9-e690-4065-bf99-bf821af7b626+19:3641:x1875523772890112:12345-0@lo:103: 00010000:00010000:0.0:1788638960.126226:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638960.126232:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d1186958/0x25c454990262bdfa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262bdf3 expref: 19 pid: 6511 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638960.126242:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d1186958/0x25c454990262bdfa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262bdf3 expref: 19 pid: 6511 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638960.126255:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d1186958/0x25c454990262bdfa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262bdf3 expref: 19 pid: 6511 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638960.126268:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788638960.126328:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001bcc7bc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01f1eef9-e690-4065-bf99-bf821af7b626+18:3641:x1875523772890112:12345-0@lo:103: Request processed in 116us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638960.126335:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788638960.126349:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788638960.126354:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff14feb0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01f1eef9-e690-4065-bf99-bf821af7b626+17:3641:x1875523772890240:12345-0@lo:103: 00010000:00010000:0.0:1788638960.126361:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638960.126364:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000139271d4/0x25c454990262bd0c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262bd05 expref: 17 pid: 6510 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638960.126372:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000139271d4/0x25c454990262bd0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262bd05 expref: 17 pid: 6510 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638960.126380:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000139271d4/0x25c454990262bd0c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262bd05 expref: 17 pid: 6510 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638960.126389:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000012df6312/0x25c454990262be8d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638960.126403:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000012df6312/0x25c454990262be8d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638960.126415:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000012df6312/0x25c454990262be8d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638960.126421:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000012df6312/0x25c454990262be8d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638960.126427:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000012df6312/0x25c454990262be8d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638960.126432:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000012df6312/0x25c454990262be8d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638960.126436:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000012df6312 already unused, calling callback (00000000d43fd8e0) 00010000:00010000:0.0:1788638960.126440:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000012df6312/0x25c454990262be8d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638960.126446:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000012df6312/0x25c454990262be8d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638960.126465:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000012df6312/0x25c454990262be8d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638960.126474:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788638960.126497:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff14feb0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01f1eef9-e690-4065-bf99-bf821af7b626+16:3641:x1875523772890240:12345-0@lo:103: Request processed in 144us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638960.126503:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788638960.126565:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c7ce8359 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772890240:0@lo:103: 00000100:00100000:3.0:1788638960.126573:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008307515f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772890112:0@lo:103: 00010000:00010000:2.0:1788638960.126644:0:7922:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000012df6312/0x25c454990262be8d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638960.126653:0:7922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000012df6312/0x25c454990262be8d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638960.126658:0:7922:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000012df6312/0x25c454990262be8d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638960.315788:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ad95b2a6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772890368:0@lo:41: 00000100:00100000:0.0:1788638960.315887:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638960.315961:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772890368 00000100:00100000:0.0:1788638960.315968:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772890368 00000100:00100000:0.0:1788638960.316011:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788638960.316019:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002440ae0a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772890368:12345-0@lo:41: 00000004:00000024:0.0:1788638960.316049:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1788638960.316090:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002440ae0a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772890368:12345-0@lo:41: Request processed in 72us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638960.316097:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788638960.316141:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ad95b2a6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772890368:0@lo:41: 00010000:00010000:1.0:1788638961.077085:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638962.100700:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638963.128152:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638964.149702:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638964.916941:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000012aeeba5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772890496:0@lo:41: 00000100:00100000:3.0:1788638964.917037:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638964.920551:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dbd12e6e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772890624:0@lo:400: 00000100:00100000:2.0:1788638964.920567:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772890496 00000100:00100000:2.0:1788638964.920583:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772890496 00000100:00100000:0.0:1788638964.920602:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005b20aa24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875523772890880:0@lo:400: 00000100:00100000:2.0:1788638964.920691:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788638964.920702:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008307515f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772890496:12345-0@lo:41: 00000004:00000024:2.0:1788638964.920739:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1788638964.920949:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000076690681 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875523772890752:0@lo:400: 00000100:00100000:0.0:1788638964.928967:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638964.929011:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008307515f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772890496:12345-0@lo:41: Request processed in 8299us (11963us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638964.929029:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788638964.929120:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788638964.929139:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bfc8ef29 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772891008:0@lo:400: 00000100:00100000:0.0:1788638964.929213:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638964.929435:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772891008 00000100:00100000:0.0:1788638964.929437:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772890880 00000100:00100000:2.0:1788638964.929446:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772891008 00000100:00100000:0.0:1788638964.929448:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772890880 00000100:00100000:2.0:1788638964.929505:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788638964.929519:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000095909143 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772891008:12345-0@lo:400: 00000100:00100000:0.0:1788638964.929526:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788638964.929539:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000781cfcb5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875523772890880:12345-0@lo:400: 00000100:00100000:2.0:1788638964.929603:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000095909143 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772891008:12345-0@lo:400: Request processed in 88us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638964.929662:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000781cfcb5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875523772890880:12345-0@lo:400: Request processed in 77us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638964.929669:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788638964.929680:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788638964.929738:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bfc8ef29 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772891008:0@lo:400: 00010000:00080000:2.0:1788638964.929758:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000005b20aa24 x1875523772890880/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638964.929783:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005b20aa24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875523772890880:0@lo:400: 00000100:00100000:1.0:1788638964.930346:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638964.930867:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772890752 00000100:00100000:0.0:1788638964.930875:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772890752 00000100:00100000:0.0:1788638964.930923:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788638964.930942:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000085668b71 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875523772890752:12345-0@lo:400: 00000100:00100000:0.0:1788638964.931017:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000085668b71 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875523772890752:12345-0@lo:400: Request processed in 78us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638964.931025:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788638964.931071:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000076690681 x1875523772890752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638964.931086:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000076690681 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875523772890752:0@lo:400: 00000100:00100000:2.0:1788638964.932733:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000012aeeba5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772890496:0@lo:41: 00000100:00100000:3.0:1788638964.937872:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638964.938208:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772890624 00000100:00100000:0.0:1788638964.938223:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772890624 00000100:00100000:0.0:1788638964.938348:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788638964.938372:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096aad499 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+16:3641:x1875523772890624:12345-0@lo:400: 00000100:00100000:0.0:1788638964.939793:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096aad499 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+16:3641:x1875523772890624:12345-0@lo:400: Request processed in 1429us (1925us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638964.939808:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788638964.939979:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dbd12e6e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772890624:0@lo:400: 00010000:00010000:3.0:1788638965.173151:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638965.429152:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788638965.429174:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c4d42836 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772891136:0@lo:41: 00000100:00100000:0.0:1788638965.429239:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638965.429355:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772891136 00000100:00100000:2.0:1788638965.429363:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772891136 00000100:00100000:2.0:1788638965.429414:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788638965.429422:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000076690681 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772891136:12345-0@lo:41: 00000004:00000024:2.0:1788638965.429451:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1788638965.429505:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000076690681 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772891136:12345-0@lo:41: Request processed in 84us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638965.429512:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788638965.429666:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c4d42836 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772891136:0@lo:41: 10000000:01000000:0.0:1788638965.940773:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788638965.940785:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae3506e9000 from 1 10000000:01000000:0.0:1788638965.940802:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788638965.940859:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: 000000008ff68b4a/0x25c454990262be94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638965.940872:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: 000000008ff68b4a/0x25c454990262be94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638965.940885:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: 000000008ff68b4a/0x25c454990262be94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638965.940940:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000552f99b3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772891264:0@lo:101: 00000100:00100000:0.0:1788638965.941032:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638965.941108:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 0000000085d71c4c going to sleep for 11 seconds 00000100:00100000:1.0:1788638965.941415:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772891264 00000100:00100000:1.0:1788638965.941435:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772891264 00000100:00100000:1.0:1788638965.941502:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788638965.941513:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ba53e576 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+16:6513:x1875523772891264:12345-0@lo:101: 00010000:00010000:1.0:1788638965.941529:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638965.941544:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c6a1eb6a/0x25c454990262be9b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262be94 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638965.941572:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c6a1eb6a/0x25c454990262be9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262be94 expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638965.941584:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c6a1eb6a/0x25c454990262be9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262be94 expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638965.941594:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c6a1eb6a, rc 0) 00000100:00100000:1.0:1788638965.941695:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ba53e576 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+17:6513:x1875523772891264:12345-0@lo:101: Request processed in 178us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638965.941703:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788638965.942187:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000552f99b3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772891264:0@lo:101: 00010000:00010000:0.0:1788638965.942206:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: 000000008ff68b4a/0x25c454990262be94 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262be9b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638965.942220:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: 000000008ff68b4a/0x25c454990262be94 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262be9b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638965.942326:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000552f99b3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772891392:0@lo:501: 00000100:00100000:0.0:1788638965.942373:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638965.942426:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 0000000085d71c4c going to sleep for 11 seconds 00000100:00100000:1.0:1788638965.943232:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772891392 00000100:00100000:1.0:1788638965.943240:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772891392 00000100:00100000:1.0:1788638965.943301:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788638965.943309:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fdf419ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+17:6513:x1875523772891392:12345-0@lo:501: 00000100:00100000:1.0:1788638965.943490:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fdf419ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+17:6513:x1875523772891392:12345-0@lo:501: Request processed in 181us (1116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638965.943499:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788638965.943952:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000552f99b3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772891392:0@lo:501: 00000100:00100000:0.0:1788638965.943998:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000552f99b3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772891520:0@lo:503: 00000100:00100000:0.0:1788638965.944066:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638965.944101:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 0000000085d71c4c going to sleep for 11 seconds 00000100:00100000:1.0:1788638965.944724:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772891520 00000100:00100000:1.0:1788638965.944732:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772891520 00000100:00100000:1.0:1788638965.944993:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788638965.945022:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000078f761f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+17:6513:x1875523772891520:12345-0@lo:503: 00000100:00100000:1.0:1788638965.947351:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000078f761f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+17:6513:x1875523772891520:12345-0@lo:503: Request processed in 2336us (3271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638965.947370:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788638965.947753:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000552f99b3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772891520:0@lo:503: 00000100:00100000:3.0:1788638965.948574:0:8148:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c7ce8359 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:8148:1875523772891648:0@lo:502: 00000100:00100000:3.0:1788638965.950136:0:8148:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638965.951266:0:8148:0:(client.c:2716:ptlrpc_set_wait()) set 000000007f895677 going to sleep for 11 seconds 00000100:00100000:1.0:1788638965.951555:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772891648 00000100:00100000:1.0:1788638965.951567:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772891648 00000100:00100000:1.0:1788638965.951657:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788638965.951668:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e0cb3d74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+17:8148:x1875523772891648:12345-0@lo:502: 00000100:00100000:1.0:1788638965.951863:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e0cb3d74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+17:8148:x1875523772891648:12345-0@lo:502: Request processed in 196us (1731us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638965.951871:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788638965.951985:0:8148:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c7ce8359 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:8148:1875523772891648:0@lo:502: 00000020:01000000:3.0:1788638965.952025:0:8148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788638965.952038:0:8148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638965.952041:0:8148:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788638965.952048:0:8148:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ae3506e9000 00000020:00000080:3.0:1788638965.952051:0:8148:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788638965.952112:0:8148:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1ab480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:8148:1875523772891776:0@lo:502: 00000100:00100000:3.0:1788638965.952174:0:8148:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638965.952206:0:8148:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae350da6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788638965.952698:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772891776 00000100:00100000:2.0:1788638965.952706:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772891776 00000100:00100000:2.0:1788638965.952744:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788638965.952752:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae369900850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+17:8148:x1875523772891776:12345-0@lo:502: 00000100:00100000:2.0:1788638965.952880:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae369900850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+17:8148:x1875523772891776:12345-0@lo:502: Request processed in 128us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638965.952887:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788638965.953578:0:8148:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1ab480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:8148:1875523772891776:0@lo:502: 00000020:01000000:3.0:1788638965.953657:0:8148:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788638965.953666:0:8148:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638965.953668:0:8148:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788638965.953673:0:8148:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1788638965.956318:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788638965.956364:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788638965.956379:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae340031800/0x25c454990262be94 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262be9b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638965.956394:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae340031800/0x25c454990262be94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262be9b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638965.956409:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788638965.956421:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae3461e3800 from 1 10000000:01000000:2.0:1788638965.956424:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788638965.956471:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae38217a600/0x25c454990262bea2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638965.956481:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae38217a600/0x25c454990262bea2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638965.956494:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae38217a600/0x25c454990262bea2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638965.956523:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342e3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772891904:0@lo:101: 00000100:00100000:2.0:1788638965.956605:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638965.957034:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d325600 going to sleep for 11 seconds 00000100:00100000:2.0:1788638965.957063:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772891904 00000100:00100000:2.0:1788638965.957072:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772891904 00000100:00100000:2.0:1788638965.957127:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788638965.957138:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+17:6513:x1875523772891904:12345-0@lo:101: 00010000:00010000:2.0:1788638965.957950:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638965.957970:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae38217a400/0x25c454990262bea9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262bea2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638965.958003:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae38217a400/0x25c454990262bea9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262bea2 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638965.958016:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae38217a400/0x25c454990262bea9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262bea2 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638965.958026:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae38217a400, rc 0) 00000100:00100000:2.0:1788638965.958089:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+18:6513:x1875523772891904:12345-0@lo:101: Request processed in 952us (1484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638965.958105:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788638965.959072:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342e3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772891904:0@lo:101: 00010000:00010000:2.0:1788638965.959097:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae38217a600/0x25c454990262bea2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bea9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638965.959116:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae38217a600/0x25c454990262bea2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262bea9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638965.960402:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342e3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772892032:0@lo:501: 00000100:00100000:2.0:1788638965.960499:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638965.960545:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d325600 going to sleep for 11 seconds 00000100:00100000:2.0:1788638965.960585:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772892032 00000100:00100000:2.0:1788638965.960592:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772892032 00000100:00100000:2.0:1788638965.963301:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788638965.963328:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+18:6513:x1875523772892032:12345-0@lo:501: 00000100:00100000:2.0:1788638965.963590:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+18:6513:x1875523772892032:12345-0@lo:501: Request processed in 274us (3090us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638965.963599:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788638965.963708:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342e3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772892032:0@lo:501: 00000100:00100000:2.0:1788638965.963765:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342e3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772892160:0@lo:503: 00000100:00100000:2.0:1788638965.963827:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638965.963857:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d325600 going to sleep for 11 seconds 00000100:00100000:2.0:1788638965.963870:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772892160 00000100:00100000:2.0:1788638965.963876:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772892160 00000100:00100000:2.0:1788638965.963904:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788638965.963909:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+18:6513:x1875523772892160:12345-0@lo:503: 00000100:00100000:2.0:1788638965.963982:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+18:6513:x1875523772892160:12345-0@lo:503: Request processed in 73us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638965.963989:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788638965.964029:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342e3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772892160:0@lo:503: 00000100:00100000:0.0:1788638965.969497:0:8150:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36914e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:8150:1875523772892288:0@lo:502: 00000100:00100000:0.0:1788638965.969612:0:8150:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638965.970414:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772892288 00000100:00100000:2.0:1788638965.970425:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772892288 00000100:00100000:2.0:1788638965.970526:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788638965.970540:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+18:8150:x1875523772892288:12345-0@lo:502: 00000100:00100000:2.0:1788638965.970757:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+18:8150:x1875523772892288:12345-0@lo:502: Request processed in 220us (1145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638965.971101:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788638965.976706:0:8150:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3442533c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788638965.976795:0:8150:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36914e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:8150:1875523772892288:0@lo:502: 00000020:01000000:1.0:1788638965.976850:0:8150:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788638965.976863:0:8150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788638965.976866:0:8150:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788638965.976874:0:8150:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ae3461e3800 00000020:00000080:1.0:1788638965.976877:0:8150:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788638965.976929:0:8150:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3691aa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:8150:1875523772892416:0@lo:502: 00000100:00100000:1.0:1788638965.977029:0:8150:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638965.977058:0:8150:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344398540 going to sleep for 11 seconds 00000100:00100000:2.0:1788638965.977426:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772892416 00000100:00100000:2.0:1788638965.977434:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772892416 00000100:00100000:2.0:1788638965.977501:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788638965.977512:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+18:8150:x1875523772892416:12345-0@lo:502: 00000100:00100000:2.0:1788638965.977689:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+18:8150:x1875523772892416:12345-0@lo:502: Request processed in 178us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638965.977696:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788638965.981003:0:8150:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3691aa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:8150:1875523772892416:0@lo:502: 00000020:01000000:1.0:1788638965.981076:0:8150:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788638965.981088:0:8150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788638965.981105:0:8150:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788638965.981111:0:8150:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1788638965.981744:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788638965.981800:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788638965.981829:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae38217a600/0x25c454990262bea2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bea9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638965.981843:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae38217a600/0x25c454990262bea2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bea9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638966.196885:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638967.227836:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638968.245962:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638969.272141:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638970.036956:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342e3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01f1eef9-e690-4065-bf99-bf821af7b626:3642:1875523772892544:0@lo:400: 00000100:00100000:2.0:1788638970.037051:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638970.037102:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342e3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772893056:0@lo:400: 00000100:00100000:2.0:1788638970.037147:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638970.037487:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772892544 00000100:00100000:0.0:1788638970.037498:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772892544 00000100:00100000:0.0:1788638970.037563:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788638970.037575:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+18:3642:x1875523772892544:12345-0@lo:400: 00000100:00100000:0.0:1788638970.037678:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+18:3642:x1875523772892544:12345-0@lo:400: Request processed in 105us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638970.037685:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788638970.040703:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342e3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01f1eef9-e690-4065-bf99-bf821af7b626:3642:1875523772892544:0@lo:400: 00000100:00100000:2.0:1788638970.040728:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788638970.040741:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342e3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523772892928:0@lo:400: 00000100:00100000:2.0:1788638970.040805:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638970.040858:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342e3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523772892672:0@lo:400: 00000100:00100000:2.0:1788638970.040887:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638970.040908:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3691aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772893184:0@lo:41: 00000100:00100000:2.0:1788638970.040933:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638970.040953:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788638970.040958:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342e3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772892800:0@lo:400: 00000100:00100000:2.0:1788638970.040977:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638970.041005:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772893056 00000100:00100000:2.0:1788638970.041013:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772893056 00000100:00100000:2.0:1788638970.041052:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772893184 00000100:00100000:2.0:1788638970.041055:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772893184 00000100:00100000:2.0:1788638970.041068:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772892800 00000100:00100000:2.0:1788638970.041070:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772892800 00000100:00100000:2.0:1788638970.041083:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788638970.041092:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772893056:12345-0@lo:400: 00000100:00100000:2.0:1788638970.041153:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772893056:12345-0@lo:400: Request processed in 61us (4004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638970.041160:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788638970.041190:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788638970.041196:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3643:x1875523772893184:12345-0@lo:41: 00000004:00000024:2.0:1788638970.041247:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1788638970.041296:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3643:x1875523772893184:12345-0@lo:41: Request processed in 89us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638970.041984:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788638970.042005:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788638970.042012:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772892800:12345-0@lo:400: 00000100:00100000:2.0:1788638970.042050:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772892800:12345-0@lo:400: Request processed in 40us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638970.042056:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788638970.042075:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772892928 00000100:00100000:2.0:1788638970.042080:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772892928 00000100:00100000:2.0:1788638970.042104:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772892672 00000100:00100000:2.0:1788638970.042106:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772892672 00000100:00100000:2.0:1788638970.042116:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788638970.042122:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523772892928:12345-0@lo:400: 00000100:00100000:2.0:1788638970.042150:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523772892928:12345-0@lo:400: Request processed in 28us (1346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638970.042155:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788638970.042166:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788638970.042172:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523772892672:12345-0@lo:400: 00000100:00100000:2.0:1788638970.042200:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523772892672:12345-0@lo:400: Request processed in 29us (1313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638970.042206:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1788638970.042260:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae342e3ca80 x1875523772892928/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638970.042275:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342e3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523772892928:0@lo:400: 00000100:00100000:2.0:1788638970.045937:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342e3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772893056:0@lo:400: 00000100:00100000:2.0:1788638970.046001:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342e3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772892800:0@lo:400: 00010000:00080000:2.0:1788638970.046020:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae342e3d500 x1875523772892672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638970.046032:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342e3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523772892672:0@lo:400: 00000100:00100000:2.0:1788638970.046054:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3691aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772893184:0@lo:41: 00010000:00010000:3.0:1788638970.295195:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638970.558557:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3691a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772893312:0@lo:41: 00000100:00100000:1.0:1788638970.558674:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638970.558800:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772893312 00000100:00100000:1.0:1788638970.558810:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772893312 00000100:00100000:1.0:1788638970.558864:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788638970.558873:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3691ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772893312:12345-0@lo:41: 00000004:00000024:1.0:1788638970.558916:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788638970.558972:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3691ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772893312:12345-0@lo:41: Request processed in 99us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638970.558980:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788638970.559032:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3691a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772893312:0@lo:41: 00010000:00010000:3.0:1788638971.317569:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638972.340897:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788638973.114467:0:8423:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788638973.114472:0:8423:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788638973.114473:0:8423:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788638973.114684:0:8423:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ae375ea2800 00000020:01000004:1.0:1788638973.114703:0:8423:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788638973.114719:0:8423:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788638973.114735:0:8423:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9ae375c5cd40) 00000020:00000080:1.0:1788638973.114755:0:8423:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788638973.158577:0:8423:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1788638973.158738:0:8423:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:2.0:1788638973.211229:0:8423:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788638973.215331:0:8423:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788638973.215353:0:8423:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788638973.215368:0:8423:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x25c454990262beb7 00000020:01000004:2.0:1788638973.215378:0:8423:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788638973.215408:0:8423:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.118@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788638973.215412:0:8423:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.118@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788638973.215420:0:8423:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788638973.215425:0:8423:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788638973.215443:0:8423:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9ae3802a3380) 00000020:00000080:2.0:1788638973.215460:0:8423:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1788638973.218166:0:8423:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788638973.218404:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788638973.218412:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788638973.238058:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788638973.239188:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788638973.241548:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788638973.241561:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788638973.250671:0:8423:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788638973.250896:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788638973.250904:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788638973.253239:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788638973.253251:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788638973.286280:0:8423:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788638973.288917:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788638973.288988:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788638973.292131:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788638973.292147:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788638973.295109:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788638973.295130:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788638973.297106:0:8423:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788638973.297362:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788638973.297368:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788638973.301256:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788638973.301276:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788638973.353869:0:8423:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788638973.354104:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788638973.354111:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788638973.357509:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788638973.357532:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788638973.358698:0:8423:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788638973.358734:0:8423:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1788638973.358742:0:8423:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.118@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00010000:00010000:1.0:1788638973.364813:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788638973.438423:0:8423:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.118@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788638973.438477:0:8423:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.118@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1788638973.438482:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788638973.438484:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788638973.438486:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788638973.438492:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788638973.438493:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788638973.438495:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788638973.438496:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788638973.438497:0:8423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788638973.438499:0:8423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788638973.438501:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788638973.438503:0:8423:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788638973.438507:0:8423:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1788638973.438510:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788638973.438511:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788638973.438512:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788638973.438513:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788638973.438514:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788638973.438515:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788638973.438516:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788638973.438517:0:8423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788638973.438518:0:8423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788638973.438519:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788638973.438520:0:8423:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788638973.438553:0:8423:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788638973.438576:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:8423:1875523772893440:0@lo:253: 00000100:00100000:3.0:1788638973.438720:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638973.438858:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae345521300 going to sleep for 11 seconds 00000100:00100000:1.0:1788638973.439919:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772893440 00000100:00100000:1.0:1788638973.439932:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772893440 00000100:00100000:1.0:1788638973.439996:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788638973.440006:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+18:8423:x1875523772893440:12345-0@lo:253: 20000000:01000000:1.0:1788638973.440049:0:6508:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788638973.440052:0:6508:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1788638973.440057:0:6508:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1788638973.440059:0:6508:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1788638973.440319:0:6508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788638973.440482:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1788638973.440495:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1788638973.440511:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1788638973.440516:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1788638973.440528:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1788638973.440543:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1788638973.440648:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1788638973.440665:0:6508:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.118@tcp 20000000:01000000:1.0:1788638973.440668:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.118@tcp (null) (null) (null) 00000040:00080000:1.0:1788638973.440680:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1788638973.440685:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788638973.440697:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1788638973.440702:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.206.118@tcp (null) (null) 00000040:00080000:1.0:1788638973.440711:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1788638973.440716:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788638973.440725:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1788638973.440738:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1788638973.440812:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:1.0:1788638973.440824:0:6508:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.118@tcp 20000000:01000000:1.0:1788638973.440825:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.118@tcp (null) (null) (null) 00000040:00080000:1.0:1788638973.440840:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:1.0:1788638973.440845:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788638973.440869:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:1.0:1788638973.440875:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.206.118@tcp (null) (null) 00000040:00080000:1.0:1788638973.440892:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:1.0:1788638973.440897:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788638973.440907:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:1.0:1788638973.440919:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:1.0:1788638973.441266:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:1.0:1788638973.441277:0:6508:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.118@tcp 20000000:01000000:1.0:1788638973.441279:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.118@tcp (null) (null) (null) 00000040:00080000:1.0:1788638973.441292:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:1.0:1788638973.441296:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788638973.441306:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:1.0:1788638973.441310:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.206.118@tcp (null) (null) 00000040:00080000:1.0:1788638973.441321:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:1.0:1788638973.441326:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788638973.441335:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:1.0:1788638973.441347:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:1.0:1788638973.441357:0:6508:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788638973.441360:0:6508:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788638973.441363:0:6508:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788638973.441400:0:6508:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788638973.441403:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788638973.443787:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1788638973.446640:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1788638973.446679:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1788638973.446695:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1788638973.446704:0:6508:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788638973.446707:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788638973.450705:0:8443:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:1.0:1788638973.450751:0:8443:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:1.0:1788638973.450766:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1788638973.451099:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:2.0:1788638973.451133:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:2.0:1788638973.451147:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:2.0:1788638973.451157:0:6508:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788638973.451160:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788638973.456047:0:8444:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:1.0:1788638973.456326:0:8444:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:1.0:1788638973.456349:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:0.0:1788638973.470185:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:0.0:1788638973.470254:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:0.0:1788638973.470425:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:0.0:1788638973.470446:0:6508:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788638973.470450:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788638973.472394:0:8445:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:2.0:1788638973.472455:0:8445:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:2.0:1788638973.472473:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1788638973.472946:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1788638973.472976:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1788638973.472993:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:0.0:1788638973.473015:0:6508:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788638973.473039:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ae340030400/0x25c454990262bec5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.473060:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae3429e4e00/0x25c454990262bd91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262bd8a expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.473133:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae340030c00/0x25c454990262be08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262be01 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.473142:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae340031600/0x25c454990262be40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262be39 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.473167:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae38217ba00/0x25c454990262be5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262be55 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.473175:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae340031200/0x25c454990262be86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262be7f expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.473183:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ae340030400/0x25c454990262bec5 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.473250:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae340031200/0x25c454990262be86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262be7f expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.473267:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ae340031200/0x25c454990262be86 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262be7f expref: 18 pid: 6511 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638973.473409:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36914dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875523772893568:0@lo:104: 00000100:00100000:0.0:1788638973.473947:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788638973.474111:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae38217ba00/0x25c454990262be5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262be55 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.474122:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ae38217ba00/0x25c454990262be5c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262be55 expref: 18 pid: 6511 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638973.474132:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36914e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875523772893696:0@lo:104: 00000100:00100000:0.0:1788638973.474159:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788638973.474407:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae340031600/0x25c454990262be40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262be39 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.474417:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ae340031600/0x25c454990262be40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262be39 expref: 18 pid: 6510 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638973.474434:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36914e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875523772893824:0@lo:104: 00000100:00100000:0.0:1788638973.474460:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638973.474552:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772893568 00000100:00100000:3.0:1788638973.474562:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772893568 00000100:00100000:3.0:1788638973.474610:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772893696 00000100:00100000:3.0:1788638973.474613:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772893696 00000100:00100000:3.0:1788638973.474668:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788638973.474680:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36914df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+4:6508:x1875523772893568:12345-0@lo:104: 00010000:00010000:3.0:1788638973.474695:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb400/0x25c454990262be7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262be86 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638973.474758:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788638973.474765:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36914df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+4:6508:x1875523772893568:12345-0@lo:104: Request processed in 89us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638973.474782:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788638973.474801:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788638973.474807:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36914ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+3:6508:x1875523772893696:12345-0@lo:104: 00010000:00010000:3.0:1788638973.474816:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5e00/0x25c454990262be55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262be5c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638973.474851:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788638973.474856:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36914ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+3:6508:x1875523772893696:12345-0@lo:104: Request processed in 50us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638973.474861:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1788638973.474893:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788638973.474899:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb400/0x25c454990262be7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262be86 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638973.474907:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fb400 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:3.0:1788638973.474911:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb400/0x25c454990262be7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262be86 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638973.474921:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb400/0x25c454990262be7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262be86 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788638973.474928:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb400/0x25c454990262be7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262be86 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788638973.474934:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788638973.474971:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb400/0x25c454990262be7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262be86 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638973.474974:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788638973.474983:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788638973.475013:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb400/0x25c454990262be7f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262be86 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638973.475020:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772893952:0@lo:103: 00010000:00010000:3.0:1788638973.475024:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb400/0x25c454990262be7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262be86 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638973.475040:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638973.475043:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638973.475045:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638973.475064:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788638973.475299:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638973.475306:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5e00/0x25c454990262be55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262be5c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638973.475314:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3429e5e00 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:2.0:1788638973.475317:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5e00/0x25c454990262be55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262be5c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638973.475324:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5e00/0x25c454990262be55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262be5c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788638973.475342:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5e00/0x25c454990262be55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262be5c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638973.475348:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788638973.475376:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5e00/0x25c454990262be55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262be5c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638973.475383:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788638973.475394:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5e00/0x25c454990262be55 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262be5c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638973.475411:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5e00/0x25c454990262be55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262be5c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638973.475423:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638973.475425:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638973.475426:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638973.475440:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01f1eef9-e690-4065-bf99-bf821af7b626:3642:1875523772894080:0@lo:103: 00000100:00100000:2.0:1788638973.475469:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638973.475500:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772893952 00000100:00100000:2.0:1788638973.475516:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772893952 00010000:00010000:2.0:1788638973.475538:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae340031200/0x25c454990262be86 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262be7f expref: 19 pid: 6511 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638973.475571:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772894080 00000100:00100000:2.0:1788638973.475574:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772894080 00010000:00010000:2.0:1788638973.475587:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae38217ba00/0x25c454990262be5c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262be55 expref: 20 pid: 6511 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638973.475611:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788638973.475639:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01f1eef9-e690-4065-bf99-bf821af7b626+20:3641:x1875523772893952:12345-0@lo:103: 00010000:00010000:2.0:1788638973.475653:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638973.475659:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae340031200/0x25c454990262be86 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262be7f expref: 20 pid: 6511 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638973.475681:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae340031200/0x25c454990262be86 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262be7f expref: 20 pid: 6511 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638973.475702:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788638973.475740:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01f1eef9-e690-4065-bf99-bf821af7b626+20:3641:x1875523772893952:12345-0@lo:103: Request processed in 103us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638973.475747:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788638973.475763:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788638973.475770:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01f1eef9-e690-4065-bf99-bf821af7b626+19:3642:x1875523772894080:12345-0@lo:103: 00010000:00010000:2.0:1788638973.475777:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638973.475781:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae38217ba00/0x25c454990262be5c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262be55 expref: 19 pid: 6511 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638973.475789:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae38217ba00/0x25c454990262be5c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262be55 expref: 19 pid: 6511 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638973.475798:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788638973.475825:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01f1eef9-e690-4065-bf99-bf821af7b626+19:3642:x1875523772894080:12345-0@lo:103: Request processed in 56us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638973.475832:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788638973.475853:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772893824 00000100:00100000:0.0:1788638973.475858:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772893824 00000100:00100000:2.0:1788638973.475874:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772893952:0@lo:103: 00000100:00100000:0.0:1788638973.475882:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788638973.475890:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36914f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+3:6508:x1875523772893824:12345-0@lo:104: 00010000:00010000:0.0:1788638973.475899:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae340031c00/0x25c454990262be39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262be40 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638973.475906:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01f1eef9-e690-4065-bf99-bf821af7b626:3642:1875523772894080:0@lo:103: 00010000:00010000:2.0:1788638973.475921:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638973.475923:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638973.475945:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788638973.475951:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36914f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+3:6508:x1875523772893824:12345-0@lo:104: Request processed in 63us (1491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638973.475957:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1788638973.475990:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae340030c00/0x25c454990262be08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262be01 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.476001:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ae340030c00/0x25c454990262be08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262be01 expref: 18 pid: 6511 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638973.476011:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36914f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875523772894208:0@lo:104: 00000100:00100000:0.0:1788638973.476035:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638973.476055:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772894208 00000100:00100000:0.0:1788638973.476059:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772894208 00000100:00100000:0.0:1788638973.476075:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788638973.476081:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36914f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+3:6508:x1875523772894208:12345-0@lo:104: 00010000:00010000:0.0:1788638973.476088:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae38217a800/0x25c454990262be01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262be08 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.476147:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788638973.476152:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36914f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+3:6508:x1875523772894208:12345-0@lo:104: Request processed in 72us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638973.476158:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1788638973.476172:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788638973.476177:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae340031c00/0x25c454990262be39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262be40 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.476183:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae340031c00 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:0.0:1788638973.476187:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae340031c00/0x25c454990262be39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262be40 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.476194:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae340031c00/0x25c454990262be39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262be40 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788638973.476200:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae340031c00/0x25c454990262be39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262be40 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638973.476205:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788638973.476246:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae340031c00/0x25c454990262be39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262be40 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.476253:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788638973.476462:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae340031c00/0x25c454990262be39 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262be40 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.476471:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae340031c00/0x25c454990262be39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262be40 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.476494:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638973.476498:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae38217a800/0x25c454990262be01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262be08 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.476504:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae38217a800 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:0.0:1788638973.476507:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae38217a800/0x25c454990262be01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262be08 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.476515:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae38217a800/0x25c454990262be01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262be08 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788638973.476521:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae38217a800/0x25c454990262be01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262be08 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638973.476526:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788638973.476557:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae38217a800/0x25c454990262be01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262be08 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.476564:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788638973.476570:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae38217a800/0x25c454990262be01 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262be08 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.476576:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae38217a800/0x25c454990262be01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262be08 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.476586:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638973.476588:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638973.476589:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638973.476608:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36914d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523772894336:0@lo:103: 00000100:00100000:0.0:1788638973.476672:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638973.476697:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788638973.476702:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523772894464:0@lo:103: 00000100:00100000:0.0:1788638973.476720:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638973.476752:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772894336 00000100:00100000:0.0:1788638973.476756:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772894336 00010000:00010000:0.0:1788638973.476771:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae340031600/0x25c454990262be40 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262be39 expref: 19 pid: 6510 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638973.476790:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772894464 00000100:00100000:0.0:1788638973.476793:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772894464 00010000:00010000:0.0:1788638973.476804:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae340030c00/0x25c454990262be08 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262be01 expref: 20 pid: 6511 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638973.476816:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788638973.476823:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2416e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01f1eef9-e690-4065-bf99-bf821af7b626+20:3643:x1875523772894336:12345-0@lo:103: 00010000:00010000:0.0:1788638973.476831:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638973.476836:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae340031600/0x25c454990262be40 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262be39 expref: 20 pid: 6510 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.476845:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae340031600/0x25c454990262be40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262be39 expref: 20 pid: 6510 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.476858:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788638973.477048:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2416e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01f1eef9-e690-4065-bf99-bf821af7b626+20:3643:x1875523772894336:12345-0@lo:103: Request processed in 224us (372us total) trans 0 rc 0/0 00010000:00010000:2.0:1788638973.477052:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638973.477057:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788638973.477075:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788638973.477082:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2416e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01f1eef9-e690-4065-bf99-bf821af7b626+19:3643:x1875523772894464:12345-0@lo:103: 00010000:00010000:0.0:1788638973.477098:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638973.477103:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae340030c00/0x25c454990262be08 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262be01 expref: 19 pid: 6511 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.477112:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae340030c00/0x25c454990262be08 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262be01 expref: 19 pid: 6511 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.477122:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788638973.477720:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae3429e4e00/0x25c454990262bd91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262bd8a expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638973.477739:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ae3429e4e00/0x25c454990262bd91 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262bd8a expref: 19 pid: 6510 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638973.477753:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f39880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875523772894592:0@lo:104: 00000100:00100000:0.0:1788638973.477774:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2416e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01f1eef9-e690-4065-bf99-bf821af7b626+19:3643:x1875523772894464:12345-0@lo:103: Request processed in 690us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638973.477786:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788638973.477800:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638973.477897:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523772894464:0@lo:103: 00000100:00100000:0.0:1788638973.477906:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36914d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523772894336:0@lo:103: 00000100:00100000:2.0:1788638973.478084:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344252840 going to sleep for 11 seconds 00010000:00010000:2.0:1788638973.478103:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae340031200/0x25c454990262be86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262be7f expref: 18 pid: 6511 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638973.478116:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36914dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875523772893568:0@lo:104: 00010000:00010000:2.0:1788638973.478127:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae38217ba00/0x25c454990262be5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262be55 expref: 17 pid: 6511 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638973.478136:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36914e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875523772893696:0@lo:104: 00010000:00010000:2.0:1788638973.478145:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae340031600/0x25c454990262be40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262be39 expref: 16 pid: 6510 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638973.478154:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36914e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875523772893824:0@lo:104: 00010000:00010000:2.0:1788638973.478163:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae340030c00/0x25c454990262be08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262be01 expref: 15 pid: 6511 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638973.478171:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36914f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875523772894208:0@lo:104: 00000100:00100000:1.0:1788638973.478312:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772894592 00000100:00100000:1.0:1788638973.478344:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772894592 00000100:00100000:1.0:1788638973.478407:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788638973.478417:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+3:6508:x1875523772894592:12345-0@lo:104: 00010000:00010000:1.0:1788638973.478436:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262bd8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262bd91 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638973.478533:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788638973.478540:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+3:6508:x1875523772894592:12345-0@lo:104: Request processed in 125us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638973.478548:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788638973.478898:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f39880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875523772894592:0@lo:104: 00010000:00010000:3.0:1788638973.479037:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788638973.479052:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262bd8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262bd91 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638973.479062:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fb800 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:3.0:1788638973.479076:0:8446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262bd8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262bd91 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638973.479087:0:8446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262bd8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262bd91 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788638973.479095:0:8446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262bd8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262bd91 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788638973.479101:0:8446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788638973.479144:0:6508:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ae340030400/0x25c454990262bec5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638973.479154:0:8446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262bd8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bd91 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638973.479163:0:8446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788638973.479180:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262bd8a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bd91 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638973.479187:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262bd8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bd91 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638973.479537:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772894720:0@lo:103: 00000100:00100000:2.0:1788638973.479595:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788638973.479966:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638973.479969:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638973.479971:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638973.480046:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772894720 00000100:00100000:0.0:1788638973.480053:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772894720 00010000:00010000:0.0:1788638973.480080:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae3429e4e00/0x25c454990262bd91 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262bd8a expref: 15 pid: 6510 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638973.480117:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788638973.480125:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ffa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01f1eef9-e690-4065-bf99-bf821af7b626+15:3641:x1875523772894720:12345-0@lo:103: 00010000:00010000:0.0:1788638973.480138:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638973.480144:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae3429e4e00/0x25c454990262bd91 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262bd8a expref: 15 pid: 6510 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.480168:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae3429e4e00/0x25c454990262bd91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262bd8a expref: 15 pid: 6510 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.480184:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae3429e4e00/0x25c454990262bd91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262bd8a expref: 15 pid: 6510 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.480200:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ae340030400/0x25c454990262bec5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.480210:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae340030400/0x25c454990262bec5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.480240:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae340030400/0x25c454990262bec5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.480248:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae340030400/0x25c454990262bec5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.480254:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ae340030400/0x25c454990262bec5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.480261:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ae340030400/0x25c454990262bec5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.480266:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae340030400 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788638973.480327:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ae340030400/0x25c454990262bec5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.480338:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ae340030400/0x25c454990262bec5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.480371:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ae340030400/0x25c454990262bec5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.480382:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788638973.480441:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ffa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01f1eef9-e690-4065-bf99-bf821af7b626+14:3641:x1875523772894720:12345-0@lo:103: Request processed in 316us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638973.480449:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788638973.480574:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772894720:0@lo:103: 00010000:00010000:3.0:1788638973.481009:0:6508:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ae340030400/0x25c454990262bec5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638973.481020:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ae340030400/0x25c454990262bec5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638973.481028:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae340030400/0x25c454990262bec5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788638973.481043:0:6508:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788638973.483388:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+13:8423:x1875523772893440:12345-0@lo:253: Request processed in 43372us (44657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638973.483404:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788638973.483491:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:8423:1875523772893440:0@lo:253: 10000000:01000000:3.0:1788638973.483508:0:8423:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788638973.483511:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788638973.483513:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788638973.483515:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788638973.483516:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1788638973.483518:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788638973.483520:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788638973.483521:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788638973.483522:0:8423:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788638973.483524:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788638973.483525:0:8423:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788638973.483548:0:8423:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ae375ea2800 from lustre-OST0000 10000000:01000000:3.0:1788638973.483601:0:8423:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788638973.483605:0:8423:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788638973.483839:0:8423:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ae342e50000 local copy 10000000:01000000:3.0:1788638973.483844:0:8423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788638973.483949:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4600/0x25c454990262becc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638973.483961:0:8423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4600/0x25c454990262becc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638973.483973:0:8423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4600/0x25c454990262becc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638973.483991:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:8423:1875523772894848:0@lo:101: 00000100:00100000:3.0:1788638973.484031:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638973.484106:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d395480 going to sleep for 11 seconds 00000100:00100000:1.0:1788638973.484138:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772894848 00000100:00100000:1.0:1788638973.484144:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772894848 00000100:00100000:1.0:1788638973.484225:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788638973.484237:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+13:8423:x1875523772894848:12345-0@lo:101: 00010000:00010000:1.0:1788638973.484250:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638973.484265:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae3750fbc00/0x25c454990262bed3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262becc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638973.484290:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae3750fbc00/0x25c454990262bed3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262becc expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638973.484302:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae3750fbc00/0x25c454990262bed3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262becc expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638973.484313:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fbc00, rc 0) 00000100:00100000:1.0:1788638973.484350:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+14:8423:x1875523772894848:12345-0@lo:101: Request processed in 116us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638973.484357:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788638973.484407:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:8423:1875523772894848:0@lo:101: 00010000:00010000:3.0:1788638973.484420:0:8423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4600/0x25c454990262becc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x25c454990262bed3 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638973.484430:0:8423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4600/0x25c454990262becc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x25c454990262bed3 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638973.484524:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:8423:1875523772894976:0@lo:501: 00000100:00100000:3.0:1788638973.484547:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638973.484757:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d395480 going to sleep for 11 seconds 00000100:00100000:0.0:1788638973.484897:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772894976 00000100:00100000:0.0:1788638973.484902:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772894976 00000100:00100000:0.0:1788638973.484924:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788638973.484931:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+14:8423:x1875523772894976:12345-0@lo:501: 00000100:00100000:0.0:1788638973.485000:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+14:8423:x1875523772894976:12345-0@lo:501: Request processed in 69us (452us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788638973.485007:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788638973.485071:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:8423:1875523772894976:0@lo:501: 10000000:01000000:3.0:1788638973.485083:0:8423:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.118@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788638973.485097:0:8423:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.118@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788638973.485103:0:8423:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4600/0x25c454990262becc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x25c454990262bed3 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638973.485112:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4600/0x25c454990262becc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x25c454990262bed3 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638973.485127:0:8423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4600/0x25c454990262becc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x25c454990262bed3 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638973.485149:0:8423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788638973.485170:0:8423:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ae375ea2800 10000000:01000000:3.0:1788638973.485175:0:8423:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788638973.485181:0:8423:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788638973.485183:0:8423:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788638973.485188:0:8423:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788638973.485190:0:8423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788638973.485205:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5000/0x25c454990262beda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638973.485213:0:8423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5000/0x25c454990262beda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638973.485235:0:8423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5000/0x25c454990262beda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638973.485247:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:8423:1875523772895104:0@lo:101: 00000100:00100000:3.0:1788638973.485270:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638973.485281:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d395300 going to sleep for 11 seconds 00010000:00010000:0.0:1788638973.485381:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638973.485388:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4600/0x25c454990262becc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x25c454990262bed3 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.485395:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3429e4600 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:0.0:1788638973.485399:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4600/0x25c454990262becc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x25c454990262bed3 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.485408:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4600/0x25c454990262becc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x25c454990262bed3 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788638973.485426:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4600/0x25c454990262becc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x25c454990262bed3 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638973.485433:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788638973.485453:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4600/0x25c454990262becc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x25c454990262bed3 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.485458:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788638973.485486:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4600/0x25c454990262becc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x25c454990262bed3 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.485494:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4600/0x25c454990262becc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x25c454990262bed3 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.485507:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638973.485509:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638973.485510:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638973.485518:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788638973.485528:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772895232:0@lo:103: 00000100:00100000:0.0:1788638973.485554:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638973.485578:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772895104 00000100:00100000:0.0:1788638973.485581:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772895104 00000100:00100000:0.0:1788638973.485596:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788638973.485601:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+14:8423:x1875523772895104:12345-0@lo:101: 00010000:00010000:0.0:1788638973.485608:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638973.485638:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae340031c00/0x25c454990262bee1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262beda expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.485655:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae340031c00/0x25c454990262bee1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262beda expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.485671:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae340031c00/0x25c454990262bee1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262beda expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.485679:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae340031c00, rc 0) 00000100:00100000:0.0:1788638973.485704:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+15:8423:x1875523772895104:12345-0@lo:101: Request processed in 103us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638973.485710:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788638973.485746:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772895232 00000100:00100000:0.0:1788638973.485749:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772895232 00000100:00100000:0.0:1788638973.485775:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788638973.485781:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2416e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01f1eef9-e690-4065-bf99-bf821af7b626+15:3641:x1875523772895232:12345-0@lo:103: 00010000:00010000:0.0:1788638973.485789:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638973.485800:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae3750fbc00/0x25c454990262bed3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c454990262becc expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.485810:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788638973.485832:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2416e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01f1eef9-e690-4065-bf99-bf821af7b626+14:3641:x1875523772895232:12345-0@lo:103: Request processed in 52us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638973.485839:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788638973.485859:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772895232:0@lo:103: 00000100:00100000:3.0:1788638973.486053:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:8423:1875523772895104:0@lo:101: 00010000:00010000:3.0:1788638973.486064:0:8423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5000/0x25c454990262beda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bee1 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638973.486073:0:8423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5000/0x25c454990262beda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262bee1 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638973.486144:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:8423:1875523772895360:0@lo:501: 00000100:00100000:3.0:1788638973.486169:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638973.486195:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d395300 going to sleep for 11 seconds 00000100:00100000:0.0:1788638973.486239:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772895360 00000100:00100000:0.0:1788638973.486243:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772895360 00000100:00100000:0.0:1788638973.486259:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788638973.486265:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+14:8423:x1875523772895360:12345-0@lo:501: 00000100:00100000:0.0:1788638973.486394:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+14:8423:x1875523772895360:12345-0@lo:501: Request processed in 129us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638973.486409:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788638973.486523:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:8423:1875523772895360:0@lo:501: 00000100:00100000:3.0:1788638973.486549:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:8423:1875523772895488:0@lo:503: 00000100:00100000:3.0:1788638973.486585:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638973.486660:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d395300 going to sleep for 11 seconds 00000100:00100000:0.0:1788638973.486837:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772895488 00000100:00100000:0.0:1788638973.486841:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772895488 00000100:00100000:0.0:1788638973.486950:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788638973.486958:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+14:8423:x1875523772895488:12345-0@lo:503: 00000100:00100000:0.0:1788638973.487044:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+14:8423:x1875523772895488:12345-0@lo:503: Request processed in 88us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638973.487051:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788638973.487106:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:8423:1875523772895488:0@lo:503: 00000040:00080000:3.0:1788638973.487382:0:8423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788638973.487456:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:8423:1875523772895616:0@lo:502: 00000100:00100000:3.0:1788638973.487493:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638973.487556:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d395300 going to sleep for 11 seconds 00000100:00100000:1.0:1788638973.487642:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772895616 00000100:00100000:1.0:1788638973.487652:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772895616 00000100:00100000:1.0:1788638973.487674:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788638973.487680:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+14:8423:x1875523772895616:12345-0@lo:502: 00000100:00100000:1.0:1788638973.487783:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+14:8423:x1875523772895616:12345-0@lo:502: Request processed in 102us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638973.487790:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788638973.488534:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:8423:1875523772895616:0@lo:502: 00000040:00080000:3.0:1788638973.488880:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788638973.488919:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788638973.488935:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788638973.488946:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788638973.488965:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788638973.488981:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788638973.489011:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:8423:1875523772895744:0@lo:502: 00000100:00100000:3.0:1788638973.489069:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638973.489107:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d395300 going to sleep for 11 seconds 00000100:00100000:1.0:1788638973.489260:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772895744 00000100:00100000:1.0:1788638973.489267:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772895744 00000100:00100000:1.0:1788638973.489317:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788638973.489326:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+14:8423:x1875523772895744:12345-0@lo:502: 00000100:00100000:1.0:1788638973.489423:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+14:8423:x1875523772895744:12345-0@lo:502: Request processed in 98us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638973.489431:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788638973.489464:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:8423:1875523772895744:0@lo:502: 00000040:00080000:3.0:1788638973.489505:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788638973.489518:0:8423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1788638973.493119:0:8447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788638973.493136:0:8447:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1788638973.493157:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638973.493160:0:8447:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788638973.493167:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788638973.493186:0:8447:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9ae3691ccd40) 00000020:00000080:3.0:1788638973.493230:0:8447:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788638973.493239:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788638973.493384:0:8447:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ae375ea2800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788638973.493393:0:8447:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788638973.493402:0:8447:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x25c454990262beef 00010000:00010000:3.0:1788638973.504096:0:8447:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:3.0:1788638973.504398:0:8447:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1788638973.509673:0:8447:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788638973.509983:0:8447:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1788638973.515650:0:8447:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1788638973.515846:0:8447:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1788638973.529513:0:8447:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1788638973.532429:0:8447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788638973.532446:0:8447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788638973.532454:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638973.532456:0:8447:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788638973.532460:0:8447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788638973.532464:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638973.532466:0:8447:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788638973.532469:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788638973.532472:0:8447:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788638973.532511:0:8447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788638973.532515:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638973.532516:0:8447:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788638973.532520:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788638973.532660:0:8423:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1788638973.532709:0:8423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788638973.532730:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5000/0x25c454990262beda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bee1 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638973.532743:0:8423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5000/0x25c454990262beda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bee1 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638973.532752:0:8423:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae375ea2800 from 1 10000000:01000000:1.0:1788638973.532756:0:8423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788638973.532794:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3750fae00/0x25c454990262bef6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638973.532802:0:8423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae3750fae00/0x25c454990262bef6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638973.532829:0:8423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae3750fae00/0x25c454990262bef6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638973.532853:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3691a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:8423:1875523772895872:0@lo:101: 00000100:00100000:1.0:1788638973.532916:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638973.534082:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772895872 00000100:00100000:2.0:1788638973.534091:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772895872 00000100:00100000:1.0:1788638973.534109:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae37b589540 going to sleep for 11 seconds 00000100:00100000:2.0:1788638973.534146:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788638973.534155:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+14:8423:x1875523772895872:12345-0@lo:101: 00010000:00010000:2.0:1788638973.534168:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638973.534181:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae38217ba00/0x25c454990262befd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262bef6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638973.534235:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae38217ba00/0x25c454990262befd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262bef6 expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638973.534246:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae38217ba00/0x25c454990262befd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262bef6 expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638973.534255:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae38217ba00, rc 0) 00000100:00100000:2.0:1788638973.534425:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+15:8423:x1875523772895872:12345-0@lo:101: Request processed in 270us (1508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638973.534435:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788638973.537859:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3691a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:8423:1875523772895872:0@lo:101: 00010000:00010000:1.0:1788638973.537900:0:8423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae3750fae00/0x25c454990262bef6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262befd expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638973.537918:0:8423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae3750fae00/0x25c454990262bef6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262befd expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638973.538082:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3691a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:8423:1875523772896000:0@lo:501: 00000100:00100000:1.0:1788638973.538153:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638973.538202:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae37b589540 going to sleep for 11 seconds 00000100:00100000:0.0:1788638973.538353:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772896000 00000100:00100000:0.0:1788638973.538364:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772896000 00000100:00100000:0.0:1788638973.538418:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788638973.538427:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+15:8423:x1875523772896000:12345-0@lo:501: 00000100:00100000:0.0:1788638973.538597:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+15:8423:x1875523772896000:12345-0@lo:501: Request processed in 169us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638973.538607:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788638973.538744:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3691a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:8423:1875523772896000:0@lo:501: 00000100:00100000:1.0:1788638973.538841:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3691a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:8423:1875523772896128:0@lo:503: 00000100:00100000:1.0:1788638973.538899:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638973.538970:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae37b589540 going to sleep for 11 seconds 00000100:00100000:3.0:1788638973.539015:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772896128 00000100:00100000:3.0:1788638973.539028:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772896128 00000100:00100000:3.0:1788638973.539084:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788638973.539094:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b678850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+15:8423:x1875523772896128:12345-0@lo:503: 00000100:00100000:3.0:1788638973.539261:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b678850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+15:8423:x1875523772896128:12345-0@lo:503: Request processed in 169us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638973.539270:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788638973.539389:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3691a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:8423:1875523772896128:0@lo:503: 00000040:00080000:1.0:1788638973.543173:0:8423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788638973.543321:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3691a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:8423:1875523772896256:0@lo:502: 00000100:00100000:1.0:1788638973.543428:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638973.543481:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae37b589540 going to sleep for 11 seconds 00000100:00100000:0.0:1788638973.543613:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772896256 00000100:00100000:0.0:1788638973.543652:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772896256 00000100:00100000:0.0:1788638973.543704:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788638973.543715:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b678450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+15:8423:x1875523772896256:12345-0@lo:502: 00000100:00100000:0.0:1788638973.543934:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b678450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+15:8423:x1875523772896256:12345-0@lo:502: Request processed in 220us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638973.543943:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788638973.544046:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3691a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:8423:1875523772896256:0@lo:502: 00000040:00080000:1.0:1788638973.544357:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788638973.544386:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788638973.544417:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3691a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:8423:1875523772896384:0@lo:502: 00000100:00100000:1.0:1788638973.544461:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638973.544496:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae37b589540 going to sleep for 11 seconds 00000100:00100000:0.0:1788638973.544590:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772896384 00000100:00100000:0.0:1788638973.544596:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772896384 00000100:00100000:0.0:1788638973.544661:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788638973.544667:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b679850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+15:8423:x1875523772896384:12345-0@lo:502: 00000100:00100000:0.0:1788638973.544732:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b679850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+15:8423:x1875523772896384:12345-0@lo:502: Request processed in 65us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638973.544737:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788638973.544870:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3691a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:8423:1875523772896384:0@lo:502: 00000040:00080000:1.0:1788638973.544915:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788638973.544923:0:8423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788638973.545338:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788638973.545349:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638973.545352:0:8451:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788638973.545359:0:8451:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ae375ea2800 00000020:00000080:3.0:1788638973.545362:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788638973.545374:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788638973.545377:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638973.545378:0:8451:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788638973.545380:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788638973.545527:0:8423:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788638973.545550:0:8423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788638973.545570:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3750fae00/0x25c454990262bef6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262befd expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638973.545581:0:8423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae3750fae00/0x25c454990262bef6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262befd expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638973.545749:0:8423:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788638973.545753:0:8423:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ae375ea2800 10000000:01000000:1.0:1788638973.545756:0:8423:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ae375ea2800 10000000:01000000:1.0:1788638973.545771:0:8423:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788638973.545779:0:8423:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ae375ea2800 from 1 10000000:01000000:1.0:1788638973.545782:0:8423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788638973.545816:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa400/0x25c454990262bf04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638973.545825:0:8423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa400/0x25c454990262bf04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638973.545836:0:8423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa400/0x25c454990262bf04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638973.545861:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3691a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:8423:1875523772896512:0@lo:101: 00000100:00100000:1.0:1788638973.545912:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638973.545946:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae37b589c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788638973.545961:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772896512 00000100:00100000:0.0:1788638973.545967:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772896512 00000100:00100000:0.0:1788638973.546042:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788638973.546052:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+15:8423:x1875523772896512:12345-0@lo:101: 00010000:00010000:0.0:1788638973.546063:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638973.546077:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae340030400/0x25c454990262bf0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262bf04 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.546103:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae340030400/0x25c454990262bf0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262bf04 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.546115:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae340030400/0x25c454990262bf0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262bf04 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.546125:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae340030400, rc 0) 00000100:00100000:0.0:1788638973.546177:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+16:8423:x1875523772896512:12345-0@lo:101: Request processed in 126us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638973.546188:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788638973.546284:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3691a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:8423:1875523772896512:0@lo:101: 00010000:00010000:1.0:1788638973.546299:0:8423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa400/0x25c454990262bf04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bf0b expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638973.546309:0:8423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa400/0x25c454990262bf04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262bf0b expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638973.546382:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3691a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:8423:1875523772896640:0@lo:501: 00000100:00100000:1.0:1788638973.546423:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638973.546445:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae37b589c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788638973.546611:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772896640 00000100:00100000:3.0:1788638973.546664:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772896640 00000100:00100000:3.0:1788638973.546691:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788638973.546699:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+16:8423:x1875523772896640:12345-0@lo:501: 00000100:00100000:3.0:1788638973.547602:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+16:8423:x1875523772896640:12345-0@lo:501: Request processed in 899us (1174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638973.547612:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788638973.547760:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3691a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:8423:1875523772896640:0@lo:501: 00000100:00100000:1.0:1788638973.547879:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3691a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:8423:1875523772896768:0@lo:503: 00000100:00100000:1.0:1788638973.547932:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638973.547964:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae37b589c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788638973.547969:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772896768 00000100:00100000:0.0:1788638973.547976:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772896768 00000100:00100000:0.0:1788638973.548012:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788638973.548020:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b678c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+16:8423:x1875523772896768:12345-0@lo:503: 00000100:00100000:0.0:1788638973.548589:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b678c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+16:8423:x1875523772896768:12345-0@lo:503: Request processed in 566us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638973.548598:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788638973.548610:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3691a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:8423:1875523772896768:0@lo:503: 00000040:00080000:1.0:1788638973.549134:0:8423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788638973.549213:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3691a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:8423:1875523772896896:0@lo:502: 00000100:00100000:1.0:1788638973.549270:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638973.549343:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae37b589c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788638973.549388:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772896896 00000100:00100000:3.0:1788638973.549395:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772896896 00000100:00100000:3.0:1788638973.549526:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788638973.549536:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b679c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+16:8423:x1875523772896896:12345-0@lo:502: 00000100:00100000:3.0:1788638973.549656:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b679c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+16:8423:x1875523772896896:12345-0@lo:502: Request processed in 122us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638973.549665:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788638973.549850:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3691a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:8423:1875523772896896:0@lo:502: 00000040:00080000:0.0:1788638973.550084:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788638973.550120:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788638973.550134:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788638973.550144:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788638973.550155:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788638973.550166:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788638973.550176:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788638973.550187:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788638973.550198:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788638973.550209:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788638973.550232:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788638973.550245:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788638973.550257:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788638973.550268:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788638973.550279:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788638973.550291:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788638973.550303:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788638973.550315:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788638973.550330:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788638973.550342:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788638973.550353:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788638973.550380:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788638973.550392:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788638973.550403:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788638973.550413:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1788638973.550424:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1788638973.550435:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1788638973.550445:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1788638973.550455:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1788638973.550467:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1788638973.550477:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1788638973.550505:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1788638973.550518:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1788638973.550529:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1788638973.550540:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1788638973.550551:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1788638973.550561:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:0.0:1788638973.550592:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:8423:1875523772897024:0@lo:502: 00000100:00100000:0.0:1788638973.551450:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638973.552799:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae348ea5600 going to sleep for 11 seconds 00000100:00100000:2.0:1788638973.552974:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772897024 00000100:00100000:2.0:1788638973.552985:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772897024 00000100:00100000:2.0:1788638973.553083:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788638973.553094:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+16:8423:x1875523772897024:12345-0@lo:502: 00000100:00100000:2.0:1788638973.553287:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+16:8423:x1875523772897024:12345-0@lo:502: Request processed in 195us (1839us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638973.553302:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788638973.553582:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:8423:1875523772897024:0@lo:502: 00000040:00080000:0.0:1788638973.553905:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1788638973.553923:0:8423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1788638973.555507:0:8452:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788638973.555526:0:8452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9ae36a0e8000) 00000020:00000080:0.0:1788638973.555553:0:8452:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1788638973.555660:0:8452:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ae375ea2800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788638973.555664:0:8452:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ae375ea2800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788638973.555667:0:8452:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ae375ea2800 3 00010000:00080000:0.0:1788638973.555701:0:8452:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ae3438e8000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.118@tcp at head 00010000:00010000:0.0:1788638973.567015:0:8452:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:0.0:1788638973.567844:0:8452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788638973.567916:0:8452:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788638973.567933:0:8452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x25c454990262bf19 00000100:00080000:0.0:1788638973.567947:0:8452:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788638973.567955:0:8452:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ae3438e8000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:0.0:1788638973.568002:0:8452:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae2416e4a80 x1875523772897152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788638973.568084:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875523772897152:0@lo:38: 00000100:00100000:1.0:1788638973.568178:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638973.568328:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772897152 00000100:00100000:2.0:1788638973.568338:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772897152 00000100:00080000:0.0:1788638973.568378:0:8452:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788638973.568381:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788638973.568391:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3691a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875523772897152:12345-0@lo:38: 00010000:00080000:2.0:1788638973.568418:0:6516:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:2.0:1788638973.568463:0:6516:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x25c454990262bf20 00000004:00100000:2.0:1788638973.568479:0:6516:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788638973.568539:0:6516:0:(import.c:65:import_set_state_nolock()) ffff9ae241e9b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788638973.568602:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3691a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875523772897152:12345-0@lo:38: Request processed in 211us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638973.568636:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788638973.568773:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772897408:0@lo:400: 00000100:00100000:0.0:1788638973.568822:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638973.568857:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788638973.568864:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875523772897280:0@lo:400: 00000100:00100000:0.0:1788638973.568892:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638973.568923:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875523772897536:0@lo:400: 00000100:00100000:0.0:1788638973.568951:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638973.568969:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788638973.568975:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772897664:0@lo:400: 00000100:00100000:0.0:1788638973.569000:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638973.569028:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772897280 00000100:00100000:0.0:1788638973.569032:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772897280 00000100:00100000:0.0:1788638973.569062:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772897536 00000100:00100000:0.0:1788638973.569077:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772897536 00000100:00100000:0.0:1788638973.569108:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788638973.569115:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2416e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875523772897280:12345-0@lo:400: 00000100:00100000:0.0:1788638973.569165:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2416e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875523772897280:12345-0@lo:400: Request processed in 50us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638973.569171:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788638973.569189:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788638973.569196:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2416e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875523772897536:12345-0@lo:400: 00000100:00100000:1.0:1788638973.569209:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772897408 00000100:00100000:1.0:1788638973.569227:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772897408 00000100:00100000:0.0:1788638973.569247:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2416e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875523772897536:12345-0@lo:400: Request processed in 50us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638973.569254:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772897664 00000100:00100000:0.0:1788638973.569256:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788638973.569260:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772897664 00000100:00100000:1.0:1788638973.569282:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788638973.569292:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2416e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772897408:12345-0@lo:400: 00000100:00100000:1.0:1788638973.569329:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2416e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772897408:12345-0@lo:400: Request processed in 41us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638973.569336:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788638973.569349:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788638973.569356:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2416e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772897664:12345-0@lo:400: 00000100:00100000:1.0:1788638973.569382:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2416e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772897664:12345-0@lo:400: Request processed in 27us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638973.569389:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1788638973.569425:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae2416e4a80 x1875523772897152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788638983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788638973.569434:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae2416e4700 x1875523772897280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638989 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638973.569438:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788638973.569450:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00100000:0.0:1788638973.569451:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875523772897280:0@lo:400: 00000100:00080000:1.0:1788638973.569459:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788638973.569465:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788638973.569468:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae3438e8000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788638973.569475:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875523772897152:0@lo:38: 00000100:00100000:0.0:1788638973.569494:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772897408:0@lo:400: 00000100:00100000:0.0:1788638973.569527:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772897664:0@lo:400: 00010000:00080000:0.0:1788638973.569538:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae2416e7100 x1875523772897536/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638989 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638973.569547:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875523772897536:0@lo:400: 00000020:01000004:2.0:1788638973.569735:0:8452:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788638973.569764:0:8452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9ae241ee19c0) 00000020:00000080:2.0:1788638973.569785:0:8452:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:2.0:1788638973.569896:0:8452:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ae375ea2800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788638973.569901:0:8452:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ae375ea2800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788638973.569905:0:8452:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ae375ea2800 3 00010000:00080000:2.0:1788638973.570166:0:8452:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ae241e99800@lustre-MDT0001-lwp-OST0000: add connection 192.168.206.118@tcp at head 00010000:00010000:2.0:1788638973.573042:0:8452:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:2.0:1788638973.573348:0:8452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1788638973.573397:0:8452:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788638973.573411:0:8452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x25c454990262bf2e 00000100:00080000:2.0:1788638973.573424:0:8452:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788638973.573431:0:8452:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9ae241e99800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788638973.573472:0:8452:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae375f38a80 x1875523772897792/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788638973.573502:0:8452:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788638973.573648:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875523772897792:0@lo:38: 00000100:00100000:1.0:1788638973.573735:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638973.573843:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772897792 00000100:00100000:2.0:1788638973.573852:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772897792 00000100:00100000:2.0:1788638973.573884:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788638973.573892:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3691aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875523772897792:12345-0@lo:38: 00010000:00080000:2.0:1788638973.573919:0:6517:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:2.0:1788638973.573952:0:6517:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x25c454990262bf35 00000004:00100000:2.0:1788638973.573969:0:6517:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788638973.574004:0:6517:0:(import.c:65:import_set_state_nolock()) ffff9ae241e9f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788638973.574053:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3691aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875523772897792:12345-0@lo:38: Request processed in 161us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638973.574069:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788638973.574144:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae375f38a80 x1875523772897792/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788638983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638973.574166:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788638973.574173:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1788638973.574180:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788638973.574185:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788638973.574187:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae241e99800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788638973.574193:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875523772897792:0@lo:38: 00000040:00080000:1.0:1788638973.580157:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1788638973.580299:0:8423:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1788638973.580333:0:8423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788638973.580350:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa400/0x25c454990262bf04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bf0b expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638973.580363:0:8423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa400/0x25c454990262bf04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bf0b expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788638973.580416:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788638973.580418:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788638973.580420:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788638973.580421:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788638973.580423:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788638973.580424:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788638973.580426:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788638973.580427:0:8423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788638973.580429:0:8423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788638973.580430:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788638973.580431:0:8423:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788638973.580436:0:8423:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1788638973.580439:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788638973.580441:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788638973.580442:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788638973.580443:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788638973.580447:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788638973.580449:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788638973.580450:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788638973.580451:0:8423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788638973.580452:0:8423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788638973.580453:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788638973.580454:0:8423:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788638973.580485:0:8423:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788638973.580507:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3691abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:8423:1875523772897920:0@lo:253: 00000100:00100000:1.0:1788638973.580588:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638973.580644:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae37b589540 going to sleep for 11 seconds 00000100:00100000:2.0:1788638973.580718:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772897920 00000100:00100000:2.0:1788638973.580726:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772897920 00000100:00100000:2.0:1788638973.580777:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788638973.580786:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+16:8423:x1875523772897920:12345-0@lo:253: 20000000:01000000:2.0:1788638973.580814:0:6510:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788638973.580828:0:6510:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788638973.594788:0:6510:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788638973.594808:0:6510:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788638973.594910:0:6532:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788638973.594917:0:6532:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788638973.594944:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ae340030c00/0x25c454990262bf3c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.594968:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae38217b800/0x25c454990262be32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262be2b expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.594977:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae38217b000/0x25c454990262be4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262be47 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.594985:0:6532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ae340030c00/0x25c454990262bf3c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.595032:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae38217b000/0x25c454990262be4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262be47 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.595047:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ae38217b000/0x25c454990262be4e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262be47 expref: 16 pid: 6510 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638973.595063:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e7100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6532:1875523772898048:0@lo:104: 00000100:00100000:0.0:1788638973.595144:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788638973.595227:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae38217b800/0x25c454990262be32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262be2b expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.595249:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ae38217b800/0x25c454990262be32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262be2b expref: 16 pid: 6511 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638973.595259:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e5180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6532:1875523772898176:0@lo:104: 00000100:00100000:0.0:1788638973.595278:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344252000 going to sleep for 11 seconds 00000100:00100000:2.0:1788638973.595576:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+16:8423:x1875523772897920:12345-0@lo:253: Request processed in 14788us (14985us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638973.595587:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788638973.595766:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788638973.595785:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638973.595850:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772898048 00000100:00100000:1.0:1788638973.595858:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772898048 00000100:00100000:3.0:1788638973.595953:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3691abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:8423:1875523772897920:0@lo:253: 00000100:00100000:0.0:1788638973.595965:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772898176 10000000:01000000:3.0:1788638973.595969:0:8423:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000100:00100000:0.0:1788638973.595970:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772898176 00000020:01000004:3.0:1788638973.595975:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788638973.595978:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788638973.595980:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788638973.595981:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788638973.595983:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788638973.595985:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788638973.595987:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788638973.595989:0:8423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788638973.595991:0:8423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788638973.595993:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788638973.595996:0:8423:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1788638973.595996:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788638973.596008:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375e93850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+4:6532:x1875523772898048:12345-0@lo:104: 00000020:02000000:3.0:1788638973.596015:0:8423:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1788638973.596022:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae38217aa00/0x25c454990262be47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262be4e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.596085:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788638973.596091:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375e93850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+4:6532:x1875523772898048:12345-0@lo:104: Request processed in 88us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638973.596098:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788638973.596134:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788638973.596139:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3691a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+3:6532:x1875523772898176:12345-0@lo:104: 00010000:00010000:0.0:1788638973.596147:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae340031000/0x25c454990262be2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262be32 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.596182:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788638973.596188:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3691a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+3:6532:x1875523772898176:12345-0@lo:104: Request processed in 48us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638973.596193:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1788638973.596211:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788638973.596228:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae38217aa00/0x25c454990262be47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262be4e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.596243:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae38217aa00 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:0.0:1788638973.596248:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae38217aa00/0x25c454990262be47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262be4e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.596257:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae38217aa00/0x25c454990262be47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262be4e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788638973.596266:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae38217aa00/0x25c454990262be47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262be4e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638973.596271:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788638973.596303:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae38217aa00/0x25c454990262be47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262be4e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.596310:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788638973.596329:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae38217aa00/0x25c454990262be47 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262be4e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.596337:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae38217aa00/0x25c454990262be47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262be4e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.596349:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638973.596353:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae340031000/0x25c454990262be2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262be32 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.596359:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae340031000 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:0.0:1788638973.596362:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae340031000/0x25c454990262be2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262be32 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.596378:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae340031000/0x25c454990262be2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262be32 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788638973.596384:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae340031000/0x25c454990262be2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262be32 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638973.596390:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788638973.596401:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae340031000/0x25c454990262be2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262be32 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.596407:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788638973.596412:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae340031000/0x25c454990262be2b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262be32 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.596419:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae340031000/0x25c454990262be2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262be32 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.596431:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638973.596433:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638973.596435:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638973.596454:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523772898304:0@lo:103: 00000100:00100000:0.0:1788638973.596483:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638973.596514:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788638973.596519:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523772898432:0@lo:103: 00000100:00100000:2.0:1788638973.596680:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e7100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6532:1875523772898048:0@lo:104: 00000100:00100000:2.0:1788638973.596688:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e5180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6532:1875523772898176:0@lo:104: 00010000:00010000:2.0:1788638973.596704:0:6532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ae340030c00/0x25c454990262bf3c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638973.597034:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638973.597080:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772898304 00000100:00100000:0.0:1788638973.597085:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772898304 00010000:00010000:0.0:1788638973.597103:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae38217b000/0x25c454990262be4e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262be47 expref: 16 pid: 6510 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638973.597134:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772898432 00000100:00100000:0.0:1788638973.597137:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772898432 00010000:00010000:0.0:1788638973.597146:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae38217b800/0x25c454990262be32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262be2b expref: 17 pid: 6511 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638973.597158:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788638973.597164:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2416e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+17:3643:x1875523772898304:12345-0@lo:103: 00010000:00010000:0.0:1788638973.597174:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638973.597179:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae38217b000/0x25c454990262be4e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262be47 expref: 17 pid: 6510 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.597191:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae38217b000/0x25c454990262be4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262be47 expref: 17 pid: 6510 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.597206:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae38217b000/0x25c454990262be4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262be47 expref: 17 pid: 6510 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.597233:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788638973.597262:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2416e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+16:3643:x1875523772898304:12345-0@lo:103: Request processed in 98us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638973.597268:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788638973.597280:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788638973.597285:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2416e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+15:3643:x1875523772898432:12345-0@lo:103: 00010000:00010000:0.0:1788638973.597292:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638973.597296:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae38217b800/0x25c454990262be32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262be2b expref: 15 pid: 6511 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.597305:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae38217b800/0x25c454990262be32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262be2b expref: 15 pid: 6511 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.597321:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae38217b800/0x25c454990262be32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262be2b expref: 15 pid: 6511 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.597331:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ae340030c00/0x25c454990262bf3c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.597340:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae340030c00/0x25c454990262bf3c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788638973.597353:0:6500:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007054721s 00010000:00010000:0.0:1788638973.597358:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae340030c00/0x25c454990262bf3c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.597365:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae340030c00/0x25c454990262bf3c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.597373:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ae340030c00/0x25c454990262bf3c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.597379:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ae340030c00/0x25c454990262bf3c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.597385:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae340030c00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788638973.597390:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ae340030c00/0x25c454990262bf3c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.597398:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ae340030c00/0x25c454990262bf3c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.597412:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ae340030c00/0x25c454990262bf3c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.597429:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788638973.597451:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2416e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+14:3643:x1875523772898432:12345-0@lo:103: Request processed in 166us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638973.597457:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788638973.597483:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523772898432:0@lo:103: 00000100:00100000:0.0:1788638973.597490:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523772898304:0@lo:103: 00010000:00010000:0.0:1788638973.597505:0:6532:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ae340030c00/0x25c454990262bf3c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.597513:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ae340030c00/0x25c454990262bf3c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638973.597520:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae340030c00/0x25c454990262bf3c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638973.601127:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1788638973.607235:0:8423:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1788638973.610271:0:8423:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788638973.610859:0:8423:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1788638973.611000:0:8423:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788638973.611189:0:8423:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1788638973.613025:0:8423:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1788638973.615572:0:8423:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788638973.626609:0:8423:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788638973.626780:0:8423:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788638973.626826:0:8423:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788638973.626882:0:8423:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.118@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788638973.626906:0:8423:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788638973.626931:0:8423:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1788638973.627906:0:8423:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788638973.628121:0:8423:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1788638974.391485:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788638974.866394:0:8508:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788638974.866604:0:8508:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788638975.161693:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788638975.161742:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3691aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772898560:0@lo:41: 00000100:00100000:3.0:1788638975.161837:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638975.177970:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772898560 00000100:00100000:0.0:1788638975.177984:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772898560 00000100:00100000:0.0:1788638975.178060:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788638975.178070:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36d1ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772898560:12345-0@lo:41: 00000004:00000024:0.0:1788638975.178106:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:0.0:1788638975.178185:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36d1ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772898560:12345-0@lo:41: Request processed in 117us (16348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638975.178192:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788638975.186583:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3691aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772898560:0@lo:41: 00010000:00010000:2.0:1788638975.413531:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638975.671294:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3691aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772898688:0@lo:41: 00000100:00100000:1.0:1788638975.671398:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638975.672368:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772898688 00000100:00100000:0.0:1788638975.672381:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772898688 00000100:00100000:0.0:1788638975.672447:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788638975.672466:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3691a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772898688:12345-0@lo:41: 00000004:00000024:0.0:1788638975.672509:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1788638975.672584:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3691a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772898688:12345-0@lo:41: Request processed in 120us (1186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638975.672591:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788638975.674884:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3691aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772898688:0@lo:41: 00010000:00010000:3.0:1788638976.446830:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638977.461408:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638978.484902:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638978.743026:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523772898816:0@lo:400: 00000100:00100000:1.0:1788638978.743110:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638978.743167:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772899328:0@lo:400: 00000100:00100000:1.0:1788638978.743203:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638978.743249:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788638978.743256:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523772898944:0@lo:400: 00000100:00100000:1.0:1788638978.743295:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638978.743313:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875523772899456:0@lo:400: 00000100:00100000:1.0:1788638978.743363:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638978.743393:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523772899200:0@lo:400: 00000100:00100000:1.0:1788638978.743416:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638978.743434:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788638978.743439:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772899072:0@lo:400: 00000100:00100000:1.0:1788638978.743459:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638978.743474:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875523772899584:0@lo:400: 00000100:00100000:1.0:1788638978.743494:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638978.743514:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772899328 00000100:00100000:1.0:1788638978.743521:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772899328 00000100:00100000:1.0:1788638978.743551:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772899072 00000100:00100000:1.0:1788638978.743554:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772899072 00000100:00100000:1.0:1788638978.743571:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788638978.743579:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3691aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772899328:12345-0@lo:400: 00000100:00100000:1.0:1788638978.743650:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3691aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772899328:12345-0@lo:400: Request processed in 70us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638978.743658:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788638978.743672:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788638978.743679:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242083480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772899072:12345-0@lo:400: 00000100:00100000:1.0:1788638978.743709:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242083480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772899072:12345-0@lo:400: Request processed in 31us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638978.743715:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788638978.743731:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772898944 00000100:00100000:1.0:1788638978.743740:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772898944 00000100:00100000:1.0:1788638978.743758:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772899456 00000100:00100000:1.0:1788638978.743761:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772899456 00000100:00100000:1.0:1788638978.743788:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772899200 00000100:00100000:1.0:1788638978.743791:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772899200 00000100:00100000:1.0:1788638978.743799:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772899584 00000100:00100000:1.0:1788638978.743801:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772899584 00000100:00100000:1.0:1788638978.743814:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788638978.743820:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3691abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523772898944:12345-0@lo:400: 00000100:00100000:1.0:1788638978.743852:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3691abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523772898944:12345-0@lo:400: Request processed in 32us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638978.743857:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788638978.743867:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788638978.743872:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875523772899456:12345-0@lo:400: 00000100:00100000:1.0:1788638978.743895:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875523772899456:12345-0@lo:400: Request processed in 23us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638978.743900:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788638978.743909:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788638978.743914:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523772899200:12345-0@lo:400: 00000100:00100000:1.0:1788638978.743935:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523772899200:12345-0@lo:400: Request processed in 21us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638978.743940:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788638978.743949:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788638978.743954:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875523772899584:12345-0@lo:400: 00000100:00100000:1.0:1788638978.743976:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875523772899584:12345-0@lo:400: Request processed in 22us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638978.743982:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788638978.744022:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772899072:0@lo:400: 00010000:00080000:1.0:1788638978.744044:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae36d1a9880 x1875523772899584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638978.744055:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875523772899584:0@lo:400: 00010000:00080000:1.0:1788638978.744065:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae36d1a8380 x1875523772899200/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638978.744074:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523772899200:0@lo:400: 00010000:00080000:1.0:1788638978.744106:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae36d1ab800 x1875523772898944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638978.744115:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523772898944:0@lo:400: 00010000:00080000:1.0:1788638978.744124:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae36d1a9f80 x1875523772899456/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638978.744131:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875523772899456:0@lo:400: 00000100:00100000:1.0:1788638978.744140:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772899328:0@lo:400: 00000100:00080000:1.0:1788638978.744175:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788638978.744179:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788638978.744778:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772898816 00000100:00100000:3.0:1788638978.744785:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772898816 00000100:00100000:3.0:1788638978.744827:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788638978.744835:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b679450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+14:3643:x1875523772898816:12345-0@lo:400: 00000100:00100000:3.0:1788638978.744893:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b679450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+14:3643:x1875523772898816:12345-0@lo:400: Request processed in 60us (1784us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638978.744900:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788638978.744982:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523772898816:0@lo:400: 00010000:00010000:1.0:1788638979.511750:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638980.279732:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788638980.279833:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772899712:0@lo:41: 00000100:00100000:0.0:1788638980.279918:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638980.280084:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772899712 00000100:00100000:1.0:1788638980.280095:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772899712 00000100:00100000:1.0:1788638980.280161:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788638980.280173:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2416e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772899712:12345-0@lo:41: 00000004:00000024:1.0:1788638980.280263:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:1.0:1788638980.280328:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2416e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772899712:12345-0@lo:41: Request processed in 156us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638980.280336:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788638980.280391:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772899712:0@lo:41: 00010000:00010000:1.0:1788638980.535117:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638980.790675:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788638980.790700:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242080000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772899840:0@lo:41: 00000100:00100000:1.0:1788638980.790762:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638980.790833:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772899840 00000100:00100000:1.0:1788638980.790841:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772899840 00000100:00100000:1.0:1788638980.790884:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788638980.790893:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772899840:12345-0@lo:41: 00000004:00000024:1.0:1788638980.790924:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788638980.790965:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772899840:12345-0@lo:41: Request processed in 73us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638980.790972:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788638980.791016:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242080000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772899840:0@lo:41: 00000001:02000400:2.0:1788638981.492743:0:8798:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg618-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788638981.559279:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788638981.813876:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788638981.813886:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ae3506e9000 from 30 10000000:01000000:0.0:1788638981.813893:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788638981.813941:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae340031200/0x25c454990262bf43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638981.813955:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae340031200/0x25c454990262bf43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638981.813967:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae340031200/0x25c454990262bf43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638981.813994:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772899968:0@lo:101: 00000100:00100000:0.0:1788638981.814084:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638981.814144:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3750e2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788638981.814167:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772899968 00000100:00100000:0.0:1788638981.814185:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772899968 00000100:00100000:0.0:1788638981.814246:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788638981.814255:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b679050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+14:6513:x1875523772899968:12345-0@lo:101: 00010000:00010000:0.0:1788638981.814270:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638981.814284:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae340030800/0x25c454990262bf4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262bf43 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638981.814311:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae340030800/0x25c454990262bf4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262bf43 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638981.814323:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae340030800/0x25c454990262bf4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262bf43 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638981.814334:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae340030800, rc 0) 00000100:00100000:0.0:1788638981.814374:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b679050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+15:6513:x1875523772899968:12345-0@lo:101: Request processed in 119us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638981.814381:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788638981.814432:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772899968:0@lo:101: 00010000:00010000:0.0:1788638981.814447:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae340031200/0x25c454990262bf43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bf4a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638981.814458:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae340031200/0x25c454990262bf43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262bf4a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638981.814521:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772900096:0@lo:501: 00000100:00100000:0.0:1788638981.814544:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638981.814559:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3750e2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788638981.814572:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772900096 00000100:00100000:0.0:1788638981.814575:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772900096 00000100:00100000:0.0:1788638981.814593:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788638981.814605:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+15:6513:x1875523772900096:12345-0@lo:501: 00000100:00100000:0.0:1788638981.814754:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+15:6513:x1875523772900096:12345-0@lo:501: Request processed in 149us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638981.814762:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788638981.814788:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772900096:0@lo:501: 00000100:00100000:0.0:1788638981.814811:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772900224:0@lo:503: 00000100:00100000:0.0:1788638981.814846:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638981.814859:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3750e2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788638981.814869:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772900224 00000100:00100000:0.0:1788638981.814872:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772900224 00000100:00100000:0.0:1788638981.814890:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788638981.814895:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+15:6513:x1875523772900224:12345-0@lo:503: 00000100:00100000:0.0:1788638981.814970:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+15:6513:x1875523772900224:12345-0@lo:503: Request processed in 73us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638981.814976:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788638981.815010:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772900224:0@lo:503: 00000100:00100000:0.0:1788638981.815561:0:8819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:8819:1875523772900352:0@lo:502: 00000100:00100000:0.0:1788638981.815595:0:8819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638981.815637:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772900352 00000100:00100000:0.0:1788638981.815641:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772900352 00000100:00100000:0.0:1788638981.815662:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788638981.815669:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+15:8819:x1875523772900352:12345-0@lo:502: 00000100:00100000:0.0:1788638981.815747:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+15:8819:x1875523772900352:12345-0@lo:502: Request processed in 77us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638981.815754:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788638981.815784:0:8819:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3750e2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788638981.815796:0:8819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:8819:1875523772900352:0@lo:502: 00000100:00100000:0.0:1788638981.815832:0:8819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:8819:1875523772900480:0@lo:502: 00000100:00100000:0.0:1788638981.815860:0:8819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638981.815877:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772900480 00000100:00100000:0.0:1788638981.815880:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772900480 00000100:00100000:0.0:1788638981.815897:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788638981.815902:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+15:8819:x1875523772900480:12345-0@lo:502: 00000100:00100000:0.0:1788638981.815954:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+15:8819:x1875523772900480:12345-0@lo:502: Request processed in 50us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638981.815960:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788638981.815985:0:8819:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3750e2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788638981.815994:0:8819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:8819:1875523772900480:0@lo:502: 00000040:00080000:0.0:1788638981.816010:0:8819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788638981.816063:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788638981.816079:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788638981.816088:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae340031200/0x25c454990262bf43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bf4a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638981.816098:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae340031200/0x25c454990262bf43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bf4a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638981.816107:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788638981.816110:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ae3506e9000 from 5 10000000:01000000:0.0:1788638981.816113:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788638981.816134:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae340030e00/0x25c454990262bf51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638981.816152:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae340030e00/0x25c454990262bf51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638981.816161:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae340030e00/0x25c454990262bf51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638981.816186:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772900608:0@lo:101: 00000100:00100000:0.0:1788638981.816210:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638981.816223:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3750e2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788638981.816234:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772900608 00000100:00100000:0.0:1788638981.816236:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772900608 00000100:00100000:0.0:1788638981.816253:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788638981.816257:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b678050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+15:6513:x1875523772900608:12345-0@lo:101: 00010000:00010000:0.0:1788638981.816265:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638981.816277:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae340031600/0x25c454990262bf58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262bf51 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638981.816298:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae340031600/0x25c454990262bf58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262bf51 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638981.816309:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae340031600/0x25c454990262bf58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262bf51 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638981.816316:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae340031600, rc 0) 00000100:00100000:0.0:1788638981.816344:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b678050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+16:6513:x1875523772900608:12345-0@lo:101: Request processed in 86us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638981.816349:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788638981.827766:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772900608:0@lo:101: 00010000:00010000:0.0:1788638981.827816:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae340030e00/0x25c454990262bf51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bf58 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638981.827831:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae340030e00/0x25c454990262bf51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262bf58 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638981.827982:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772900736:0@lo:256: 00000100:00100000:0.0:1788638981.828187:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638981.828274:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3750e2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788638981.840402:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772900736 00000100:00100000:1.0:1788638981.840418:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772900736 00000100:00100000:1.0:1788638981.840830:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788638981.840845:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+16:6513:x1875523772900736:12345-0@lo:256: 20000000:01000000:1.0:1788638981.840875:0:6510:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788638981.840938:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788638981.840942:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788638981.841089:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+16:6513:x1875523772900736:12345-0@lo:256: Request processed in 248us (12900us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638981.841097:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788638981.841161:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772900736:0@lo:256: 10000000:01000000:1.0:1788638981.841232:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788638981.841242:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae340030e00/0x25c454990262bf51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bf58 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638981.841258:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae340030e00/0x25c454990262bf51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bf58 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638981.841270:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1788638981.841273:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:1.0:1788638981.841276:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788638981.841314:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb000/0x25c454990262bf5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638981.841323:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb000/0x25c454990262bf5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638981.841333:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb000/0x25c454990262bf5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638981.841353:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242080000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772900864:0@lo:101: 00000100:00100000:1.0:1788638981.841388:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638981.841429:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d35a540 going to sleep for 11 seconds 00000100:00100000:3.0:1788638981.841944:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772900864 00000100:00100000:3.0:1788638981.841950:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772900864 00000100:00100000:3.0:1788638981.841989:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788638981.841997:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+16:6513:x1875523772900864:12345-0@lo:101: 00010000:00010000:3.0:1788638981.842077:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638981.842095:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae3429e4800/0x25c454990262bf66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262bf5f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638981.842122:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae3429e4800/0x25c454990262bf66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262bf5f expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638981.842135:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae3429e4800/0x25c454990262bf66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262bf5f expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638981.842145:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3429e4800, rc 0) 00000100:00100000:3.0:1788638981.842200:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+17:6513:x1875523772900864:12345-0@lo:101: Request processed in 203us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638981.842206:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788638981.843706:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242080000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772900864:0@lo:101: 00010000:00010000:1.0:1788638981.843733:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb000/0x25c454990262bf5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bf66 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638981.843746:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb000/0x25c454990262bf5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262bf66 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638981.843834:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242080000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772900992:0@lo:501: 00000100:00100000:1.0:1788638981.843888:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638981.843937:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772900992 00000100:00100000:1.0:1788638981.843943:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772900992 00000100:00100000:1.0:1788638981.843985:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788638981.843994:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+17:6513:x1875523772900992:12345-0@lo:501: 00000100:00100000:1.0:1788638981.844137:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+17:6513:x1875523772900992:12345-0@lo:501: Request processed in 143us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638981.844143:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788638981.844200:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d35a540 going to sleep for 11 seconds 00000100:00100000:1.0:1788638981.844212:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242080000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772900992:0@lo:501: 00000100:00100000:1.0:1788638981.844239:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242080000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772901120:0@lo:503: 00000100:00100000:1.0:1788638981.844283:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638981.844309:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772901120 00000100:00100000:1.0:1788638981.844313:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772901120 00000100:00100000:1.0:1788638981.844333:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788638981.844340:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+17:6513:x1875523772901120:12345-0@lo:503: 00000100:00100000:1.0:1788638981.844429:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+17:6513:x1875523772901120:12345-0@lo:503: Request processed in 90us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638981.844435:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788638981.844471:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d35a540 going to sleep for 11 seconds 00000100:00100000:1.0:1788638981.844483:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242080000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772901120:0@lo:503: 00000100:00100000:1.0:1788638981.847635:0:8821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242080000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:8821:1875523772901248:0@lo:502: 00000100:00100000:1.0:1788638981.847732:0:8821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638981.847771:0:8821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d35a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788638981.848748:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772901248 00000100:00100000:0.0:1788638981.848760:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772901248 00000100:00100000:0.0:1788638981.848817:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788638981.848827:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+17:8821:x1875523772901248:12345-0@lo:502: 00000100:00100000:0.0:1788638981.849118:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+17:8821:x1875523772901248:12345-0@lo:502: Request processed in 193us (1286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638981.849127:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788638981.849292:0:8821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242080000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:8821:1875523772901248:0@lo:502: 00000020:01000000:1.0:1788638981.849327:0:8821:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788638981.849336:0:8821:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788638981.849459:0:8821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788638981.849462:0:8821:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788638981.849468:0:8821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788638981.849472:0:8821:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.118@tcp to nid 0x20000c0a8ce76 (192.168.206.118@tcp) 00000020:01000000:1.0:1788638981.849499:0:8821:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788638981.849502:0:8821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788638981.849521:0:8821:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9ae375c58000) 00000020:00000080:1.0:1788638981.849561:0:8821:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1788638981.849569:0:8821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788638981.849704:0:8821:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1788638981.849712:0:8821:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788638981.849719:0:8821:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x25c454990262bf74 00010000:00080000:1.0:1788638981.849754:0:8821:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ae375c2c800@lustre-OST0000-osc-MDT0001: add connection 192.168.206.118@tcp at head 00010000:00010000:1.0:1788638981.850673:0:8821:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1788638981.881453:0:8821:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788638981.881484:0:8821:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788638981.881773:0:8821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788638981.882016:0:8821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788638981.882103:0:8821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1788638981.882213:0:8821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1788638981.887455:0:8822:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788638981.887465:0:8822:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788638981.888274:0:8821:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788638981.888290:0:8821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788638981.888343:0:8821:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788638981.888374:0:8821:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x25c454990262bf7b 00000100:00080000:2.0:1788638981.888387:0:8821:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788638981.888395:0:8821:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9ae375c2c800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788638981.888445:0:8821:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae375f3ad80 x1875523772901376/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788638981.888479:0:8821:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788638981.888554:0:8821:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788638981.888559:0:8821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788638981.888561:0:8821:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788638981.888565:0:8821:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788638981.888569:0:8821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788638981.888571:0:8821:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788638981.888574:0:8821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788638981.888576:0:8821:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788638981.888610:0:8821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f3bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:8821:1875523772901504:0@lo:502: 00000100:00100000:2.0:1788638981.888921:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523772901888:0@lo:400: 00000100:00100000:2.0:1788638981.888989:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638981.889060:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523772901376:0@lo:8: 00000100:00100000:1.0:1788638981.889107:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638981.889187:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875523772901632:0@lo:400: 00000100:00100000:0.0:1788638981.889300:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772902016:0@lo:400: 00000100:00100000:0.0:1788638981.889334:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638981.889383:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772901760:0@lo:400: 00000100:00100000:0.0:1788638981.889405:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638981.889422:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875523772902272:0@lo:400: 00000100:00100000:0.0:1788638981.889458:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772901376 00000100:00100000:0.0:1788638981.889465:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772901376 00000100:00100000:0.0:1788638981.889497:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788638981.889506:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242080000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1875523772901376:12345-0@lo:8: 00010000:00080000:0.0:1788638981.889532:0:8430:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 240 last 0 00000020:00000080:0.0:1788638981.889572:0:8430:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x25c454990262bf82 00002000:00100000:0.0:1788638981.889609:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9ae375f88800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1788638981.889630:0:8430:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:0.0:1788638981.889635:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1788638981.889726:0:8430:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1788638981.890008:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638981.890059:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772902016 00000100:00100000:1.0:1788638981.890064:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772902016 00000100:00100000:1.0:1788638981.890090:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772901760 00000100:00100000:1.0:1788638981.890093:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772901760 00000100:00100000:1.0:1788638981.890104:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788638981.890117:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2416e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772902016:12345-0@lo:400: 00000100:00100000:1.0:1788638981.890187:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2416e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772902016:12345-0@lo:400: Request processed in 70us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638981.890195:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788638981.890211:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788638981.890216:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2416e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772901760:12345-0@lo:400: 00000100:00100000:1.0:1788638981.890242:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2416e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772901760:12345-0@lo:400: Request processed in 26us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638981.890248:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00002000:00080000:0.0:1788638981.891859:0:8430:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1788638981.891901:0:8430:0:(import.c:65:import_set_state_nolock()) ffff9ae375f8a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788638981.891984:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242080000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1875523772901376:12345-0@lo:8: Request processed in 2476us (2875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638981.891992:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788638981.892070:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772902016:0@lo:400: 00010000:00080000:1.0:1788638981.894861:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae375f3ad80 x1875523772901376/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788638991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638981.894880:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788638981.894892:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788638981.894902:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788638981.894909:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788638981.894912:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae375c2c800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788638981.894941:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788638981.894948:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523772901376:0@lo:8: 00000004:00080000:1.0:1788638981.894988:0:8822:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788638981.895080:0:8822:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 240689463056ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788638981.895087:0:8822:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788638981.896982:0:8823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8823:1875523772902400:0@lo:700: 00000100:00100000:0.0:1788638981.897062:0:8823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638981.897105:0:8823:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae345521540 going to sleep for 11 seconds 00000004:00080000:1.0:1788638981.899079:0:7446:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:2.0:1788638981.901513:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875523772902144:0@lo:400: 00000100:00100000:2.0:1788638981.901595:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638981.901834:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772901888 00000100:00100000:3.0:1788638981.901845:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772901888 00000100:00100000:1.0:1788638981.904054:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772901632 00000100:00100000:1.0:1788638981.904067:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772901632 00000100:00100000:1.0:1788638981.904118:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788638981.904128:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523772901888:12345-0@lo:400: 00000100:00100000:1.0:1788638981.904240:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523772901888:12345-0@lo:400: Request processed in 112us (15249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638981.904254:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788638981.904272:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788638981.904278:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875523772901632:12345-0@lo:400: 00000100:00100000:1.0:1788638981.904310:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875523772901632:12345-0@lo:400: Request processed in 31us (14302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638981.904316:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1788638981.904664:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae36d1aad80 x1875523772901888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638981.904682:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523772901888:0@lo:400: 00010000:00080000:2.0:1788638981.905844:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae36d1a8700 x1875523772901632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638981.906649:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875523772901632:0@lo:400: 00000100:00100000:0.0:1788638981.906782:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772902144 00000100:00100000:0.0:1788638981.906790:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772902144 00000100:00100000:0.0:1788638981.906848:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788638981.906919:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638981.906986:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772901760:0@lo:400: 00000100:00100000:0.0:1788638981.907095:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875523772902144:12345-0@lo:400: 00000100:00100000:0.0:1788638981.907185:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875523772902144:12345-0@lo:400: Request processed in 82us (5578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638981.907193:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788638981.907210:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772902272 00000100:00100000:0.0:1788638981.907213:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772902272 00000100:00100000:0.0:1788638981.907230:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788638981.907235:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875523772902272:12345-0@lo:400: 00000100:00100000:0.0:1788638981.907266:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875523772902272:12345-0@lo:400: Request processed in 31us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638981.907279:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1788638981.907473:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae36d1a9f80 x1875523772902144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638981.907486:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875523772902144:0@lo:400: 00010000:00080000:2.0:1788638981.907513:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae36d1ab800 x1875523772902272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638981.907522:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875523772902272:0@lo:400: 00000100:00100000:2.0:1788638981.907551:0:8821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638981.907586:0:8821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24216e300 going to sleep for 11 seconds 00000100:00100000:3.0:1788638981.907779:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772902400 00000100:00100000:3.0:1788638981.907785:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772902400 00000100:00100000:3.0:1788638981.907813:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788638981.907820:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2416e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8823:x1875523772902400:12345-0@lo:700: 00000100:00100000:3.0:1788638981.907939:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8438:1875523772902528:0@lo:700: 00000100:00100000:3.0:1788638981.907977:0:8438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638981.907997:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae343acb780 going to sleep for 11 seconds 00000100:00100000:3.0:1788638981.908012:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772902528 00000100:00100000:3.0:1788638981.908079:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772902528 00000100:00100000:3.0:1788638981.908105:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788638981.908111:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36d1a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8438:x1875523772902528:12345-0@lo:700: 00000100:00100000:0.0:1788638981.908400:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772901504 00000100:00100000:0.0:1788638981.908404:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772901504 00000100:00100000:0.0:1788638981.908439:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788638981.908446:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+17:8821:x1875523772901504:12345-0@lo:502: 00000100:00100000:0.0:1788638981.908571:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+17:8821:x1875523772901504:12345-0@lo:502: Request processed in 124us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638981.908578:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:1.0:1788638981.908771:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788638981.908778:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788638981.908781:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788638981.908962:0:8821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f3bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:8821:1875523772901504:0@lo:502: 00000020:01000000:2.0:1788638981.908997:0:8821:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788638981.909013:0:8821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788638981.909082:0:8821:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788638981.909089:0:8821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:0.0:1788638981.910119:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:0.0:1788638981.910152:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788638981.910165:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb000/0x25c454990262bf5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bf66 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638981.910190:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb000/0x25c454990262bf5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bf66 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638981.910202:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788638981.910206:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ae3461e3800 from 30 10000000:01000000:0.0:1788638981.910209:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788638981.910248:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae340031000/0x25c454990262bf89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638981.910257:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae340031000/0x25c454990262bf89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638981.910269:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae340031000/0x25c454990262bf89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638981.910291:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772902656:0@lo:101: 00000100:00100000:0.0:1788638981.910365:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638981.910420:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36a011180 going to sleep for 11 seconds 00000100:00100000:3.0:1788638981.910776:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772902656 00000100:00100000:3.0:1788638981.910791:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772902656 00000100:00100000:3.0:1788638981.910844:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788638981.910964:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+17:6513:x1875523772902656:12345-0@lo:101: 00010000:00010000:3.0:1788638981.910980:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638981.910997:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae3429e5800/0x25c454990262bf90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262bf89 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638981.911538:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae3429e5800/0x25c454990262bf90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262bf89 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638981.911553:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae3429e5800/0x25c454990262bf90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262bf89 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638981.911564:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3429e5800, rc 0) 00000100:00100000:1.0:1788638981.912563:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+18:6513:x1875523772902656:12345-0@lo:101: Request processed in 1600us (2193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638981.912573:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788638981.913825:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772902656:0@lo:101: 00010000:00010000:3.0:1788638981.913951:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae340031000/0x25c454990262bf89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bf90 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638981.913966:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae340031000/0x25c454990262bf89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262bf90 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638981.914124:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772902784:0@lo:501: 00000100:00100000:3.0:1788638981.914191:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638981.914230:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344252480 going to sleep for 11 seconds 00000100:00100000:3.0:1788638981.914252:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772902784 00000100:00100000:3.0:1788638981.914258:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772902784 00000100:00100000:3.0:1788638981.914299:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788638981.914308:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+18:6513:x1875523772902784:12345-0@lo:501: 00000100:00100000:3.0:1788638981.914452:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+18:6513:x1875523772902784:12345-0@lo:501: Request processed in 145us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638981.914469:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788638981.914508:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772902784:0@lo:501: 00000100:00100000:3.0:1788638981.914534:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772902912:0@lo:503: 00000100:00100000:3.0:1788638981.914573:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638981.914588:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344252480 going to sleep for 11 seconds 00000100:00100000:1.0:1788638981.914926:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772902912 00000100:00100000:1.0:1788638981.914931:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772902912 00000100:00100000:1.0:1788638981.914958:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788638981.914965:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+18:6513:x1875523772902912:12345-0@lo:503: 00000100:00100000:1.0:1788638981.915121:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+18:6513:x1875523772902912:12345-0@lo:503: Request processed in 156us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638981.915128:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788638981.915205:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772902912:0@lo:503: 00000100:00100000:2.0:1788638981.916871:0:8824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f3bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:8824:1875523772903040:0@lo:502: 00000100:00100000:2.0:1788638981.916941:0:8824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638981.916980:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772903040 00000100:00100000:2.0:1788638981.916986:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772903040 00000100:00100000:2.0:1788638981.917795:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788638981.917806:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+18:8824:x1875523772903040:12345-0@lo:502: 40000000:02000000:1.0:1788638981.918489:0:6523:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:2.0:1788638981.920268:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+18:8824:x1875523772903040:12345-0@lo:502: Request processed in 2454us (3315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638981.920282:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788638981.923197:0:8824:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24216e300 going to sleep for 11 seconds 00000100:00100000:0.0:1788638981.923254:0:8824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f3bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:8824:1875523772903040:0@lo:502: 00000100:00100000:0.0:1788638981.923362:0:8824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:8824:1875523772903168:0@lo:502: 00000100:00100000:0.0:1788638981.923456:0:8824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638981.923516:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772903168 00000100:00100000:0.0:1788638981.923523:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772903168 00000100:00100000:0.0:1788638981.923587:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788638981.923597:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+18:8824:x1875523772903168:12345-0@lo:502: 00000100:00100000:0.0:1788638981.923752:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+18:8824:x1875523772903168:12345-0@lo:502: Request processed in 154us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638981.923760:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788638981.923806:0:8824:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36a011480 going to sleep for 11 seconds 00000100:00100000:0.0:1788638981.923820:0:8824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:8824:1875523772903168:0@lo:502: 00000040:00080000:0.0:1788638981.923839:0:8824:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788638981.928716:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788638981.928764:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788638981.928778:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae340031000/0x25c454990262bf89 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bf90 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638981.928803:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae340031000/0x25c454990262bf89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bf90 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638981.928816:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788638981.928819:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ae3461e3800 from 5 10000000:01000000:1.0:1788638981.928822:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788638981.928865:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262bf97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638981.928874:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262bf97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638981.928886:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262bf97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638981.928912:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242080a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772903296:0@lo:101: 00000100:00100000:1.0:1788638981.928983:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638981.929140:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d35a840 going to sleep for 11 seconds 00000100:00100000:1.0:1788638981.929163:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772903296 00000100:00100000:1.0:1788638981.929181:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772903296 00000100:00100000:1.0:1788638981.929229:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788638981.929239:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+18:6513:x1875523772903296:12345-0@lo:101: 00010000:00010000:1.0:1788638981.929253:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638981.929266:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae3750fb400/0x25c454990262bf9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262bf97 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638981.929293:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae3750fb400/0x25c454990262bf9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262bf97 expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638981.929318:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae3750fb400/0x25c454990262bf9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262bf97 expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638981.929328:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fb400, rc 0) 00000100:00100000:1.0:1788638981.929361:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+19:6513:x1875523772903296:12345-0@lo:101: Request processed in 123us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638981.929368:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788638981.929419:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242080a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772903296:0@lo:101: 00010000:00010000:1.0:1788638981.929434:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262bf97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bf9e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638981.929444:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262bf97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262bf9e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638981.929492:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242080a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772903424:0@lo:256: 00000100:00100000:1.0:1788638981.929522:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638981.929535:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d35a840 going to sleep for 11 seconds 00000100:00100000:1.0:1788638981.929545:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772903424 00000100:00100000:1.0:1788638981.929548:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772903424 00000100:00100000:1.0:1788638981.929567:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788638981.929573:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+19:6513:x1875523772903424:12345-0@lo:256: 20000000:01000000:1.0:1788638981.929587:0:6511:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788638981.929604:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788638981.929608:0:6511:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788638981.929924:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+19:6513:x1875523772903424:12345-0@lo:256: Request processed in 349us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638981.929932:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788638981.930238:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242080a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772903424:0@lo:256: 10000000:01000000:1.0:1788638981.930284:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788638981.930292:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262bf97 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bf9e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638981.930301:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262bf97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bf9e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638981.930309:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788638981.930311:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1788638981.930313:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788638981.930335:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3750fac00/0x25c454990262bfa5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638981.930342:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae3750fac00/0x25c454990262bfa5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638981.930350:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae3750fac00/0x25c454990262bfa5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638981.930362:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242080a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772903552:0@lo:101: 00000100:00100000:1.0:1788638981.930387:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638981.931255:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d35a840 going to sleep for 11 seconds 00000100:00100000:1.0:1788638981.931321:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36d1a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8438:x1875523772902528:12345-0@lo:700: Request processed in 23208us (23341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638981.931337:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788638981.931511:0:8438:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae36d1a8380 x1875523772902528/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788638997 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638981.931526:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8438:1875523772902528:0@lo:700: 40000000:02000000:3.0:1788638981.931538:0:8438:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:0.0:1788638981.935138:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772903552 00000100:00100000:0.0:1788638981.935155:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772903552 00000100:00100000:0.0:1788638981.935230:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788638981.935241:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+19:6513:x1875523772903552:12345-0@lo:101: 00010000:00010000:0.0:1788638981.935261:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638981.935283:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae340030c00/0x25c454990262bfac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262bfa5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638981.935317:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae340030c00/0x25c454990262bfac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262bfa5 expref: 20 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638981.935347:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae340030c00/0x25c454990262bfac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262bfa5 expref: 20 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638981.935358:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae340030c00, rc 0) 00000100:00100000:0.0:1788638981.935449:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+20:6513:x1875523772903552:12345-0@lo:101: Request processed in 210us (5060us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638981.935456:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788638981.935588:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242080a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772903552:0@lo:101: 00010000:00010000:1.0:1788638981.935609:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae3750fac00/0x25c454990262bfa5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bfac expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638981.935657:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae3750fac00/0x25c454990262bfa5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262bfac expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638981.935755:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242080a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772903680:0@lo:501: 00000100:00100000:1.0:1788638981.935790:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638981.935827:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d35a840 going to sleep for 11 seconds 00000100:00100000:0.0:1788638981.936516:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772903680 00000100:00100000:0.0:1788638981.936525:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772903680 00000100:00100000:0.0:1788638981.936573:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788638981.936582:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+20:6513:x1875523772903680:12345-0@lo:501: 00000100:00100000:0.0:1788638981.936764:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+20:6513:x1875523772903680:12345-0@lo:501: Request processed in 183us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638981.936772:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788638981.936867:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242080a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772903680:0@lo:501: 00000100:00100000:1.0:1788638981.936904:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242080a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772903808:0@lo:503: 00000100:00100000:1.0:1788638981.936949:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638981.936972:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d35a840 going to sleep for 11 seconds 00000100:00100000:1.0:1788638981.936987:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772903808 00000100:00100000:1.0:1788638981.936990:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772903808 00000100:00100000:1.0:1788638981.937013:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788638981.937030:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+20:6513:x1875523772903808:12345-0@lo:503: 00000100:00100000:1.0:1788638981.937107:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+20:6513:x1875523772903808:12345-0@lo:503: Request processed in 77us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638981.937114:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788638981.937154:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242080a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772903808:0@lo:503: 00000100:00100000:0.0:1788638981.938902:0:8826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:8826:1875523772903936:0@lo:502: 00000100:00100000:0.0:1788638981.938981:0:8826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638981.939030:0:8826:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae37b589780 going to sleep for 11 seconds 00000100:00100000:1.0:1788638981.939123:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772903936 00000100:00100000:1.0:1788638981.939130:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772903936 00000100:00100000:1.0:1788638981.939184:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788638981.939194:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+20:8826:x1875523772903936:12345-0@lo:502: 00000100:00100000:1.0:1788638981.939323:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+20:8826:x1875523772903936:12345-0@lo:502: Request processed in 130us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638981.939331:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788638981.939397:0:8826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:8826:1875523772903936:0@lo:502: 00000020:01000000:1.0:1788638981.939428:0:8826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788638981.939438:0:8826:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788638981.939447:0:8826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788638981.939450:0:8826:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788638981.939457:0:8826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788638981.939462:0:8826:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.118@tcp to nid 0x20000c0a8ce76 (192.168.206.118@tcp) 00000020:01000000:1.0:1788638981.939493:0:8826:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788638981.939496:0:8826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788638981.939531:0:8826:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9ae37f71cd40) 00000020:00000080:1.0:1788638981.939563:0:8826:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1788638981.939570:0:8826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788638981.941216:0:8826:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788638981.941228:0:8826:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788638981.941241:0:8826:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x25c454990262bfba 00010000:00080000:1.0:1788638981.941284:0:8826:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ae375c2b800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.118@tcp at head 00010000:00010000:1.0:1788638981.941551:0:8826:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000001:00100000:3.0:1788638981.946125:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1788638981.946490:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2416e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8823:x1875523772902400:12345-0@lo:700: Request processed in 38664us (49421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638981.946511:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788638981.946603:0:8823:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae2416e7480 x1875523772902400/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788638997 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638981.946847:0:8823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8823:1875523772902400:0@lo:700: 00000040:01000000:1.0:1788638981.952941:0:8826:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788638981.952972:0:8826:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788638981.953302:0:8826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788638981.953516:0:8826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788638981.953764:0:8826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1788638981.953937:0:8826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1788638981.954528:0:8827:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788638981.954534:0:8827:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788638981.955468:0:8826:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788638981.955482:0:8826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788638981.955527:0:8826:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788638981.955555:0:8826:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x25c454990262bfc1 00000100:00080000:1.0:1788638981.955568:0:8826:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788638981.955576:0:8826:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ae375c2b800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:1.0:1788638981.955783:0:8826:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae242080a80 x1875523772904064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788638981.955906:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242080a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523772904064:0@lo:8: 00000100:00100000:2.0:1788638981.956002:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638981.956184:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772904064 00000100:00100000:3.0:1788638981.956193:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772904064 00000100:00100000:3.0:1788638981.956238:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788638981.956247:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3640:x1875523772904064:12345-0@lo:8: 00010000:00080000:3.0:1788638981.956278:0:8432:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 240 last 0 00000020:00000080:3.0:1788638981.956307:0:8432:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x25c454990262bfc8 00002000:00100000:3.0:1788638981.956323:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9ae2416ec800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788638981.956328:0:8432:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788638981.956331:0:8432:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788638981.956429:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788638981.956458:0:8432:0:(import.c:65:import_set_state_nolock()) ffff9ae2416ed000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1788638981.956688:0:8826:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788638981.956779:0:8826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788638981.956784:0:8826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788638981.956787:0:8826:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788638981.956791:0:8826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788638981.956795:0:8826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788638981.956815:0:8826:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788638981.956820:0:8826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788638981.956822:0:8826:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788638981.956853:0:8826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:8826:1875523772904192:0@lo:502: 00000100:00100000:0.0:1788638981.956904:0:8826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638981.956949:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772904192 00000100:00100000:0.0:1788638981.956954:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772904192 00000100:00100000:0.0:1788638981.956991:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788638981.957000:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+20:8826:x1875523772904192:12345-0@lo:502: 00000100:00100000:0.0:1788638981.957262:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+20:8826:x1875523772904192:12345-0@lo:502: Request processed in 263us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638981.957272:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788638981.957327:0:8826:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae37b589180 going to sleep for 11 seconds 00000100:00100000:0.0:1788638981.957351:0:8826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:8826:1875523772904192:0@lo:502: 00000020:01000000:0.0:1788638981.957380:0:8826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788638981.957385:0:8826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788638981.957387:0:8826:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788638981.957391:0:8826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1788638981.957684:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1788638981.957709:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788638981.957721:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3750fac00/0x25c454990262bfa5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bfac expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638981.957733:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae3750fac00/0x25c454990262bfa5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bfac expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638981.957744:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788638981.957747:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ae342e50000 from 1 10000000:01000000:1.0:1788638981.957750:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788638981.957781:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb200/0x25c454990262bfcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638981.957789:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb200/0x25c454990262bfcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638981.957799:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb200/0x25c454990262bfcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638981.957826:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242082d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772904320:0@lo:101: 00000100:00100000:1.0:1788638981.957860:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638981.957889:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3431e9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788638981.957905:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772904320 00000100:00100000:1.0:1788638981.957909:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772904320 00000100:00100000:1.0:1788638981.957938:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788638981.957945:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370fff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+20:6513:x1875523772904320:12345-0@lo:101: 00010000:00010000:1.0:1788638981.957954:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638981.957975:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae3750fa800/0x25c454990262bfd6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262bfcf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638981.957998:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae3750fa800/0x25c454990262bfd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262bfcf expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638981.958010:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae3750fa800/0x25c454990262bfd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262bfcf expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638981.958192:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fa800, rc 0) 00000100:00100000:1.0:1788638981.958230:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370fff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+21:6513:x1875523772904320:12345-0@lo:101: Request processed in 285us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638981.958237:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788638981.958271:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242082d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772904320:0@lo:101: 00010000:00010000:1.0:1788638981.958282:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb200/0x25c454990262bfcf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bfd6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638981.958291:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb200/0x25c454990262bfcf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262bfd6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638981.958343:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242082d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772904448:0@lo:501: 00000100:00100000:1.0:1788638981.958367:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638981.958378:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3431e9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788638981.958388:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772904448 00000100:00100000:1.0:1788638981.958391:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772904448 00000100:00100000:1.0:1788638981.958408:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788638981.958414:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+21:6513:x1875523772904448:12345-0@lo:501: 00000100:00100000:1.0:1788638981.958478:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+21:6513:x1875523772904448:12345-0@lo:501: Request processed in 63us (110us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788638981.958493:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788638981.958519:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242082d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772904448:0@lo:501: 10000000:01000000:1.0:1788638981.958541:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788638981.958545:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb200/0x25c454990262bfcf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bfd6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638981.958552:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb200/0x25c454990262bfcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bfd6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638981.959372:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1875523772904064:12345-0@lo:8: Request processed in 3120us (3367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638981.959389:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788638981.960496:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae242080a80 x1875523772904064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788638991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638981.960511:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788638981.960521:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788638981.960530:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788638981.960537:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788638981.960540:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae375c2b800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788638981.960589:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788638981.960596:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242080a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523772904064:0@lo:8: 00000004:00080000:2.0:1788638981.962142:0:8823:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788638981.962186:0:8823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f3bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8823:1875523772904704:0@lo:7: 00000100:00100000:2.0:1788638981.962261:0:8823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638981.962303:0:8823:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24216ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1788638981.962333:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772904704 00000100:00100000:2.0:1788638981.962341:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772904704 00000100:00100000:2.0:1788638981.962388:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788638981.962398:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8823:x1875523772904704:12345-0@lo:7: 00000100:00100000:3.0:1788638981.963144:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788638981.963158:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772904576:0@lo:13: 00000100:00100000:3.0:1788638981.963213:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638981.963309:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772904576 00000100:00100000:3.0:1788638981.963314:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772904576 00000100:00100000:3.0:1788638981.963342:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788638981.963349:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36d1a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1875523772904576:12345-0@lo:13: 00002000:00000024:3.0:1788638981.963369:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923935232 avail 3692412928 00000100:00100000:3.0:1788638981.963414:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36d1a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1875523772904576:12345-0@lo:13: Request processed in 66us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638981.963421:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788638981.963923:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae375f39f80 x1875523772904576/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638997 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638981.963945:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772904576:0@lo:13: 00000004:00080000:3.0:1788638981.965134:0:8828:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788638981.965160:0:8828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1ab800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8828:1875523772904960:0@lo:7: 00000100:00100000:3.0:1788638981.965225:0:8828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638981.965248:0:8828:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344252780 going to sleep for 11 seconds 00000100:00100000:1.0:1788638981.965312:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772904832:0@lo:13: 00000100:00100000:1.0:1788638981.965347:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638981.965392:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788638981.965399:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788638981.965554:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772904960 00000100:00100000:1.0:1788638981.965561:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772904960 00000100:00080000:1.0:1788638981.965607:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788638981.965709:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788638981.965718:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36d1a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8828:x1875523772904960:12345-0@lo:7: 00000100:00100000:3.0:1788638981.965899:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772904832 00000100:00100000:3.0:1788638981.965904:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772904832 00000100:00100000:3.0:1788638981.965928:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788638981.965934:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242082d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1875523772904832:12345-0@lo:13: 00002000:00000024:3.0:1788638981.965947:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923935232 avail 3692412928 00000100:00100000:3.0:1788638981.965995:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242082d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1875523772904832:12345-0@lo:13: Request processed in 60us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638981.966011:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000004:00080000:0.0:1788638981.966115:0:8827:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788638981.966214:0:8827:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 240760596942ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788638981.966220:0:8827:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00080000:1.0:1788638981.966590:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae36d1a9c00 x1875523772904832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638997 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638981.966610:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772904832:0@lo:13: 00000004:00080000:0.0:1788638981.968895:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:2.0:1788638981.972450:0:8431:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1788638981.972460:0:8431:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788638981.972575:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8823:x1875523772904704:12345-0@lo:7: Request processed in 10173us (10308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638981.972587:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788638981.972811:0:8823:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae375f3bb80 x1875523772904704/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788638997 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638981.972829:0:8823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f3bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8823:1875523772904704:0@lo:7: 00000004:00080000:3.0:1788638981.972846:0:8823:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788638981.972890:0:8823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1abb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8823:1875523772905088:0@lo:5: 00000100:00100000:3.0:1788638981.972928:0:8823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638981.972964:0:8823:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344252480 going to sleep for 11 seconds 00000100:00100000:0.0:1788638981.974130:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772905088 00000100:00100000:0.0:1788638981.974139:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772905088 00000100:00100000:0.0:1788638981.974204:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788638981.974214:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36d1a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8823:x1875523772905088:12345-0@lo:5: 00002000:00080000:0.0:1788638981.974246:0:8432:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1788638981.974314:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36d1a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8823:x1875523772905088:12345-0@lo:5: Request processed in 100us (1385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638981.974332:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788638981.974557:0:8823:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae36d1abb80 x1875523772905088/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788638997 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638981.974571:0:8823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1abb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8823:1875523772905088:0@lo:5: 00000004:00080000:3.0:1788638981.974583:0:8823:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788638981.974645:0:8823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1abb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8823:1875523772905216:0@lo:5: 00000100:00100000:3.0:1788638981.974684:0:8823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638981.974705:0:8823:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344252480 going to sleep for 11 seconds 00000100:00100000:2.0:1788638981.975825:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772905216 00000100:00100000:2.0:1788638981.975833:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772905216 00000100:00100000:2.0:1788638981.975874:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788638981.975884:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36d1aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8823:x1875523772905216:12345-0@lo:5: 00002000:00080000:2.0:1788638981.975925:0:8431:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1788638981.979987:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36d1aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:8823:x1875523772905216:12345-0@lo:5: Request processed in 4097us (5294us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788638981.980002:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788638981.980331:0:8823:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae36d1abb80 x1875523772905216/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788638997 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638981.980350:0:8823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1abb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8823:1875523772905216:0@lo:5: 00000004:00080000:3.0:1788638981.980368:0:8823:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:3.0:1788638981.980414:0:8823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1a8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8823:1875523772905344:0@lo:900: 00000100:00100000:3.0:1788638981.980453:0:8823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638981.980485:0:8823:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344252480 going to sleep for 11 seconds 00000100:00100000:0.0:1788638981.980654:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772905344 00000100:00100000:0.0:1788638981.980662:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772905344 00000100:00100000:0.0:1788638981.980826:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788638981.980837:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36d1a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8823:x1875523772905344:12345-0@lo:900: 00000100:00100000:0.0:1788638981.980899:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36d1a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8823:x1875523772905344:12345-0@lo:900: Request processed in 64us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638981.980906:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00002000:00080000:1.0:1788638981.981696:0:8829:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1788638981.981703:0:8829:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788638981.981750:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36d1a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8828:x1875523772904960:12345-0@lo:7: Request processed in 16032us (16523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638981.981758:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788638981.982003:0:8828:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae36d1ab800 x1875523772904960/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788638997 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638981.982033:0:8828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1ab800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8828:1875523772904960:0@lo:7: 00000004:00080000:3.0:1788638981.982045:0:8828:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788638981.982075:0:8828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1ab800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8828:1875523772905472:0@lo:5: 00000100:00100000:3.0:1788638981.982114:0:8828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638981.982141:0:8828:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344252780 going to sleep for 11 seconds 00000100:00100000:2.0:1788638981.982242:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772905472 00000100:00100000:2.0:1788638981.982247:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772905472 00000100:00100000:2.0:1788638981.982283:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788638981.982291:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8828:x1875523772905472:12345-0@lo:5: 00002000:00080000:2.0:1788638981.982314:0:8430:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788638981.982319:0:8430:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00010000:00080000:0.0:1788638981.985945:0:8823:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae36d1a8e00 x1875523772905344/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788638997 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638981.985967:0:8823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1a8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8823:1875523772905344:0@lo:900: 00000001:00080000:2.0:1788638981.986793:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:2.0:1788638981.986808:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1788638981.986817:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788638981.987079:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8828:x1875523772905472:12345-0@lo:5: Request processed in 4788us (4962us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788638981.987091:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788638981.987222:0:8828:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae36d1ab800 x1875523772905472/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788638997 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638981.987242:0:8828:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788638981.987248:0:8828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1ab800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8828:1875523772905472:0@lo:5: 00000004:00080000:1.0:1788638981.987260:0:8828:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788638981.987313:0:8828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242083b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8828:1875523772905600:0@lo:700: 00000100:00100000:1.0:1788638981.987350:0:8828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638981.987383:0:8828:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae348fc3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788638981.987434:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772905600 00000100:00100000:2.0:1788638981.987441:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772905600 00000100:00100000:2.0:1788638981.987489:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788638981.987499:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242083100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8828:x1875523772905600:12345-0@lo:700: 00000100:00100000:2.0:1788638982.002471:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242083100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8828:x1875523772905600:12345-0@lo:700: Request processed in 14961us (15108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638982.002488:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788638982.002767:0:8828:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae242083b80 x1875523772905600/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788638997 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638982.002783:0:8828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242083b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8828:1875523772905600:0@lo:700: 00000004:02000040:1.0:1788638982.004453:0:8828:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:1.0:1788638982.016358:0:8828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242083b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8828:1875523772905728:0@lo:5: 00000100:00100000:1.0:1788638982.016438:0:8828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638982.016490:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772905728 00000100:00100000:1.0:1788638982.016498:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772905728 00000100:00100000:1.0:1788638982.016551:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788638982.016560:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242081180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:8828:x1875523772905728:12345-0@lo:5: 00000100:00100000:2.0:1788638982.019838:0:8828:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae348fc3d80 going to sleep for 11 seconds 00002000:00080000:1.0:1788638982.029121:0:8829:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1788638982.029148:0:8829:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:1.0:1788638982.042472:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242081180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8828:x1875523772905728:12345-0@lo:5: Request processed in 25904us (26024us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788638982.042487:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788638982.042890:0:8828:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae242083b80 x1875523772905728/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788638998 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638982.042909:0:8828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242083b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8828:1875523772905728:0@lo:5: 00000004:00080000:2.0:1788638982.042927:0:8828:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000020:00000004:3.0:1788638982.327328:0:8859:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788638982.327551:0:8859:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788638982.586462:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788638983.047965:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:1.0:1788638983.605905:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638984.631774:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788638984.813516:0:8960:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788638984.813907:0:8960:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788638985.396913:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788638985.396950:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772905856:0@lo:41: 00000100:00100000:0.0:1788638985.397046:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638985.397180:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772905856 00000100:00100000:1.0:1788638985.397190:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772905856 00000100:00100000:1.0:1788638985.397263:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788638985.397274:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2416e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772905856:12345-0@lo:41: 00000004:00000024:1.0:1788638985.397321:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1788638985.397380:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2416e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772905856:12345-0@lo:41: Request processed in 108us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638985.397388:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788638985.397441:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772905856:0@lo:41: 00000020:00000004:1.0:1788638985.496106:0:9008:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788638985.496121:0:9008:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:3.0:1788638985.653536:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638985.908838:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788638985.908872:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772905984:0@lo:41: 00000100:00100000:1.0:1788638985.908957:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638985.909027:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772905984 00000100:00100000:1.0:1788638985.909036:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772905984 00000100:00100000:1.0:1788638985.909091:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788638985.909101:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772905984:12345-0@lo:41: 00000004:00000024:1.0:1788638985.909731:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788638985.909817:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772905984:12345-0@lo:41: Request processed in 714us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638985.909827:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788638985.909998:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772905984:0@lo:41: 00010000:00010000:0.0:1788638986.677679:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638987.444919:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788638987.444944:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772906112:0@lo:13: 00000100:00100000:0.0:1788638987.445009:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638987.445082:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772906112 00000100:00100000:0.0:1788638987.445089:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772906112 00000100:00100000:0.0:1788638987.445153:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788638987.445164:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2416e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772906112:12345-0@lo:13: 00002000:00000024:0.0:1788638987.445199:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788638987.445247:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2416e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772906112:12345-0@lo:13: Request processed in 85us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638987.445255:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788638987.445275:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788638987.445303:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae2416e4000 x1875523772906112/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639003 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638987.445315:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788638987.445336:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772906112:0@lo:13: 00000100:00100000:0.0:1788638987.445544:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875523772906368:0@lo:400: 00000100:00100000:0.0:1788638987.445574:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638987.445597:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875523772906880:0@lo:400: 00000100:00100000:0.0:1788638987.445649:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638987.445671:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788638987.445677:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01f1eef9-e690-4065-bf99-bf821af7b626:3644:1875523772906240:0@lo:400: 00000100:00100000:0.0:1788638987.445703:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638987.445724:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772906752:0@lo:400: 00000100:00100000:0.0:1788638987.445746:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638987.445772:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523772906624:0@lo:400: 00000100:00100000:0.0:1788638987.445794:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638987.445813:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772907136:0@lo:400: 00000100:00100000:0.0:1788638987.445838:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638987.445859:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788638987.445864:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772906496:0@lo:400: 00000100:00100000:0.0:1788638987.445883:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638987.445908:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875523772907008:0@lo:400: 00000100:00100000:0.0:1788638987.445928:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638987.445950:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772906368 00000100:00100000:0.0:1788638987.445955:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772906368 00000100:00100000:0.0:1788638987.445979:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772906880 00000100:00100000:0.0:1788638987.445982:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772906880 00000100:00100000:0.0:1788638987.446001:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772906624 00000100:00100000:0.0:1788638987.446004:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772906624 00000100:00100000:0.0:1788638987.446014:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772907008 00000100:00100000:0.0:1788638987.446016:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772907008 00000100:00100000:0.0:1788638987.446029:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788638987.446036:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36914df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875523772906368:12345-0@lo:400: 00000100:00100000:0.0:1788638987.446076:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36914df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875523772906368:12345-0@lo:400: Request processed in 40us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638987.446082:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788638987.446098:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788638987.446104:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36914ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875523772906880:12345-0@lo:400: 00000100:00100000:0.0:1788638987.446132:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36914ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875523772906880:12345-0@lo:400: Request processed in 29us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638987.446138:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788638987.446161:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788638987.446167:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36914f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523772906624:12345-0@lo:400: 00000100:00100000:0.0:1788638987.446199:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36914f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523772906624:12345-0@lo:400: Request processed in 32us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638987.446205:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788638987.446215:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788638987.446221:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36914e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875523772907008:12345-0@lo:400: 00000100:00100000:0.0:1788638987.446247:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36914e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875523772907008:12345-0@lo:400: Request processed in 28us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638987.446259:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788638987.446281:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772906752 00000100:00100000:0.0:1788638987.446285:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772906752 00000100:00100000:0.0:1788638987.446301:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772906496 00000100:00100000:0.0:1788638987.446303:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772906496 00000100:00100000:0.0:1788638987.446313:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788638987.446318:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36914f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772906752:12345-0@lo:400: 00000100:00100000:0.0:1788638987.446351:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36914f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772906752:12345-0@lo:400: Request processed in 33us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638987.446357:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788638987.446369:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788638987.446375:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36914e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772906496:12345-0@lo:400: 00000100:00100000:0.0:1788638987.446405:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36914e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772906496:12345-0@lo:400: Request processed in 30us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638987.446410:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788638987.446430:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772907136 00000100:00100000:0.0:1788638987.446433:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772907136 00000100:00100000:0.0:1788638987.446459:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788638987.446466:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36914f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772907136:12345-0@lo:400: 00000100:00100000:0.0:1788638987.446496:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36914f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772907136:12345-0@lo:400: Request processed in 31us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638987.446501:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788638987.446522:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788638987.446525:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788638987.446527:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788638987.446549:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772906496:0@lo:400: 00010000:00080000:0.0:1788638987.446562:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae36d1ab800 x1875523772907008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638987.446578:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875523772907008:0@lo:400: 00010000:00080000:0.0:1788638987.446591:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae2416e7100 x1875523772906624/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638987.446599:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523772906624:0@lo:400: 00010000:00080000:0.0:1788638987.446609:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae36d1a8e00 x1875523772907136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638987.446637:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1788638987.446650:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772907136:0@lo:400: 00000100:00100000:0.0:1788638987.446679:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772906752:0@lo:400: 00010000:00080000:0.0:1788638987.446689:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae2416e4700 x1875523772906368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638987.446696:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875523772906368:0@lo:400: 00010000:00080000:0.0:1788638987.446705:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae36d1abb80 x1875523772906880/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638987.446712:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875523772906880:0@lo:400: 00000100:00100000:1.0:1788638987.448677:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772906240 00000100:00100000:1.0:1788638987.448689:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772906240 00000100:00100000:1.0:1788638987.448741:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788638987.448751:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+21:3644:x1875523772906240:12345-0@lo:400: 00000100:00100000:1.0:1788638987.448825:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+21:3644:x1875523772906240:12345-0@lo:400: Request processed in 77us (3121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638987.448832:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788638987.448890:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01f1eef9-e690-4065-bf99-bf821af7b626:3644:1875523772906240:0@lo:400: 00000100:00100000:2.0:1788638987.450269:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788638987.450286:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772907264:0@lo:13: 00000100:00100000:2.0:1788638987.450343:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638987.450393:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772907264 00000100:00100000:2.0:1788638987.450399:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772907264 00000100:00100000:2.0:1788638987.450441:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788638987.450450:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772907264:12345-0@lo:13: 00002000:00000024:2.0:1788638987.450468:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788638987.450507:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772907264:12345-0@lo:13: Request processed in 58us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638987.450513:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788638987.450551:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae375f38700 x1875523772907264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639003 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638987.450568:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772907264:0@lo:13: 00010000:00010000:1.0:1788638987.708192:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638988.727446:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638989.753853:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638990.518186:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788638990.518225:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242080e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772907392:0@lo:41: 00000100:00100000:0.0:1788638990.518328:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638990.518394:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772907392 00000100:00100000:1.0:1788638990.518415:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772907392 00000100:00100000:1.0:1788638990.518481:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788638990.518503:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36914dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772907392:12345-0@lo:41: 00000004:00000024:1.0:1788638990.518553:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1788638990.518642:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36914dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772907392:12345-0@lo:41: Request processed in 151us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638990.518650:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788638990.519117:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242080e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772907392:0@lo:41: 00010000:00010000:1.0:1788638990.774395:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638991.029281:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788638991.029322:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772907520:0@lo:41: 00000100:00100000:3.0:1788638991.029423:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638991.029924:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772907520 00000100:00100000:2.0:1788638991.029936:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772907520 00000100:00100000:2.0:1788638991.030347:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788638991.030360:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772907520:12345-0@lo:41: 00000004:00000024:2.0:1788638991.030407:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788638991.030485:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772907520:12345-0@lo:41: Request processed in 128us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638991.030493:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788638991.031201:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772907520:0@lo:41: 00010000:00010000:2.0:1788638991.798326:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638992.565105:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523772907776:0@lo:400: 00000100:00100000:2.0:1788638992.565186:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638992.565235:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772908288:0@lo:400: 00000100:00100000:2.0:1788638992.565271:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638992.565421:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342e3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772908800:0@lo:400: 00000100:00100000:2.0:1788638992.565448:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638992.565483:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788638992.565488:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523772907904:0@lo:400: 00000100:00100000:2.0:1788638992.565523:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638992.565545:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875523772908416:0@lo:400: 00000100:00100000:2.0:1788638992.565567:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638992.565584:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772908928:0@lo:13: 00000100:00100000:2.0:1788638992.565604:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638992.565711:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772908800 00000100:00100000:0.0:1788638992.565720:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772908800 00000100:00100000:0.0:1788638992.565771:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788638992.565781:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae342e3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772908800:12345-0@lo:400: 00000100:00100000:0.0:1788638992.565852:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae342e3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772908800:12345-0@lo:400: Request processed in 73us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638992.565860:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788638992.565882:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788638992.565961:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae342e3ed80 x1875523772908800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638992.565975:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342e3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772908800:0@lo:400: 00000100:00100000:2.0:1788638992.566003:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772907776 00000100:00100000:2.0:1788638992.566007:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772907776 00000100:00100000:2.0:1788638992.566032:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788638992.566038:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+21:3643:x1875523772907776:12345-0@lo:400: 00000100:00100000:2.0:1788638992.566073:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+21:3643:x1875523772907776:12345-0@lo:400: Request processed in 35us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638992.566079:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788638992.566107:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772908288 00000100:00100000:2.0:1788638992.566111:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772908288 00000100:00100000:2.0:1788638992.566147:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788638992.566153:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae342e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772908288:12345-0@lo:400: 00000100:00100000:2.0:1788638992.566184:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae342e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772908288:12345-0@lo:400: Request processed in 32us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638992.566196:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788638992.566213:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772907904 00000100:00100000:2.0:1788638992.566216:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772907904 00000100:00100000:2.0:1788638992.566237:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772908416 00000100:00100000:2.0:1788638992.566241:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772908416 00000100:00100000:2.0:1788638992.566266:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788638992.566272:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523772907904:12345-0@lo:400: 00000100:00100000:1.0:1788638992.566465:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772908032:0@lo:400: 00000100:00100000:1.0:1788638992.566505:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638992.566538:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342e3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875523772908544:0@lo:400: 00000100:00100000:1.0:1788638992.566562:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638992.566579:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788638992.566586:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36914d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772907648:0@lo:13: 00000100:00100000:1.0:1788638992.566609:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638992.566666:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875523772908160:0@lo:400: 00000100:00100000:1.0:1788638992.566691:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638992.566703:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342e3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772908672:0@lo:400: 00000100:00100000:1.0:1788638992.566723:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638992.566754:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772908672 00000100:00100000:1.0:1788638992.566758:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772908672 00000100:00100000:1.0:1788638992.566793:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788638992.566812:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242083b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772908672:12345-0@lo:400: 00000100:00100000:1.0:1788638992.566852:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242083b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772908672:12345-0@lo:400: Request processed in 44us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638992.566859:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788638992.566886:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772908928 00000100:00100000:1.0:1788638992.566891:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772908928 00000100:00100000:1.0:1788638992.566904:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772907648 00000100:00100000:1.0:1788638992.566907:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772907648 00000100:00100000:1.0:1788638992.566918:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788638992.566925:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772908928:12345-0@lo:13: 00002000:00000024:1.0:1788638992.566946:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788638992.566976:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772908928:12345-0@lo:13: Request processed in 52us (1371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638992.566982:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788638992.566993:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788638992.566999:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242083800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772907648:12345-0@lo:13: 00002000:00000024:1.0:1788638992.567007:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788638992.567028:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242083800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772907648:12345-0@lo:13: Request processed in 30us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638992.567033:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788638992.567072:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae36914d880 x1875523772907648/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639008 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638992.567088:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36914d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772907648:0@lo:13: 00010000:00080000:1.0:1788638992.567098:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae342e3d180 x1875523772908672/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638992.567105:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342e3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772908672:0@lo:400: 00000100:00100000:0.0:1788638992.567270:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772908032 00000100:00100000:0.0:1788638992.567276:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772908032 00000100:00100000:0.0:1788638992.567308:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788638992.567315:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772908032:12345-0@lo:400: 00000100:00100000:0.0:1788638992.567370:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772908032:12345-0@lo:400: Request processed in 56us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638992.567376:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788638992.567564:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523772907904:12345-0@lo:400: Request processed in 1291us (2039us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638992.567572:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788638992.567585:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772908544 00000100:00100000:2.0:1788638992.567588:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772908544 00000100:00100000:2.0:1788638992.567604:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772908160 00000100:00100000:2.0:1788638992.567607:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772908160 00000100:00100000:2.0:1788638992.568055:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788638992.568064:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875523772908416:12345-0@lo:400: 00000100:00100000:2.0:1788638992.568101:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875523772908416:12345-0@lo:400: Request processed in 39us (2533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638992.568107:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788638992.568131:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788638992.568138:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875523772908544:12345-0@lo:400: 00000100:00100000:2.0:1788638992.568166:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875523772908544:12345-0@lo:400: Request processed in 29us (1603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638992.568172:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788638992.568183:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788638992.568189:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875523772908160:12345-0@lo:400: 00000100:00100000:2.0:1788638992.568214:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875523772908160:12345-0@lo:400: Request processed in 26us (1523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638992.568229:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1788638992.568254:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788638992.568258:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788638992.568260:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788638992.568401:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae375f38700 x1875523772908160/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638992.568413:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875523772908160:0@lo:400: 00000100:00100000:1.0:1788638992.568423:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772908032:0@lo:400: 00010000:00080000:1.0:1788638992.568432:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae342e3d500 x1875523772908544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638992.568439:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342e3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875523772908544:0@lo:400: 00010000:00080000:2.0:1788638992.568537:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae375f38000 x1875523772907904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638992.568547:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523772907904:0@lo:400: 00010000:00080000:2.0:1788638992.568559:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae375f39f80 x1875523772908416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638992.568566:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875523772908416:0@lo:400: 00010000:00080000:2.0:1788638992.568577:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae36d1abb80 x1875523772908928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639008 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638992.568590:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772908928:0@lo:13: 00000100:00100000:2.0:1788638992.568601:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523772907776:0@lo:400: 00000100:00100000:2.0:1788638992.568611:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772908288:0@lo:400: 00010000:00010000:2.0:1788638992.823501:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638993.846210:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788638994.597756:0:9508:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788638994.597760:0:9508:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788638994.597762:0:9508:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788638994.597882:0:9508:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ae375f89000 00000020:01000004:0.0:1788638994.597896:0:9508:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788638994.597909:0:9508:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788638994.597922:0:9508:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9ae36a0e99c0) 00000020:00000080:0.0:1788638994.597938:0:9508:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788638994.642523:0:9508:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1788638994.642579:0:9508:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:1.0:1788638994.657046:0:9508:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788638994.657353:0:9508:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788638994.657367:0:9508:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788638994.657377:0:9508:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x25c454990262bfe4 00000020:01000004:1.0:1788638994.657384:0:9508:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788638994.657404:0:9508:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.118@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788638994.657407:0:9508:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.118@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788638994.657412:0:9508:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788638994.657436:0:9508:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1788638994.657440:0:9508:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.118@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788638994.684809:0:9508:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.118@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788638994.684845:0:9508:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.118@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1788638994.684850:0:9508:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788638994.684851:0:9508:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788638994.684852:0:9508:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788638994.684854:0:9508:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788638994.684855:0:9508:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788638994.684856:0:9508:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788638994.684857:0:9508:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788638994.684858:0:9508:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788638994.684859:0:9508:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788638994.684865:0:9508:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788638994.684866:0:9508:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788638994.684869:0:9508:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1788638994.684871:0:9508:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788638994.684872:0:9508:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788638994.684873:0:9508:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788638994.684874:0:9508:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788638994.684875:0:9508:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788638994.684876:0:9508:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788638994.684877:0:9508:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788638994.684877:0:9508:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788638994.684878:0:9508:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788638994.684879:0:9508:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788638994.684880:0:9508:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788638994.684905:0:9508:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788638994.684921:0:9508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242082a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:9508:1875523772909056:0@lo:253: 00000100:00100000:1.0:1788638994.684986:0:9508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638994.685072:0:9508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24201de40 going to sleep for 11 seconds 00000100:00100000:0.0:1788638994.685123:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772909056 00000100:00100000:0.0:1788638994.685131:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772909056 00000100:00100000:0.0:1788638994.685216:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788638994.685225:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370fff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+21:9508:x1875523772909056:12345-0@lo:253: 20000000:01000000:0.0:1788638994.685253:0:6511:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788638994.685257:0:6511:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788638994.685261:0:6511:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788638994.685264:0:6511:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788638994.685470:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788638994.685673:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:0.0:1788638994.685687:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788638994.685715:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:0.0:1788638994.685724:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788638994.685737:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:0.0:1788638994.685751:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:0.0:1788638994.685831:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:0.0:1788638994.685844:0:6511:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.118@tcp 20000000:01000000:0.0:1788638994.685846:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.118@tcp (null) (null) (null) 00000040:00080000:0.0:1788638994.685858:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:0.0:1788638994.685863:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788638994.685876:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:0.0:1788638994.685881:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.206.118@tcp (null) (null) 00000040:00080000:0.0:1788638994.685894:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:0.0:1788638994.685900:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788638994.685911:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:0.0:1788638994.685923:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:0.0:1788638994.685990:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:0.0:1788638994.686001:0:6511:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.118@tcp 20000000:01000000:0.0:1788638994.686002:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.118@tcp (null) (null) (null) 00000040:00080000:0.0:1788638994.686015:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:0.0:1788638994.686027:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788638994.686040:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:0.0:1788638994.686045:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.206.118@tcp (null) (null) 00000040:00080000:0.0:1788638994.686056:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:0.0:1788638994.686061:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788638994.686074:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:0.0:1788638994.686088:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:0.0:1788638994.686460:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:0.0:1788638994.686472:0:6511:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.118@tcp 20000000:01000000:0.0:1788638994.686474:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.118@tcp (null) (null) (null) 00000040:00080000:0.0:1788638994.686507:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:0.0:1788638994.686514:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788638994.686525:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:0.0:1788638994.686530:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.206.118@tcp (null) (null) 00000040:00080000:0.0:1788638994.686539:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:0.0:1788638994.686544:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788638994.686553:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:0.0:1788638994.686566:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:0.0:1788638994.686578:0:6511:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788638994.686580:0:6511:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788638994.686583:0:6511:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788638994.686662:0:6511:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788638994.686665:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788638994.687468:0:9514:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 25 1->4: lustre sys.timeout 20000000:01000000:0.0:1788638994.687504:0:9514:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 25 2->4: lustre sys.timeout 00000040:00080000:0.0:1788638994.687516:0:9514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1788638994.687828:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1788638994.687850:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:1.0:1788638994.687864:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:1.0:1788638994.687874:0:6511:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788638994.687876:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788638994.689235:0:9515:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 26 1->4: lustre sys.timeout 20000000:01000000:1.0:1788638994.689268:0:9515:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 26 2->4: lustre sys.timeout 00000040:00080000:1.0:1788638994.689282:0:9515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:0.0:1788638994.689505:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:0.0:1788638994.689528:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:0.0:1788638994.689545:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:0.0:1788638994.689555:0:6511:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1788638994.689558:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788638994.690072:0:9516:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:0.0:1788638994.690120:0:9516:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:0.0:1788638994.690141:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:1.0:1788638994.690303:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:1.0:1788638994.690324:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:1.0:1788638994.690338:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:1.0:1788638994.690361:0:6511:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788638994.690363:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788638994.690916:0:9517:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:1.0:1788638994.690937:0:9517:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:1.0:1788638994.690951:0:9517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:0.0:1788638994.691153:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:0.0:1788638994.691173:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:0.0:1788638994.691188:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:0.0:1788638994.691198:0:6511:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788638994.691200:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788638994.691484:0:9518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:0.0:1788638994.692000:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:0.0:1788638994.692022:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:0.0:1788638994.692036:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 10000000:01000000:0.0:1788638994.692061:0:6511:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788638994.692079:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ae375f54200/0x25c454990262bfeb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638994.692098:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae340031c00/0x25c454990262bee1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262beda expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638994.692115:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae340030400/0x25c454990262bf0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262bf04 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638994.692122:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae340030800/0x25c454990262bf4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262bf43 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638994.692129:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae3429e4800/0x25c454990262bf66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262bf5f expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638994.692137:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae3429e5800/0x25c454990262bf90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262bf89 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638994.692144:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae340030c00/0x25c454990262bfac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262bfa5 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638994.692150:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae3750fa800/0x25c454990262bfd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262bfcf expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638994.692157:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ae375f54200/0x25c454990262bfeb lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638994.692194:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae3750fa800/0x25c454990262bfd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262bfcf expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638994.692208:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ae3750fa800/0x25c454990262bfd6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262bfcf expref: 21 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638994.692229:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1a8e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1875523772909184:0@lo:104: 00000100:00100000:0.0:1788638994.692287:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788638994.692378:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae340030c00/0x25c454990262bfac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262bfa5 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638994.692387:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ae340030c00/0x25c454990262bfac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262bfa5 expref: 21 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638994.692397:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1abb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1875523772909312:0@lo:104: 00000100:00100000:0.0:1788638994.692417:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788638994.692492:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae3429e5800/0x25c454990262bf90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262bf89 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638994.692501:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ae3429e5800/0x25c454990262bf90 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262bf89 expref: 21 pid: 6511 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638994.692510:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e4700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1875523772909440:0@lo:104: 00000100:00100000:0.0:1788638994.692530:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638994.692749:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772909184 00000100:00100000:2.0:1788638994.692756:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772909184 00000100:00100000:3.0:1788638994.692835:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772909312 00000100:00100000:3.0:1788638994.692838:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772909312 00000100:00100000:3.0:1788638994.692853:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788638994.692861:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36d1ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+4:6511:x1875523772909184:12345-0@lo:104: 00010000:00010000:3.0:1788638994.692874:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb200/0x25c454990262bfcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262bfd6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.692928:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788638994.692934:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36d1ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+4:6511:x1875523772909184:12345-0@lo:104: Request processed in 74us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638994.692950:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788638994.692966:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788638994.692973:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2416e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+3:6511:x1875523772909312:12345-0@lo:104: 00010000:00010000:3.0:1788638994.692980:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae3750fac00/0x25c454990262bfa5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262bfac expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.693013:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788638994.693019:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2416e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+3:6511:x1875523772909312:12345-0@lo:104: Request processed in 47us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638994.693024:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:3.0:1788638994.693039:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788638994.693045:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb200/0x25c454990262bfcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262bfd6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.693051:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fb200 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:3.0:1788638994.693054:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb200/0x25c454990262bfcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262bfd6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.693062:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb200/0x25c454990262bfcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262bfd6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788638994.693068:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb200/0x25c454990262bfcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262bfd6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788638994.693074:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788638994.693099:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb200/0x25c454990262bfcf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bfd6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.693117:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788638994.693142:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb200/0x25c454990262bfcf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bfd6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.693149:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb200/0x25c454990262bfcf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bfd6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.693160:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788638994.693163:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae3750fac00/0x25c454990262bfa5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262bfac expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.693170:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fac00 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:3.0:1788638994.693173:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae3750fac00/0x25c454990262bfa5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262bfac expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.693179:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae3750fac00/0x25c454990262bfa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262bfac expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788638994.693185:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae3750fac00/0x25c454990262bfa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262bfac expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788638994.693190:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788638994.693204:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae3750fac00/0x25c454990262bfa5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bfac expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.693210:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788638994.693215:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae3750fac00/0x25c454990262bfa5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bfac expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.693221:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae3750fac00/0x25c454990262bfa5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bfac expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.693229:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638994.693236:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638994.693238:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638994.693251:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772909568:0@lo:103: 00000100:00100000:3.0:1788638994.693281:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638994.693310:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788638994.693316:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772909696:0@lo:103: 00000100:00100000:3.0:1788638994.693336:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638994.693366:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772909568 00000100:00100000:3.0:1788638994.693370:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772909568 00010000:00010000:3.0:1788638994.693388:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae3750fa800/0x25c454990262bfd6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262bfcf expref: 22 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638994.693406:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772909696 00000100:00100000:3.0:1788638994.693409:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772909696 00010000:00010000:3.0:1788638994.693419:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae340030c00/0x25c454990262bfac lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262bfa5 expref: 23 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638994.693431:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788638994.693437:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01f1eef9-e690-4065-bf99-bf821af7b626+23:3641:x1875523772909568:12345-0@lo:103: 00010000:00010000:3.0:1788638994.693447:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638994.693452:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae3750fa800/0x25c454990262bfd6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262bfcf expref: 23 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.693462:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae3750fa800/0x25c454990262bfd6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262bfcf expref: 23 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.693477:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788638994.693504:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01f1eef9-e690-4065-bf99-bf821af7b626+23:3641:x1875523772909568:12345-0@lo:103: Request processed in 67us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638994.693511:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788638994.693530:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788638994.693536:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01f1eef9-e690-4065-bf99-bf821af7b626+22:3641:x1875523772909696:12345-0@lo:103: 00010000:00010000:3.0:1788638994.693543:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638994.693548:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae340030c00/0x25c454990262bfac lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262bfa5 expref: 22 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.693556:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae340030c00/0x25c454990262bfac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262bfa5 expref: 22 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.693579:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788638994.693602:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01f1eef9-e690-4065-bf99-bf821af7b626+22:3641:x1875523772909696:12345-0@lo:103: Request processed in 66us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638994.693640:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788638994.693674:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772909696:0@lo:103: 00000100:00100000:3.0:1788638994.693682:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772909568:0@lo:103: 00010000:00010000:2.0:1788638994.693849:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638994.694026:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae3429e4800/0x25c454990262bf66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262bf5f expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638994.694035:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ae3429e4800/0x25c454990262bf66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262bf5f expref: 21 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638994.694043:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1875523772909824:0@lo:104: 00000100:00100000:0.0:1788638994.694068:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788638994.694099:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae340030800/0x25c454990262bf4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262bf43 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638994.694128:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ae340030800/0x25c454990262bf4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262bf43 expref: 21 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638994.694136:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1875523772909952:0@lo:104: 00000100:00100000:0.0:1788638994.694158:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788638994.694178:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae340030400/0x25c454990262bf0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262bf04 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638994.694186:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ae340030400/0x25c454990262bf0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262bf04 expref: 21 pid: 6511 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638994.694194:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1875523772910080:0@lo:104: 00000100:00100000:0.0:1788638994.694215:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788638994.694232:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae340031c00/0x25c454990262bee1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262beda expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638994.694239:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ae340031c00/0x25c454990262bee1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262beda expref: 21 pid: 6511 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638994.694246:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1875523772910208:0@lo:104: 00000100:00100000:0.0:1788638994.694262:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae343da29c0 going to sleep for 11 seconds 00010000:00010000:0.0:1788638994.694274:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae3750fa800/0x25c454990262bfd6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262bfcf expref: 21 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638994.694283:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1a8e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1875523772909184:0@lo:104: 00010000:00010000:0.0:1788638994.694291:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae340030c00/0x25c454990262bfac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262bfa5 expref: 20 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638994.694309:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1abb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1875523772909312:0@lo:104: 00000100:00100000:3.0:1788638994.694367:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788638994.694384:0:6499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638994.694396:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772909440 00000100:00100000:3.0:1788638994.694400:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772909440 00000100:00100000:3.0:1788638994.694419:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772909824 00000100:00100000:3.0:1788638994.694422:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772909824 00000100:00100000:3.0:1788638994.694430:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772909952 00000100:00100000:3.0:1788638994.694432:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772909952 00000100:00100000:3.0:1788638994.694439:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772910080 00000100:00100000:3.0:1788638994.694441:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772910080 00000100:00100000:3.0:1788638994.694447:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772910208 00000100:00100000:3.0:1788638994.694449:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772910208 00000100:00100000:3.0:1788638994.694459:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788638994.694465:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2416e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+7:6511:x1875523772909440:12345-0@lo:104: 00010000:00010000:3.0:1788638994.694483:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae340031000/0x25c454990262bf89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262bf90 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.694576:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788638994.694582:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2416e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+7:6511:x1875523772909440:12345-0@lo:104: Request processed in 118us (2051us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638994.694589:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788638994.694602:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788638994.694638:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2416e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+6:6511:x1875523772909824:12345-0@lo:104: 00010000:00010000:3.0:1788638994.694646:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb000/0x25c454990262bf5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262bf66 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638994.694738:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e4700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1875523772909440:0@lo:104: 00000100:00100000:0.0:1788638994.694746:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1875523772909824:0@lo:104: 00010000:00010000:2.0:1788638994.695001:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788638994.695007:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae340031000/0x25c454990262bf89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262bf90 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638994.695015:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae340031000 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:2.0:1788638994.695025:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae340031000/0x25c454990262bf89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262bf90 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638994.695033:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae340031000/0x25c454990262bf89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262bf90 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788638994.695040:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae340031000/0x25c454990262bf89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262bf90 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638994.695045:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788638994.695125:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae340031000/0x25c454990262bf89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bf90 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638994.695132:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788638994.695156:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae340031000/0x25c454990262bf89 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bf90 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638994.695164:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae340031000/0x25c454990262bf89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bf90 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638994.695174:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638994.695177:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb000/0x25c454990262bf5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262bf66 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638994.695183:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fb000 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:2.0:1788638994.695186:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb000/0x25c454990262bf5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262bf66 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638994.695192:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb000/0x25c454990262bf5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262bf66 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788638994.695207:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb000/0x25c454990262bf5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262bf66 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638994.695212:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1788638994.695247:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523772910336:0@lo:103: 00000100:00100000:1.0:1788638994.695282:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788638994.695346:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1788638994.695353:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2416e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+6:6511:x1875523772909824:12345-0@lo:104: Request processed in 745us (1284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638994.695360:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788638994.695376:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788638994.695382:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+5:6511:x1875523772909952:12345-0@lo:104: 00010000:00010000:3.0:1788638994.695391:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae340031200/0x25c454990262bf43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262bf4a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.695428:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788638994.695433:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+5:6511:x1875523772909952:12345-0@lo:104: Request processed in 52us (1275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638994.695439:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788638994.695450:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788638994.695455:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24167dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+4:6511:x1875523772910080:12345-0@lo:104: 00010000:00010000:3.0:1788638994.695469:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa400/0x25c454990262bf04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262bf0b expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.695496:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788638994.695501:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24167dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+4:6511:x1875523772910080:12345-0@lo:104: Request processed in 46us (1286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638994.695507:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788638994.695541:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788638994.695547:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+3:6511:x1875523772910208:12345-0@lo:104: 00010000:00010000:3.0:1788638994.695554:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5000/0x25c454990262beda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262bee1 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.695591:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788638994.695596:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+3:6511:x1875523772910208:12345-0@lo:104: Request processed in 50us (1211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638994.695601:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1788638994.695751:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788638994.695756:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae340031200/0x25c454990262bf43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262bf4a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638994.695762:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae340031200 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:1.0:1788638994.695765:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae340031200/0x25c454990262bf43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262bf4a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638994.695771:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae340031200/0x25c454990262bf43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262bf4a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788638994.695777:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae340031200/0x25c454990262bf43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262bf4a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638994.695782:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788638994.695842:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1788638994.695862:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772910336 00000100:00100000:3.0:1788638994.695868:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772910336 00010000:00010000:3.0:1788638994.695886:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae3429e5800/0x25c454990262bf90 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262bf89 expref: 20 pid: 6511 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638994.695906:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788638994.695913:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242080a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01f1eef9-e690-4065-bf99-bf821af7b626+20:3643:x1875523772910336:12345-0@lo:103: 00010000:00010000:3.0:1788638994.695922:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638994.695926:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae3429e5800/0x25c454990262bf90 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262bf89 expref: 20 pid: 6511 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.695947:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae3429e5800/0x25c454990262bf90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262bf89 expref: 20 pid: 6511 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.695962:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae3429e5800/0x25c454990262bf90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262bf89 expref: 20 pid: 6511 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.695975:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788638994.696003:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242080a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01f1eef9-e690-4065-bf99-bf821af7b626+19:3643:x1875523772910336:12345-0@lo:103: Request processed in 91us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638994.696009:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788638994.696040:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523772910336:0@lo:103: 00010000:00010000:3.0:1788638994.696230:0:9519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788638994.696238:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa400/0x25c454990262bf04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262bf0b expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.696243:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fa400 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:3.0:1788638994.696246:0:8446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa400/0x25c454990262bf04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262bf0b expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.696253:0:8446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa400/0x25c454990262bf04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262bf0b expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788638994.696259:0:8446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa400/0x25c454990262bf04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262bf0b expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788638994.696264:0:8446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1788638994.696348:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1875523772909952:0@lo:104: 00000100:00100000:0.0:1788638994.696357:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1875523772910080:0@lo:104: 00000100:00100000:0.0:1788638994.696363:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1875523772910208:0@lo:104: 00010000:00010000:0.0:1788638994.696409:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ae375f54200/0x25c454990262bfeb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638994.696509:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb000/0x25c454990262bf5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bf66 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638994.696516:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788638994.696527:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb000/0x25c454990262bf5f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bf66 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638994.696534:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb000/0x25c454990262bf5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bf66 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638994.696543:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638994.696544:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638994.696546:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638994.696824:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae340031200/0x25c454990262bf43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bf4a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638994.696831:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788638994.696846:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae340031200/0x25c454990262bf43 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bf4a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638994.696852:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae340031200/0x25c454990262bf43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bf4a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638994.696862:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638994.696863:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638994.696865:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638994.696876:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772910592:0@lo:103: 00000100:00100000:1.0:1788638994.696924:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788638994.697054:0:8446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa400/0x25c454990262bf04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bf0b expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.697069:0:8446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788638994.697078:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa400/0x25c454990262bf04 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bf0b expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.697084:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa400/0x25c454990262bf04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bf0b expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.697093:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638994.697095:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638994.697096:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638994.697113:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788638994.697122:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523772910464:0@lo:103: 00000100:00100000:3.0:1788638994.697148:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638994.697173:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772910592 00000100:00100000:3.0:1788638994.697179:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772910592 00010000:00010000:3.0:1788638994.697197:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae340030800/0x25c454990262bf4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262bf43 expref: 19 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638994.697215:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772910464 00000100:00100000:3.0:1788638994.697218:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772910464 00010000:00010000:3.0:1788638994.697229:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae3429e4800/0x25c454990262bf66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262bf5f expref: 20 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638994.697242:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788638994.697248:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ffbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01f1eef9-e690-4065-bf99-bf821af7b626+20:3641:x1875523772910592:12345-0@lo:103: 00010000:00010000:3.0:1788638994.697259:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638994.697263:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae340030800/0x25c454990262bf4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262bf43 expref: 20 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.697283:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae340030800/0x25c454990262bf4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262bf43 expref: 20 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.697296:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae340030800/0x25c454990262bf4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262bf43 expref: 20 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.697308:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788638994.697333:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ffbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01f1eef9-e690-4065-bf99-bf821af7b626+19:3641:x1875523772910592:12345-0@lo:103: Request processed in 85us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638994.697339:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788638994.697374:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788638994.697380:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01f1eef9-e690-4065-bf99-bf821af7b626+18:3643:x1875523772910464:12345-0@lo:103: 00010000:00010000:3.0:1788638994.697387:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638994.697391:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae3429e4800/0x25c454990262bf66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262bf5f expref: 18 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.697399:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae3429e4800/0x25c454990262bf66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262bf5f expref: 18 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.697409:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae3429e4800/0x25c454990262bf66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262bf5f expref: 18 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.697417:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788638994.697442:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01f1eef9-e690-4065-bf99-bf821af7b626+17:3643:x1875523772910464:12345-0@lo:103: Request processed in 63us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638994.697448:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788638994.697475:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523772910464:0@lo:103: 00000100:00100000:1.0:1788638994.697767:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01f1eef9-e690-4065-bf99-bf821af7b626:3642:1875523772910720:0@lo:103: 00000100:00100000:1.0:1788638994.697794:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638994.697851:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772910592:0@lo:103: 00000100:00100000:0.0:1788638994.697955:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772910720 00000100:00100000:0.0:1788638994.697960:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772910720 00010000:00010000:0.0:1788638994.697975:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae340030400/0x25c454990262bf0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262bf04 expref: 17 pid: 6511 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638994.698003:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788638994.698010:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242080a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01f1eef9-e690-4065-bf99-bf821af7b626+17:3642:x1875523772910720:12345-0@lo:103: 00010000:00010000:0.0:1788638994.698018:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638994.698022:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae340030400/0x25c454990262bf0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262bf04 expref: 17 pid: 6511 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638994.698031:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae340030400/0x25c454990262bf0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262bf04 expref: 17 pid: 6511 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638994.698042:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae340030400/0x25c454990262bf0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262bf04 expref: 17 pid: 6511 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638994.698063:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788638994.698099:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242080a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01f1eef9-e690-4065-bf99-bf821af7b626+16:3642:x1875523772910720:12345-0@lo:103: Request processed in 90us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638994.698117:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788638994.698219:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01f1eef9-e690-4065-bf99-bf821af7b626:3642:1875523772910720:0@lo:103: 00010000:00010000:0.0:1788638994.698511:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638994.698545:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638994.698547:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638994.698819:0:9519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5000/0x25c454990262beda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262bee1 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.698835:0:9519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3429e5000 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:3.0:1788638994.698839:0:9519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5000/0x25c454990262beda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262bee1 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.698847:0:9519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5000/0x25c454990262beda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262bee1 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788638994.698854:0:9519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5000/0x25c454990262beda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262bee1 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788638994.698859:0:9519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788638994.698930:0:9519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5000/0x25c454990262beda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bee1 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.698937:0:9519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788638994.698977:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1788638994.699022:0:9519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5000/0x25c454990262beda lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bee1 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.699029:0:9519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5000/0x25c454990262beda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bee1 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.699043:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638994.699044:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638994.699046:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638994.699077:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01f1eef9-e690-4065-bf99-bf821af7b626:3644:1875523772910848:0@lo:103: 00000100:00100000:2.0:1788638994.699123:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638994.699212:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772910848 00000100:00100000:1.0:1788638994.699217:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772910848 00010000:00010000:1.0:1788638994.699236:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae340031c00/0x25c454990262bee1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262beda expref: 16 pid: 6511 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638994.699310:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788638994.699317:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01f1eef9-e690-4065-bf99-bf821af7b626+16:3644:x1875523772910848:12345-0@lo:103: 00010000:00010000:1.0:1788638994.699327:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638994.699332:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae340031c00/0x25c454990262bee1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262beda expref: 16 pid: 6511 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638994.699341:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae340031c00/0x25c454990262bee1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262beda expref: 16 pid: 6511 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638994.699352:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae340031c00/0x25c454990262bee1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262beda expref: 16 pid: 6511 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638994.699366:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ae375f54200/0x25c454990262bfeb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638994.699375:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae375f54200/0x25c454990262bfeb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638994.699391:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae375f54200/0x25c454990262bfeb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638994.699405:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae375f54200/0x25c454990262bfeb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638994.699411:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ae375f54200/0x25c454990262bfeb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638994.699417:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ae375f54200/0x25c454990262bfeb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638994.699422:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375f54200 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:1.0:1788638994.699427:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ae375f54200/0x25c454990262bfeb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638994.699433:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ae375f54200/0x25c454990262bfeb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638994.699453:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ae375f54200/0x25c454990262bfeb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638994.699463:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638994.699500:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01f1eef9-e690-4065-bf99-bf821af7b626+15:3644:x1875523772910848:12345-0@lo:103: Request processed in 184us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638994.699507:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1788638994.699553:0:6511:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ae375f54200/0x25c454990262bfeb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638994.699562:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ae375f54200/0x25c454990262bfeb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638994.699577:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae375f54200/0x25c454990262bfeb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788638994.699591:0:6511:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788638994.700169:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01f1eef9-e690-4065-bf99-bf821af7b626:3644:1875523772910848:0@lo:103: 00000100:00100000:3.0:1788638994.703901:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370fff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+14:9508:x1875523772909056:12345-0@lo:253: Request processed in 18668us (18906us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638994.703914:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788638994.704068:0:9508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242082a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:9508:1875523772909056:0@lo:253: 10000000:01000000:0.0:1788638994.704084:0:9508:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788638994.704087:0:9508:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788638994.704089:0:9508:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788638994.704090:0:9508:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788638994.704091:0:9508:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1788638994.704093:0:9508:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788638994.704094:0:9508:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788638994.704095:0:9508:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788638994.704097:0:9508:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788638994.704098:0:9508:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788638994.704100:0:9508:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788638994.704135:0:9508:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ae375f89000 from lustre-OST0001 10000000:01000000:0.0:1788638994.704167:0:9508:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788638994.704177:0:9508:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788638994.704186:0:9508:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ae342e50000 local copy 10000000:01000000:0.0:1788638994.704190:0:9508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788638994.704224:0:9508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae375f55800/0x25c454990262bff2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638994.704234:0:9508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.118@tcp lock: ffff9ae375f55800/0x25c454990262bff2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638994.704242:0:9508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae375f55800/0x25c454990262bff2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638994.704258:0:9508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:9508:1875523772910976:0@lo:101: 00000100:00100000:0.0:1788638994.704291:0:9508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638994.704327:0:9508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae343da2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788638994.704345:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772910976 00000100:00100000:0.0:1788638994.704350:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772910976 00000100:00100000:0.0:1788638994.704393:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788638994.704401:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+14:9508:x1875523772910976:12345-0@lo:101: 00010000:00010000:0.0:1788638994.704413:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638994.704425:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae375f54600/0x25c454990262bff9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262bff2 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638994.704447:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae375f54600/0x25c454990262bff9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262bff2 expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638994.704457:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae375f54600/0x25c454990262bff9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262bff2 expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638994.704466:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375f54600, rc 0) 00000100:00100000:0.0:1788638994.704496:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+15:9508:x1875523772910976:12345-0@lo:101: Request processed in 96us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638994.704507:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788638994.704541:0:9508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:9508:1875523772910976:0@lo:101: 00010000:00010000:0.0:1788638994.704553:0:9508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae375f55800/0x25c454990262bff2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x25c454990262bff9 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638994.704572:0:9508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae375f55800/0x25c454990262bff2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x25c454990262bff9 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638994.704680:0:9508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:9508:1875523772911104:0@lo:501: 00000100:00100000:0.0:1788638994.704708:0:9508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638994.704721:0:9508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3471c86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788638994.704774:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772911104 00000100:00100000:3.0:1788638994.704780:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772911104 00000100:00100000:3.0:1788638994.704816:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788638994.704822:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+15:9508:x1875523772911104:12345-0@lo:501: 00000100:00100000:3.0:1788638994.704880:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+15:9508:x1875523772911104:12345-0@lo:501: Request processed in 58us (170us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788638994.704885:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788638994.705005:0:9508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:9508:1875523772911104:0@lo:501: 10000000:01000000:0.0:1788638994.705017:0:9508:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.118@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788638994.705034:0:9508:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.118@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788638994.705039:0:9508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae375f55800/0x25c454990262bff2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x25c454990262bff9 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638994.705046:0:9508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae375f55800/0x25c454990262bff2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x25c454990262bff9 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638994.705052:0:9508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9ae375f55800/0x25c454990262bff2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x25c454990262bff9 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638994.705113:0:9508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788638994.705134:0:9508:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ae375f89000 10000000:01000000:0.0:1788638994.705139:0:9508:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788638994.705144:0:9508:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788638994.705151:0:9508:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788638994.705156:0:9508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788638994.705158:0:9508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788638994.705173:0:9508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae375f55400/0x25c454990262c000 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638994.705180:0:9508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae375f55400/0x25c454990262c000 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638994.705188:0:9508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae375f55400/0x25c454990262c000 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638994.705199:0:9508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:9508:1875523772911232:0@lo:101: 00000100:00100000:0.0:1788638994.705225:0:9508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638994.705241:0:9508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae343da2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788638994.706930:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772911232 00000100:00100000:2.0:1788638994.706942:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772911232 00000100:00100000:2.0:1788638994.707024:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788638994.707034:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae369901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+15:9508:x1875523772911232:12345-0@lo:101: 00010000:00010000:2.0:1788638994.707048:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638994.707062:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae38217b000/0x25c454990262c007 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262c000 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638994.707113:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae38217b000/0x25c454990262c007 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262c000 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638994.707124:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae38217b000/0x25c454990262c007 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c000 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638994.707133:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae38217b000, rc 0) 00000100:00100000:2.0:1788638994.707200:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae369901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+16:9508:x1875523772911232:12345-0@lo:101: Request processed in 168us (1974us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638994.707206:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00010000:00010000:3.0:1788638994.707253:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788638994.707260:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae375f55800/0x25c454990262bff2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x25c454990262bff9 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.707267:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375f55800 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:3.0:1788638994.707271:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae375f55800/0x25c454990262bff2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x25c454990262bff9 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.707279:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae375f55800/0x25c454990262bff2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x25c454990262bff9 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788638994.707285:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae375f55800/0x25c454990262bff2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x25c454990262bff9 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788638994.707290:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788638994.707316:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae375f55800/0x25c454990262bff2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x25c454990262bff9 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.707322:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788638994.707339:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae375f55800/0x25c454990262bff2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x25c454990262bff9 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.707345:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae375f55800/0x25c454990262bff2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x25c454990262bff9 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.707377:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638994.707379:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638994.707381:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638994.707395:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01f1eef9-e690-4065-bf99-bf821af7b626:3644:1875523772911360:0@lo:103: 00000100:00100000:3.0:1788638994.707427:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638994.707591:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772911360 00000100:00100000:1.0:1788638994.707596:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772911360 00000100:00100000:1.0:1788638994.707662:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788638994.707669:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+16:3644:x1875523772911360:12345-0@lo:103: 00010000:00010000:1.0:1788638994.707678:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638994.707688:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae375f54600/0x25c454990262bff9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c454990262bff2 expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638994.707704:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638994.707735:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+15:3644:x1875523772911360:12345-0@lo:103: Request processed in 67us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638994.707741:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788638994.707786:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01f1eef9-e690-4065-bf99-bf821af7b626:3644:1875523772911360:0@lo:103: 00000100:00100000:1.0:1788638994.707815:0:9508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:9508:1875523772911232:0@lo:101: 00010000:00010000:1.0:1788638994.707829:0:9508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae375f55400/0x25c454990262c000 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c007 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638994.707838:0:9508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae375f55400/0x25c454990262c000 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262c007 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638994.707941:0:9508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242081880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:9508:1875523772911488:0@lo:501: 00000100:00100000:1.0:1788638994.707968:0:9508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638994.708237:0:9508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24201da80 going to sleep for 11 seconds 00000100:00100000:0.0:1788638994.708265:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772911488 00000100:00100000:0.0:1788638994.708270:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772911488 00000100:00100000:0.0:1788638994.708292:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788638994.708298:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae369903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+15:9508:x1875523772911488:12345-0@lo:501: 00000100:00100000:0.0:1788638994.708434:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae369903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+15:9508:x1875523772911488:12345-0@lo:501: Request processed in 135us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638994.708440:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788638994.708509:0:9508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242081880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:9508:1875523772911488:0@lo:501: 00000100:00100000:1.0:1788638994.708544:0:9508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242081880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:9508:1875523772911616:0@lo:503: 00000100:00100000:3.0:1788638994.708955:0:9508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638994.708981:0:9508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24201da80 going to sleep for 11 seconds 00000100:00100000:0.0:1788638994.709023:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772911616 00000100:00100000:0.0:1788638994.709028:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772911616 00000100:00100000:0.0:1788638994.709057:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788638994.709064:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae369902c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+15:9508:x1875523772911616:12345-0@lo:503: 00000100:00100000:0.0:1788638994.709172:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae369902c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+15:9508:x1875523772911616:12345-0@lo:503: Request processed in 108us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638994.709179:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788638994.709595:0:9508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242081880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:9508:1875523772911616:0@lo:503: 00000040:00080000:3.0:1788638994.710023:0:9508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788638994.710501:0:9508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f34a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:9508:1875523772911744:0@lo:502: 00000100:00100000:3.0:1788638994.710554:0:9508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638994.710594:0:9508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24202f840 going to sleep for 11 seconds 00000100:00100000:0.0:1788638994.710797:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772911744 00000100:00100000:0.0:1788638994.710804:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772911744 00000100:00100000:0.0:1788638994.710846:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788638994.710854:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae369902850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+15:9508:x1875523772911744:12345-0@lo:502: 00000100:00100000:0.0:1788638994.710949:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae369902850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+15:9508:x1875523772911744:12345-0@lo:502: Request processed in 96us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638994.710956:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788638994.711248:0:9508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f34a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:9508:1875523772911744:0@lo:502: 00000040:00080000:3.0:1788638994.712447:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788638994.712500:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788638994.712516:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788638994.712535:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788638994.712550:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788638994.712564:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788638994.712601:0:9508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f34a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:9508:1875523772911872:0@lo:502: 00000100:00100000:3.0:1788638994.712792:0:9508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638994.712832:0:9508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24202f840 going to sleep for 11 seconds 00000100:00100000:0.0:1788638994.712857:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772911872 00000100:00100000:0.0:1788638994.712864:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772911872 00000100:00100000:0.0:1788638994.712906:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788638994.712918:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae369903c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+15:9508:x1875523772911872:12345-0@lo:502: 00000100:00100000:0.0:1788638994.713028:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae369903c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+15:9508:x1875523772911872:12345-0@lo:502: Request processed in 110us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638994.713035:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788638994.713048:0:9508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f34a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:9508:1875523772911872:0@lo:502: 00000040:00080000:1.0:1788638994.713094:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788638994.713116:0:9508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:0.0:1788638994.713758:0:9521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788638994.713766:0:9521:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1788638994.713772:0:9521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788638994.713775:0:9521:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788638994.713780:0:9521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788638994.713795:0:9521:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9ae36a0eb380) 00000020:00000080:0.0:1788638994.713817:0:9521:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788638994.713823:0:9521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788638994.713880:0:9521:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ae375f89000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788638994.713888:0:9521:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788638994.713895:0:9521:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x25c454990262c015 00010000:00010000:0.0:1788638994.719359:0:9521:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:0.0:1788638994.719921:0:9521:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1788638994.723090:0:9521:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788638994.723892:0:9521:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1788638994.728406:0:9521:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1788638994.728789:0:9521:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1788638994.735101:0:9521:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1788638994.736801:0:9521:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788638994.736811:0:9521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788638994.736817:0:9521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788638994.736819:0:9521:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788638994.736823:0:9521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788638994.736826:0:9521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788638994.736828:0:9521:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788638994.736831:0:9521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788638994.736833:0:9521:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788638994.736855:0:9521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788638994.736858:0:9521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788638994.736859:0:9521:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788638994.736862:0:9521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788638994.737048:0:9508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1788638994.737122:0:9508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788638994.737176:0:9508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae375f55400/0x25c454990262c000 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c007 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638994.737199:0:9508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae375f55400/0x25c454990262c000 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c007 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638994.737206:0:9508:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae375f89000 from 1 10000000:01000000:1.0:1788638994.737208:0:9508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788638994.737244:0:9508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa200/0x25c454990262c01c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638994.737251:0:9508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa200/0x25c454990262c01c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638994.737260:0:9508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa200/0x25c454990262c01c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638994.737281:0:9508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242081880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:9508:1875523772912000:0@lo:101: 00000100:00100000:1.0:1788638994.737342:0:9508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638994.737389:0:9508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24201d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788638994.737464:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772912000 00000100:00100000:2.0:1788638994.737471:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772912000 00000100:00100000:2.0:1788638994.737518:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788638994.737526:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae369900050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+15:9508:x1875523772912000:12345-0@lo:101: 00010000:00010000:2.0:1788638994.737536:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638994.737547:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae38217aa00/0x25c454990262c023 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262c01c expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638994.737579:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae38217aa00/0x25c454990262c023 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262c01c expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638994.737589:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae38217aa00/0x25c454990262c023 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c01c expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638994.737598:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae38217aa00, rc 0) 00000100:00100000:2.0:1788638994.737830:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae369900050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+16:9508:x1875523772912000:12345-0@lo:101: Request processed in 304us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638994.737837:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788638994.737931:0:9508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242081880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:9508:1875523772912000:0@lo:101: 00010000:00010000:1.0:1788638994.737945:0:9508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa200/0x25c454990262c01c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c023 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638994.737954:0:9508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa200/0x25c454990262c01c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262c023 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638994.738042:0:9508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242081880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:9508:1875523772912128:0@lo:501: 00000100:00100000:1.0:1788638994.738068:0:9508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638994.738089:0:9508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24201d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788638994.738155:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772912128 00000100:00100000:2.0:1788638994.738160:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772912128 00000100:00100000:2.0:1788638994.738219:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788638994.738227:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae369900850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+16:9508:x1875523772912128:12345-0@lo:501: 00000100:00100000:2.0:1788638994.738318:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae369900850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+16:9508:x1875523772912128:12345-0@lo:501: Request processed in 92us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638994.738324:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788638994.738753:0:9508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242081880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:9508:1875523772912128:0@lo:501: 00000100:00100000:0.0:1788638994.738791:0:9508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:9508:1875523772912256:0@lo:503: 00000100:00100000:0.0:1788638994.738830:0:9508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638994.738955:0:9508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24216e480 going to sleep for 11 seconds 00000100:00100000:1.0:1788638994.738982:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772912256 00000100:00100000:1.0:1788638994.738986:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772912256 00000100:00100000:1.0:1788638994.739008:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788638994.739015:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+16:9508:x1875523772912256:12345-0@lo:503: 00000100:00100000:1.0:1788638994.739148:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+16:9508:x1875523772912256:12345-0@lo:503: Request processed in 132us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638994.739154:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788638994.739243:0:9508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:9508:1875523772912256:0@lo:503: 00000040:00080000:0.0:1788638994.739835:0:9508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788638994.739895:0:9508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:9508:1875523772912384:0@lo:502: 00000100:00100000:0.0:1788638994.739933:0:9508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638994.739997:0:9508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24216e480 going to sleep for 11 seconds 00000100:00100000:1.0:1788638994.740026:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772912384 00000100:00100000:1.0:1788638994.740031:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772912384 00000100:00100000:1.0:1788638994.740098:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788638994.740122:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+16:9508:x1875523772912384:12345-0@lo:502: 00000100:00100000:1.0:1788638994.740211:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+16:9508:x1875523772912384:12345-0@lo:502: Request processed in 105us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638994.740218:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788638994.740281:0:9508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:9508:1875523772912384:0@lo:502: 00000040:00080000:0.0:1788638994.740483:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788638994.740508:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788638994.740528:0:9508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:9508:1875523772912512:0@lo:502: 00000100:00100000:0.0:1788638994.740577:0:9508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638994.740908:0:9508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24216e480 going to sleep for 11 seconds 00000100:00100000:2.0:1788638994.740991:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772912512 00000100:00100000:2.0:1788638994.740997:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772912512 00000100:00100000:2.0:1788638994.741021:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788638994.741028:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+16:9508:x1875523772912512:12345-0@lo:502: 00000100:00100000:2.0:1788638994.741120:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+16:9508:x1875523772912512:12345-0@lo:502: Request processed in 91us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638994.741126:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788638994.741207:0:9508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:9508:1875523772912512:0@lo:502: 00000040:00080000:0.0:1788638994.741248:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788638994.741256:0:9508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788638994.742066:0:9525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788638994.742077:0:9525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788638994.742079:0:9525:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788638994.742086:0:9525:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ae375f89000 00000020:00000080:2.0:1788638994.742089:0:9525:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788638994.742100:0:9525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788638994.742115:0:9525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788638994.742116:0:9525:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788638994.742119:0:9525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788638994.742254:0:9508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788638994.742291:0:9508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788638994.742341:0:9508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa200/0x25c454990262c01c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c023 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638994.742351:0:9508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa200/0x25c454990262c01c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c023 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638994.742401:0:9508:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788638994.742404:0:9508:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ae375f89000 10000000:01000000:1.0:1788638994.742407:0:9508:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ae375f89000 10000000:01000000:1.0:1788638994.742412:0:9508:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788638994.742549:0:9508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ae375f89000 from 1 10000000:01000000:1.0:1788638994.742553:0:9508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788638994.742798:0:9508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa400/0x25c454990262c02a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638994.742816:0:9508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa400/0x25c454990262c02a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638994.742827:0:9508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa400/0x25c454990262c02a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638994.742846:0:9508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242082a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:9508:1875523772912640:0@lo:101: 00000100:00100000:1.0:1788638994.742897:0:9508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638994.742929:0:9508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24201d840 going to sleep for 11 seconds 00000100:00100000:2.0:1788638994.742975:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772912640 00000100:00100000:2.0:1788638994.742982:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772912640 00000100:00100000:2.0:1788638994.743014:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788638994.743022:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+16:9508:x1875523772912640:12345-0@lo:101: 00010000:00010000:2.0:1788638994.743032:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638994.743043:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae38217a800/0x25c454990262c031 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262c02a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638994.743072:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae38217a800/0x25c454990262c031 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262c02a expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638994.743082:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae38217a800/0x25c454990262c031 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c02a expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638994.743091:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae38217a800, rc 0) 00000100:00100000:2.0:1788638994.743144:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+17:9508:x1875523772912640:12345-0@lo:101: Request processed in 122us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638994.743149:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788638994.743220:0:9508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242082a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:9508:1875523772912640:0@lo:101: 00010000:00010000:1.0:1788638994.743233:0:9508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa400/0x25c454990262c02a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c031 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638994.743242:0:9508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa400/0x25c454990262c02a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262c031 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638994.743321:0:9508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242082a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:9508:1875523772912768:0@lo:501: 00000100:00100000:1.0:1788638994.743346:0:9508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638994.743370:0:9508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24201d840 going to sleep for 11 seconds 00000100:00100000:2.0:1788638994.743409:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772912768 00000100:00100000:2.0:1788638994.743413:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772912768 00000100:00100000:2.0:1788638994.743446:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788638994.743794:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+17:9508:x1875523772912768:12345-0@lo:501: 00000100:00100000:2.0:1788638994.743886:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+17:9508:x1875523772912768:12345-0@lo:501: Request processed in 95us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638994.744064:0:9508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242082a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:9508:1875523772912768:0@lo:501: 00000100:00100000:1.0:1788638994.744093:0:9508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242082a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:9508:1875523772912896:0@lo:503: 00000100:00100000:1.0:1788638994.744146:0:9508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638994.744169:0:9508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24201d840 going to sleep for 11 seconds 00000100:00100000:2.0:1788638994.744217:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788638994.744241:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772912896 00000100:00100000:2.0:1788638994.744246:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772912896 00000100:00100000:2.0:1788638994.744310:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788638994.744318:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+17:9508:x1875523772912896:12345-0@lo:503: 00000100:00100000:2.0:1788638994.744394:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+17:9508:x1875523772912896:12345-0@lo:503: Request processed in 77us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638994.744401:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788638994.744765:0:9508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242082a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:9508:1875523772912896:0@lo:503: 00000040:00080000:0.0:1788638994.744964:0:9508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788638994.745026:0:9508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:9508:1875523772913024:0@lo:502: 00000100:00100000:0.0:1788638994.745066:0:9508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638994.745247:0:9508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24216e480 going to sleep for 11 seconds 00000100:00100000:1.0:1788638994.745278:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772913024 00000100:00100000:1.0:1788638994.745284:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772913024 00000100:00100000:1.0:1788638994.745308:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788638994.745321:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+17:9508:x1875523772913024:12345-0@lo:502: 00000100:00100000:1.0:1788638994.745717:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+17:9508:x1875523772913024:12345-0@lo:502: Request processed in 395us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638994.745724:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788638994.745991:0:9508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:9508:1875523772913024:0@lo:502: 00000040:00080000:0.0:1788638994.746186:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788638994.746215:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788638994.746228:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788638994.746241:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788638994.746252:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788638994.746263:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788638994.746274:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788638994.746287:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788638994.746313:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788638994.746325:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788638994.746338:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788638994.746351:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788638994.746364:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788638994.746376:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788638994.746389:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788638994.746400:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788638994.746411:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788638994.746799:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788638994.746826:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788638994.746840:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788638994.746852:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788638994.746865:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788638994.746878:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788638994.746891:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788638994.746916:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1788638994.746930:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1788638994.746944:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1788638994.746958:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1788638994.746971:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1788638994.746983:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1788638994.746994:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1788638994.747007:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1788638994.747019:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1788638994.747032:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1788638994.747046:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1788638994.747058:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1788638994.747074:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:0.0:1788638994.747087:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1788638994.747100:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:0.0:1788638994.747367:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:0.0:1788638994.747395:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:0.0:1788638994.747411:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:0.0:1788638994.747790:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:0.0:1788638994.747811:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:0.0:1788638994.747824:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:0.0:1788638994.747837:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:0.0:1788638994.747878:0:9508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:9508:1875523772913152:0@lo:502: 00000100:00100000:0.0:1788638994.747942:0:9508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638994.748031:0:9508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24216e480 going to sleep for 11 seconds 00000100:00100000:1.0:1788638994.748074:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772913152 00000100:00100000:1.0:1788638994.748081:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772913152 00000100:00100000:1.0:1788638994.748166:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788638994.748175:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+17:9508:x1875523772913152:12345-0@lo:502: 00000100:00100000:1.0:1788638994.748303:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+17:9508:x1875523772913152:12345-0@lo:502: Request processed in 129us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638994.748310:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788638994.748389:0:9508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:9508:1875523772913152:0@lo:502: 00000040:00080000:0.0:1788638994.748563:0:9508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:0.0:1788638994.748580:0:9508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:2.0:1788638994.749197:0:9526:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788638994.749212:0:9526:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9ae241ee3380) 00000020:00000080:2.0:1788638994.749243:0:9526:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:2.0:1788638994.749320:0:9526:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ae375f89000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788638994.749323:0:9526:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ae375f89000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788638994.749326:0:9526:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ae375f89000 3 00010000:00080000:2.0:1788638994.749352:0:9526:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ae242df6000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.118@tcp at head 00010000:00010000:2.0:1788638994.753329:0:9526:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:2.0:1788638994.753857:0:9526:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788638994.753900:0:9526:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788638994.753912:0:9526:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x25c454990262c03f 00000100:00080000:2.0:1788638994.753921:0:9526:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788638994.753927:0:9526:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ae242df6000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788638994.753958:0:9526:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae375f68700 x1875523772913280/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788638994.754025:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875523772913280:0@lo:38: 00000100:00100000:1.0:1788638994.754090:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788638994.754158:0:9526:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788638994.754433:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772913536:0@lo:400: 00000100:00100000:1.0:1788638994.754549:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638994.754586:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875523772914048:0@lo:400: 00000100:00100000:1.0:1788638994.754635:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638994.754688:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875523772913408:0@lo:400: 00000100:00100000:1.0:1788638994.755000:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875523772913664:0@lo:400: 00000100:00100000:1.0:1788638994.755027:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638994.755044:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772913280 00000100:00100000:0.0:1788638994.755051:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772913280 00000100:00100000:2.0:1788638994.755094:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772914048 00000100:00100000:2.0:1788638994.755097:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772914048 00000100:00100000:2.0:1788638994.755147:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788638994.755154:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875523772914048:12345-0@lo:400: 00000100:00100000:2.0:1788638994.755202:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875523772914048:12345-0@lo:400: Request processed in 48us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638994.755210:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788638994.755226:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788638994.755230:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875523772913280:12345-0@lo:38: 00010000:00080000:2.0:1788638994.755248:0:6518:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 253 last 0 00000020:00000080:2.0:1788638994.755277:0:6518:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x25c454990262c046 00000004:00100000:2.0:1788638994.755291:0:6518:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788638994.755319:0:6518:0:(import.c:65:import_set_state_nolock()) ffff9ae242df4800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788638994.755361:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875523772913280:12345-0@lo:38: Request processed in 130us (1271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638994.755368:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788638994.755385:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788638994.755743:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772914176:0@lo:400: 00000100:00100000:1.0:1788638994.755773:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638994.755797:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788638994.755803:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772913792:0@lo:400: 00000100:00100000:1.0:1788638994.755826:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638994.755841:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36914d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772914304:0@lo:400: 00000100:00100000:1.0:1788638994.755869:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638994.755895:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772913536 00000100:00100000:1.0:1788638994.755899:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772913536 00000100:00100000:1.0:1788638994.755916:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772913792 00000100:00100000:1.0:1788638994.755918:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772913792 00000100:00100000:1.0:1788638994.755928:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788638994.755933:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772913536:12345-0@lo:400: 00000100:00100000:1.0:1788638994.755961:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772913536:12345-0@lo:400: Request processed in 28us (1412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638994.755967:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788638994.755978:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788638994.755983:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772913792:12345-0@lo:400: 00000100:00100000:1.0:1788638994.756010:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772913792:12345-0@lo:400: Request processed in 26us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638994.756015:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788638994.756032:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772914176 00000100:00100000:1.0:1788638994.756036:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772914176 00000100:00100000:1.0:1788638994.756063:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772914304 00000100:00100000:1.0:1788638994.756065:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772914304 00000100:00100000:1.0:1788638994.756083:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788638994.756089:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242efa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772914176:12345-0@lo:400: 00000100:00100000:1.0:1788638994.756129:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242efa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772914176:12345-0@lo:400: Request processed in 41us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638994.756135:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788638994.756147:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788638994.756152:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242efb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772914304:12345-0@lo:400: 00000100:00100000:1.0:1788638994.756177:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242efb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772914304:12345-0@lo:400: Request processed in 25us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638994.756187:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788638994.756216:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788638994.756228:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638994.756245:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875523772913920:0@lo:400: 00000100:00100000:1.0:1788638994.756267:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788638994.756312:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae375f68700 x1875523772913280/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788639004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638994.756323:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788638994.756332:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1788638994.756340:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788638994.756344:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788638994.756347:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae242df6000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788638994.756353:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875523772913280:0@lo:38: 00000100:00100000:1.0:1788638994.756382:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772913536:0@lo:400: 00010000:00080000:1.0:1788638994.756393:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae375f39880 x1875523772914048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638994.756401:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875523772914048:0@lo:400: 00000100:00100000:1.0:1788638994.756436:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772913792:0@lo:400: 00010000:00080000:1.0:1788638994.756446:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae36914d880 x1875523772914304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638994.756534:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36914d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772914304:0@lo:400: 00010000:00080000:1.0:1788638994.756547:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae375f38700 x1875523772914176/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638994.756714:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772914176:0@lo:400: 00000100:00100000:0.0:1788638994.756797:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772913664 00000100:00100000:0.0:1788638994.756801:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772913664 00000100:00100000:0.0:1788638994.756820:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772913408 00000100:00100000:0.0:1788638994.756823:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772913408 00000100:00100000:0.0:1788638994.756832:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772913920 00000100:00100000:0.0:1788638994.756834:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772913920 00000100:00100000:0.0:1788638994.756862:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788638994.756868:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242efb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875523772913664:12345-0@lo:400: 00000100:00100000:0.0:1788638994.756919:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242efb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875523772913664:12345-0@lo:400: Request processed in 51us (1891us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638994.756925:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788638994.756937:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788638994.756943:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875523772913408:12345-0@lo:400: 00000100:00100000:0.0:1788638994.756973:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875523772913408:12345-0@lo:400: Request processed in 30us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638994.756978:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788638994.756989:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788638994.756994:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875523772913920:12345-0@lo:400: 00000100:00100000:0.0:1788638994.757020:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875523772913920:12345-0@lo:400: Request processed in 26us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638994.757025:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1788638994.757184:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788638994.757205:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae242081880 x1875523772913408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638994.757214:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875523772913408:0@lo:400: 00010000:00080000:1.0:1788638994.757224:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae375f38000 x1875523772913920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638994.757231:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875523772913920:0@lo:400: 00010000:00080000:1.0:1788638994.757257:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae375f38380 x1875523772913664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638994.757266:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875523772913664:0@lo:400: 00000020:01000004:0.0:1788638994.757907:0:9526:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788638994.757934:0:9526:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9ae242f40000) 00000020:00000080:0.0:1788638994.757956:0:9526:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:0.0:1788638994.758036:0:9526:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ae375f89000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788638994.758040:0:9526:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ae375f89000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788638994.758042:0:9526:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ae375f89000 3 00010000:00080000:0.0:1788638994.758069:0:9526:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ae242398000@lustre-MDT0001-lwp-OST0001: add connection 192.168.206.118@tcp at head 00000100:00100000:2.0:1788638994.760424:0:9527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f68a80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9527:1875523772914432:0@lo:901: 00000100:00100000:2.0:1788638994.762664:0:9527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638994.762727:0:9527:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3750e2840 going to sleep for 11 seconds 00000100:00100000:3.0:1788638994.762750:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772914432 00000100:00100000:3.0:1788638994.762770:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772914432 00000100:00080000:2.0:1788638994.762832:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788638994.762955:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788638994.762966:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9527:x1875523772914432:12345-0@lo:901: 00000100:00100000:3.0:1788638994.763162:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9527:x1875523772914432:12345-0@lo:901: Request processed in 198us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638994.763169:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788638994.763594:0:9527:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae375f68a80 x1875523772914432/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788639010 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638994.763698:0:9527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f68a80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9527:1875523772914432:0@lo:901: 00010000:00010000:0.0:1788638994.764463:0:9526:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:0.0:1788638994.764842:0:9526:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1788638994.765863:0:9526:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788638994.765877:0:9526:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x25c454990262c054 00000100:00080000:0.0:1788638994.765886:0:9526:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788638994.765892:0:9526:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9ae242398000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:0.0:1788638994.765924:0:9526:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae24233f480 x1875523772914560/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788638994.765948:0:9526:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788638994.766376:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875523772914560:0@lo:38: 00000100:00100000:1.0:1788638994.766453:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638994.767238:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772914560 00000100:00100000:0.0:1788638994.767248:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772914560 00000100:00100000:0.0:1788638994.767290:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788638994.767298:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875523772914560:12345-0@lo:38: 00010000:00080000:0.0:1788638994.767323:0:6516:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 253 last 0 00000020:00000080:0.0:1788638994.767368:0:6516:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x25c454990262c05b 00000004:00100000:0.0:1788638994.767383:0:6516:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788638994.767417:0:6516:0:(import.c:65:import_set_state_nolock()) ffff9ae24239a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788638994.767495:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875523772914560:12345-0@lo:38: Request processed in 195us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638994.767503:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:0.0:1788638994.767785:0:9526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:0.0:1788638994.767838:0:9508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:0.0:1788638994.767886:0:9508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788638994.767901:0:9508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa400/0x25c454990262c02a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c031 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638994.767923:0:9508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa400/0x25c454990262c02a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c031 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788638994.767981:0:9508:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788638994.767983:0:9508:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788638994.767984:0:9508:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788638994.767985:0:9508:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788638994.767986:0:9508:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788638994.767988:0:9508:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788638994.767989:0:9508:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788638994.767990:0:9508:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788638994.767992:0:9508:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788638994.767993:0:9508:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788638994.767995:0:9508:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788638994.767998:0:9508:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1788638994.768000:0:9508:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788638994.768002:0:9508:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788638994.768003:0:9508:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788638994.768004:0:9508:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788638994.768005:0:9508:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788638994.768006:0:9508:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788638994.768007:0:9508:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788638994.768008:0:9508:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788638994.768009:0:9508:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788638994.768010:0:9508:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788638994.768011:0:9508:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788638994.768028:0:9508:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788638994.768041:0:9508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:9508:1875523772914688:0@lo:253: 00010000:00080000:1.0:1788638994.768086:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae24233f480 x1875523772914560/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788639004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638994.768098:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788638994.768115:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1788638994.768123:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788638994.768127:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788638994.768130:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae242398000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788638994.768137:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875523772914560:0@lo:38: 00000100:00100000:0.0:1788638994.768353:0:9508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638994.768434:0:9508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24216e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788638994.772220:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772914688 00000100:00100000:2.0:1788638994.772235:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772914688 00000100:00100000:2.0:1788638994.772293:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788638994.772303:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+17:9508:x1875523772914688:12345-0@lo:253: 20000000:01000000:2.0:1788638994.772347:0:6511:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788638994.772362:0:6511:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788638994.778750:0:6511:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788638994.778769:0:6511:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788638994.778823:0:6532:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788638994.778828:0:6532:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788638994.778848:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ae38217b600/0x25c454990262c062 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638994.778866:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae340031600/0x25c454990262bf58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262bf51 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638994.778873:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae3750fb400/0x25c454990262bf9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262bf97 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638994.778881:0:6532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ae38217b600/0x25c454990262c062 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638994.778926:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae3750fb400/0x25c454990262bf9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262bf97 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638994.778940:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ae3750fb400/0x25c454990262bf9e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262bf97 expref: 17 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638994.778954:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f68a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6532:1875523772914816:0@lo:104: 00000100:00100000:2.0:1788638994.779015:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788638994.779064:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae340031600/0x25c454990262bf58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262bf51 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638994.779072:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ae340031600/0x25c454990262bf58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262bf51 expref: 17 pid: 6511 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638994.779079:0:6532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f6b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6532:1875523772914944:0@lo:104: 00000100:00100000:2.0:1788638994.779133:0:6532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638994.779155:0:6532:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3750e2840 going to sleep for 11 seconds 00000100:00100000:1.0:1788638994.779213:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772914816 00000100:00100000:1.0:1788638994.779225:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772914816 00000100:00100000:1.0:1788638994.779259:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772914944 00000100:00100000:1.0:1788638994.779262:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772914944 00000100:00100000:1.0:1788638994.779277:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788638994.779284:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:01f1eef9-e690-4065-bf99-bf821af7b626+4:6532:x1875523772914816:12345-0@lo:104: 00010000:00010000:1.0:1788638994.779297:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262bf97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262bf9e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638994.779361:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788638994.779368:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:01f1eef9-e690-4065-bf99-bf821af7b626+4:6532:x1875523772914816:12345-0@lo:104: Request processed in 84us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638994.779375:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788638994.779392:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788638994.779399:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:01f1eef9-e690-4065-bf99-bf821af7b626+3:6532:x1875523772914944:12345-0@lo:104: 00010000:00010000:1.0:1788638994.779406:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae340030e00/0x25c454990262bf51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262bf58 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638994.779819:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788638994.779826:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:01f1eef9-e690-4065-bf99-bf821af7b626+3:6532:x1875523772914944:12345-0@lo:104: Request processed in 428us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638994.779833:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1788638994.780022:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788638994.780029:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262bf97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262bf9e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.780036:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fb800 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:3.0:1788638994.780041:0:8446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262bf97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262bf9e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.780049:0:8446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262bf97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262bf9e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788638994.780055:0:8446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262bf97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262bf9e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788638994.780060:0:8446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788638994.780089:0:8446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262bf97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bf9e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.780096:0:8446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788638994.780123:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262bf97 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bf9e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.780131:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262bf97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bf9e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.780144:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788638994.780148:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae340030e00/0x25c454990262bf51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262bf58 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.780161:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae340030e00 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:3.0:1788638994.780163:0:8446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae340030e00/0x25c454990262bf51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262bf58 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.780169:0:8446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae340030e00/0x25c454990262bf51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262bf58 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788638994.780176:0:8446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae340030e00/0x25c454990262bf51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262bf58 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788638994.780181:0:8446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788638994.780193:0:8446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae340030e00/0x25c454990262bf51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bf58 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.780198:0:8446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788638994.780204:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae340030e00/0x25c454990262bf51 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bf58 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.780210:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae340030e00/0x25c454990262bf51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bf58 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.780222:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638994.780224:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638994.780226:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638994.780238:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772915072:0@lo:103: 00000100:00100000:3.0:1788638994.780270:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638994.780300:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788638994.780306:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772915200:0@lo:103: 00000100:00100000:3.0:1788638994.780336:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638994.780364:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772915072 00000100:00100000:3.0:1788638994.780370:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772915072 00010000:00010000:3.0:1788638994.780390:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae3750fb400/0x25c454990262bf9e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262bf97 expref: 18 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638994.780408:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772915200 00000100:00100000:3.0:1788638994.780411:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772915200 00010000:00010000:3.0:1788638994.780435:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae340031600/0x25c454990262bf58 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262bf51 expref: 19 pid: 6511 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638994.780574:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788638994.780584:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f37100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01f1eef9-e690-4065-bf99-bf821af7b626+19:3641:x1875523772915072:12345-0@lo:103: 00010000:00010000:3.0:1788638994.780596:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638994.780601:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae3750fb400/0x25c454990262bf9e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262bf97 expref: 19 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.780612:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae3750fb400/0x25c454990262bf9e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262bf97 expref: 19 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.780645:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788638994.780675:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f37100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01f1eef9-e690-4065-bf99-bf821af7b626+19:3641:x1875523772915072:12345-0@lo:103: Request processed in 93us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638994.780681:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788638994.780695:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788638994.780701:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01f1eef9-e690-4065-bf99-bf821af7b626+18:3641:x1875523772915200:12345-0@lo:103: 00010000:00010000:3.0:1788638994.780708:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638994.780712:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae340031600/0x25c454990262bf58 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262bf51 expref: 18 pid: 6511 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.780731:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae340031600/0x25c454990262bf58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262bf51 expref: 18 pid: 6511 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.780743:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ae38217b600/0x25c454990262c062 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.780750:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae38217b600/0x25c454990262c062 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788638994.780763:0:6501:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007054721s 00010000:00010000:3.0:1788638994.780767:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae38217b600/0x25c454990262c062 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.780774:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae38217b600/0x25c454990262c062 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.780780:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ae38217b600/0x25c454990262c062 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.780786:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ae38217b600/0x25c454990262c062 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.780790:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae38217b600 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:3.0:1788638994.780794:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ae38217b600/0x25c454990262c062 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.780800:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ae38217b600/0x25c454990262c062 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.780807:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ae38217b600/0x25c454990262c062 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638994.780825:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788638994.780848:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01f1eef9-e690-4065-bf99-bf821af7b626+18:3641:x1875523772915200:12345-0@lo:103: Request processed in 148us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638994.780854:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788638994.780889:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772915200:0@lo:103: 00000100:00100000:3.0:1788638994.780898:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772915072:0@lo:103: 00010000:00010000:1.0:1788638994.781114:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638994.782711:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae3750fb400/0x25c454990262bf9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262bf97 expref: 17 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638994.782730:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f68a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6532:1875523772914816:0@lo:104: 00010000:00010000:2.0:1788638994.782743:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae340031600/0x25c454990262bf58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262bf51 expref: 16 pid: 6511 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638994.782752:0:6532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f6b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6532:1875523772914944:0@lo:104: 00010000:00010000:2.0:1788638994.782773:0:6532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ae38217b600/0x25c454990262c062 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638994.782799:0:6532:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ae38217b600/0x25c454990262c062 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638994.782805:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ae38217b600/0x25c454990262c062 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638994.782811:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae38217b600/0x25c454990262c062 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638994.782932:0:9508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01f1eef9-e690-4065-bf99-bf821af7b626:9508:1875523772914688:0@lo:253: 10000000:01000000:1.0:1788638994.782943:0:9508:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788638994.782947:0:9508:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788638994.782948:0:9508:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788638994.782949:0:9508:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788638994.782951:0:9508:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788638994.782952:0:9508:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788638994.782958:0:9508:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788638994.782960:0:9508:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788638994.782961:0:9508:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788638994.782963:0:9508:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788638994.782964:0:9508:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788638994.782965:0:9508:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788638994.782982:0:9508:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788638994.784097:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+15:9508:x1875523772914688:12345-0@lo:253: Request processed in 11791us (15740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638994.784120:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00080000:10000000:1.0:1788638994.790154:0:9508:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1788638994.790320:0:9508:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1788638994.791207:0:9508:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1788638994.791601:0:9508:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1788638994.792040:0:9508:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1788638994.792240:0:9508:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1788638994.796022:0:9508:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788638994.805598:0:9508:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788638994.805608:0:9508:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788638994.805749:0:9508:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788638994.805790:0:9508:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.118@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788638994.805805:0:9508:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1788638994.805822:0:9508:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1788638994.808300:0:9508:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788638994.808607:0:9508:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1788638994.869094:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638995.638467:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242ef8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772915328:0@lo:41: 00000100:00100000:2.0:1788638995.638548:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638995.638740:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772915328 00000100:00100000:1.0:1788638995.638749:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772915328 00000100:00100000:1.0:1788638995.638800:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788638995.638809:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772915328:12345-0@lo:41: 00000004:00000024:1.0:1788638995.638846:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:1.0:1788638995.638905:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772915328:12345-0@lo:41: Request processed in 96us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638995.638913:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788638995.638954:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242ef8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772915328:0@lo:41: 00000020:00000004:2.0:1788638995.657039:0:9582:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788638995.657278:0:9582:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788638995.896566:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638996.148798:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788638996.148822:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772915456:0@lo:41: 00000100:00100000:0.0:1788638996.148898:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638996.148968:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772915456 00000100:00100000:1.0:1788638996.148976:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772915456 00000100:00100000:1.0:1788638996.149148:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788638996.149159:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772915456:12345-0@lo:41: 00000004:00000024:1.0:1788638996.149202:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788638996.149251:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772915456:12345-0@lo:41: Request processed in 94us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638996.149258:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788638996.149325:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772915456:0@lo:41: 00010000:00010000:1.0:1788638996.916814:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638997.685201:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788638997.685285:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772915584:0@lo:13: 00000100:00100000:0.0:1788638997.685358:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638997.685642:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772915584 00000100:00100000:0.0:1788638997.685651:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772915584 00000100:00100000:0.0:1788638997.685708:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788638997.685721:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772915584:12345-0@lo:13: 00002000:00000024:0.0:1788638997.685748:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788638997.685798:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772915584:12345-0@lo:13: Request processed in 80us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638997.685819:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788638997.689028:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788638997.689338:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae24233c000 x1875523772915584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639013 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638997.689363:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772915584:0@lo:13: 00000100:00100000:0.0:1788638997.692245:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788638997.692267:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772915712:0@lo:13: 00000100:00100000:0.0:1788638997.692328:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638997.692404:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772915712 00000100:00100000:0.0:1788638997.692410:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772915712 00000100:00100000:0.0:1788638997.692454:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788638997.692462:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772915712:12345-0@lo:13: 00002000:00000024:0.0:1788638997.692479:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788638997.693138:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772915712:12345-0@lo:13: Request processed in 673us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638997.693147:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1788638997.693171:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788638997.693199:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae24233c000 x1875523772915712/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639013 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638997.693216:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772915712:0@lo:13: 00010000:00010000:3.0:1788638997.944652:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638998.964859:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638999.989946:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788639000.244792:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788639000.244801:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ae375ea2800 from 39 10000000:01000000:0.0:1788639000.244806:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788639000.244847:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae375f55600/0x25c454990262c069 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639000.244857:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae375f55600/0x25c454990262c069 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639000.244868:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae375f55600/0x25c454990262c069 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639000.244891:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772915840:0@lo:101: 00000100:00100000:0.0:1788639000.244953:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639000.245002:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d2d40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788639000.245022:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772915840 00000100:00100000:0.0:1788639000.245027:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772915840 00000100:00100000:0.0:1788639000.245136:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788639000.245145:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+15:6513:x1875523772915840:12345-0@lo:101: 00010000:00010000:0.0:1788639000.245157:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639000.245168:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae375f55a00/0x25c454990262c070 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262c069 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639000.245203:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae375f55a00/0x25c454990262c070 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262c069 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639000.245214:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae375f55a00/0x25c454990262c070 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c069 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639000.245222:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375f55a00, rc 0) 00000100:00100000:0.0:1788639000.245400:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+16:6513:x1875523772915840:12345-0@lo:101: Request processed in 255us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639000.245406:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788639000.246047:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875523772916224:0@lo:400: 00000100:00100000:0.0:1788639000.246114:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639000.246142:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772916736:0@lo:400: 00000100:00100000:0.0:1788639000.246168:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639000.246188:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788639000.246194:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772916352:0@lo:400: 00000100:00100000:0.0:1788639000.246217:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639000.246235:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772916864:0@lo:400: 00000100:00100000:0.0:1788639000.246329:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639000.247352:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523772915968:0@lo:400: 00000100:00100000:1.0:1788639000.247406:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639000.247435:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875523772916480:0@lo:400: 00000100:00100000:1.0:1788639000.247454:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639000.247471:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875523772916992:0@lo:400: 00000100:00100000:1.0:1788639000.247488:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639000.247504:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788639000.247509:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772916096:0@lo:400: 00000100:00100000:1.0:1788639000.247566:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639000.247584:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875523772916608:0@lo:400: 00000100:00100000:1.0:1788639000.247601:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639000.247610:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875523772917120:0@lo:400: 00000100:00100000:1.0:1788639000.247717:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639000.247748:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772916736 00000100:00100000:1.0:1788639000.247755:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772916736 00000100:00100000:1.0:1788639000.247797:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772916864 00000100:00100000:1.0:1788639000.247799:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772916864 00000100:00100000:1.0:1788639000.247816:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788639000.247823:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772916736:12345-0@lo:400: 00000100:00100000:3.0:1788639000.249777:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772915840:0@lo:101: 00010000:00010000:3.0:1788639000.249803:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae375f55600/0x25c454990262c069 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c070 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639000.249815:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae375f55600/0x25c454990262c069 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262c070 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639000.249902:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f37b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772917248:0@lo:501: 00000100:00100000:3.0:1788639000.249946:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639000.249979:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae34945e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788639000.249998:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772916224 00000100:00100000:3.0:1788639000.250003:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772916224 00000100:00100000:3.0:1788639000.250029:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772915968 00000100:00100000:3.0:1788639000.250031:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772915968 00000100:00100000:3.0:1788639000.250040:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772916480 00000100:00100000:3.0:1788639000.250042:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772916480 00000100:00100000:3.0:1788639000.250053:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772916992 00000100:00100000:3.0:1788639000.250055:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772916992 00000100:00100000:3.0:1788639000.250065:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772916608 00000100:00100000:3.0:1788639000.250082:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772916608 00000100:00100000:3.0:1788639000.250099:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772917120 00000100:00100000:3.0:1788639000.250101:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772917120 00000100:00100000:3.0:1788639000.250113:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788639000.250119:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875523772916224:12345-0@lo:400: 00000100:00100000:3.0:1788639000.250161:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875523772916224:12345-0@lo:400: Request processed in 41us (4046us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639000.250167:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788639000.250182:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788639000.250187:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ef8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523772915968:12345-0@lo:400: 00000100:00100000:3.0:1788639000.250217:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ef8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523772915968:12345-0@lo:400: Request processed in 30us (2810us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639000.250222:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788639000.250231:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788639000.250299:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875523772916480:12345-0@lo:400: 00000100:00100000:3.0:1788639000.250325:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875523772916480:12345-0@lo:400: Request processed in 89us (2871us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639000.250331:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788639000.250341:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788639000.250346:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242efad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875523772916992:12345-0@lo:400: 00000100:00100000:3.0:1788639000.250365:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242efad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875523772916992:12345-0@lo:400: Request processed in 20us (2876us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639000.250370:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788639000.250378:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788639000.250383:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242efb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875523772916608:12345-0@lo:400: 00000100:00100000:3.0:1788639000.250403:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242efb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875523772916608:12345-0@lo:400: Request processed in 20us (2801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639000.250413:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788639000.250423:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788639000.250428:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ef9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875523772917120:12345-0@lo:400: 00000100:00100000:3.0:1788639000.250451:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ef9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875523772917120:12345-0@lo:400: Request processed in 23us (2734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639000.250456:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788639000.250470:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772916352 00000100:00100000:3.0:1788639000.250473:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772916352 00000100:00100000:3.0:1788639000.250486:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772916096 00000100:00100000:3.0:1788639000.250488:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772916096 00000100:00100000:3.0:1788639000.250498:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788639000.250503:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772916352:12345-0@lo:400: 00000100:00100000:3.0:1788639000.250528:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772916352:12345-0@lo:400: Request processed in 25us (4311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639000.250533:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788639000.250541:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788639000.250546:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242efbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772916096:12345-0@lo:400: 00000100:00100000:3.0:1788639000.250564:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242efbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772916096:12345-0@lo:400: Request processed in 19us (2998us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639000.250569:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788639000.250581:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772917248 00000100:00100000:3.0:1788639000.250584:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772917248 00000100:00100000:3.0:1788639000.250602:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788639000.250607:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+16:6513:x1875523772917248:12345-0@lo:501: 00000100:00100000:3.0:1788639000.251456:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+16:6513:x1875523772917248:12345-0@lo:501: Request processed in 843us (1505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639000.251472:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788639000.251524:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772916352:0@lo:400: 00010000:00080000:3.0:1788639000.251539:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae24233f100 x1875523772916224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639000.251550:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875523772916224:0@lo:400: 00000100:00100000:3.0:1788639000.251596:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f37b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772917248:0@lo:501: 00000100:00100000:3.0:1788639000.251714:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f37b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772917376:0@lo:503: 00000100:00100000:3.0:1788639000.251758:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639000.251781:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae34945e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788639000.251793:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772917376 00000100:00100000:3.0:1788639000.251797:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772917376 00000100:00100000:3.0:1788639000.251821:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788639000.251827:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+16:6513:x1875523772917376:12345-0@lo:503: 00000100:00100000:3.0:1788639000.251902:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+16:6513:x1875523772917376:12345-0@lo:503: Request processed in 75us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639000.251908:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788639000.251945:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f37b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772917376:0@lo:503: 00000100:00100000:3.0:1788639000.252146:0:9827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f37b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:9827:1875523772917504:0@lo:502: 00000100:00100000:3.0:1788639000.252176:0:9827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639000.252197:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772917504 00000100:00100000:3.0:1788639000.252200:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772917504 00000100:00100000:3.0:1788639000.252222:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788639000.252227:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+16:9827:x1875523772917504:12345-0@lo:502: 00000100:00100000:1.0:1788639000.252740:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788639000.252753:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772916864:12345-0@lo:400: 00000100:00100000:1.0:1788639000.252801:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772916864:12345-0@lo:400: Request processed in 54us (6471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639000.252807:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788639000.252838:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788639000.252843:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788639000.252846:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788639000.252881:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae24233df80 x1875523772916864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639000.252894:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772916864:0@lo:400: 00000100:00100000:1.0:1788639000.252935:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772916096:0@lo:400: 00010000:00080000:1.0:1788639000.252947:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae24233e300 x1875523772916608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639000.252956:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875523772916608:0@lo:400: 00010000:00080000:1.0:1788639000.252967:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae24233f800 x1875523772917120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639000.252975:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875523772917120:0@lo:400: 00010000:00080000:1.0:1788639000.252985:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae24233ed80 x1875523772915968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639000.252992:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523772915968:0@lo:400: 00010000:00080000:1.0:1788639000.253002:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae24233ea00 x1875523772916480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639000.253008:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875523772916480:0@lo:400: 00010000:00080000:1.0:1788639000.253018:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae24233d500 x1875523772916992/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639000.253025:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875523772916992:0@lo:400: 00000100:00100000:1.0:1788639000.253095:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772916736:12345-0@lo:400: Request processed in 5272us (6926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639000.253102:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788639000.253129:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae24233ce00 x1875523772916736/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639000.253145:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772916736:0@lo:400: 00000100:00100000:3.0:1788639000.254474:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+16:9827:x1875523772917504:12345-0@lo:502: Request processed in 2241us (2291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639000.254493:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788639000.254552:0:9827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243066900 going to sleep for 11 seconds 00000100:00100000:3.0:1788639000.254570:0:9827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f37b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:9827:1875523772917504:0@lo:502: 00000100:00100000:3.0:1788639000.255423:0:9827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f37b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:9827:1875523772917632:0@lo:502: 00000100:00100000:3.0:1788639000.255475:0:9827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639000.255511:0:9827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243066900 going to sleep for 11 seconds 00000100:00100000:1.0:1788639000.256454:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772917632 00000100:00100000:1.0:1788639000.256462:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772917632 00000100:00100000:1.0:1788639000.256508:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788639000.256516:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+16:9827:x1875523772917632:12345-0@lo:502: 00000100:00100000:1.0:1788639000.257427:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+16:9827:x1875523772917632:12345-0@lo:502: Request processed in 906us (1946us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639000.257438:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788639000.257533:0:9827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f37b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:9827:1875523772917632:0@lo:502: 00000040:00080000:2.0:1788639000.257567:0:9827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1788639000.261339:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1788639000.261377:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788639000.261389:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae375f55600/0x25c454990262c069 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c070 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639000.261401:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae375f55600/0x25c454990262c069 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c070 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639000.261410:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788639000.261413:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1788639000.261415:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788639000.261451:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4800/0x25c454990262c077 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639000.261459:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4800/0x25c454990262c077 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639000.261469:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4800/0x25c454990262c077 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639000.261491:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f36a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772917760:0@lo:101: 00000100:00100000:3.0:1788639000.261552:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639000.261765:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243066cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788639000.263940:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772917760 00000100:00100000:2.0:1788639000.263955:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772917760 00000100:00100000:2.0:1788639000.264041:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788639000.264051:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+16:6513:x1875523772917760:12345-0@lo:101: 00010000:00010000:2.0:1788639000.264066:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639000.264101:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae38217be00/0x25c454990262c07e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262c077 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639000.264128:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae38217be00/0x25c454990262c07e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262c077 expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639000.264140:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae38217be00/0x25c454990262c07e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c077 expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639000.264149:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae38217be00, rc 0) 00000100:00100000:2.0:1788639000.264223:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+17:6513:x1875523772917760:12345-0@lo:101: Request processed in 174us (2671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639000.264230:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788639000.265920:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f36a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772917760:0@lo:101: 00010000:00010000:0.0:1788639000.265946:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4800/0x25c454990262c077 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c07e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639000.265964:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4800/0x25c454990262c077 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262c07e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639000.266043:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772917888:0@lo:501: 00000100:00100000:0.0:1788639000.266101:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639000.267734:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d2d4600 going to sleep for 11 seconds 00000100:00100000:1.0:1788639000.270222:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772917888 00000100:00100000:1.0:1788639000.270243:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772917888 00000100:00100000:1.0:1788639000.270289:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788639000.270299:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+17:6513:x1875523772917888:12345-0@lo:501: 00000100:00100000:1.0:1788639000.270474:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+17:6513:x1875523772917888:12345-0@lo:501: Request processed in 177us (4372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639000.270482:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788639000.270529:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772917888:0@lo:501: 00000100:00100000:1.0:1788639000.270593:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242efaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772918016:0@lo:503: 00000100:00100000:1.0:1788639000.270745:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639000.270770:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae242351c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788639000.270781:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772918016 00000100:00100000:1.0:1788639000.270784:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772918016 00000100:00100000:1.0:1788639000.270798:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788639000.270803:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b678850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+17:6513:x1875523772918016:12345-0@lo:503: 00000100:00100000:1.0:1788639000.270870:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b678850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+17:6513:x1875523772918016:12345-0@lo:503: Request processed in 66us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639000.270886:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788639000.270922:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242efaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772918016:0@lo:503: 00000100:00100000:1.0:1788639000.271102:0:9831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242efaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:9831:1875523772918144:0@lo:502: 00000100:00100000:1.0:1788639000.271133:0:9831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639000.271151:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772918144 00000100:00100000:1.0:1788639000.271155:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772918144 00000100:00100000:1.0:1788639000.271171:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788639000.271177:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b678450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+17:9831:x1875523772918144:12345-0@lo:502: 00000100:00100000:1.0:1788639000.271542:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b678450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+17:9831:x1875523772918144:12345-0@lo:502: Request processed in 364us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639000.271549:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788639000.271582:0:9831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae242351e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788639000.271593:0:9831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242efaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:9831:1875523772918144:0@lo:502: 00000020:01000000:1.0:1788639000.271701:0:9831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788639000.271710:0:9831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788639000.271712:0:9831:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788639000.271717:0:9831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788639000.271719:0:9831:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788639000.271735:0:9831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242efaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:9831:1875523772918272:0@lo:502: 00000100:00100000:1.0:1788639000.271767:0:9831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639000.271788:0:9831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae242351e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788639000.271838:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772918272 00000100:00100000:2.0:1788639000.271844:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772918272 00000100:00100000:2.0:1788639000.271867:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788639000.271874:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b679850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+17:9831:x1875523772918272:12345-0@lo:502: 00000100:00100000:2.0:1788639000.271952:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b679850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+17:9831:x1875523772918272:12345-0@lo:502: Request processed in 78us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639000.271959:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788639000.272336:0:9831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242efaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:9831:1875523772918272:0@lo:502: 00000020:01000000:1.0:1788639000.272356:0:9831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788639000.272360:0:9831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788639000.272362:0:9831:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788639000.272365:0:9831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1788639000.272426:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1788639000.272444:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788639000.272453:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4800/0x25c454990262c077 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c07e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639000.272463:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4800/0x25c454990262c077 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c07e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788639000.272471:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788639000.272473:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ae3506e9000 from 39 10000000:01000000:1.0:1788639000.272476:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788639000.272500:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3750fba00/0x25c454990262c085 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639000.272507:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae3750fba00/0x25c454990262c085 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639000.272515:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae3750fba00/0x25c454990262c085 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639000.272526:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242efaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772918400:0@lo:101: 00000100:00100000:1.0:1788639000.272555:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639000.272578:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae242351e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788639000.272737:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772918400 00000100:00100000:2.0:1788639000.272742:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772918400 00000100:00100000:2.0:1788639000.272763:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788639000.272769:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+17:6513:x1875523772918400:12345-0@lo:101: 00010000:00010000:2.0:1788639000.272778:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639000.272789:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae38217b800/0x25c454990262c08c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262c085 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639000.272811:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae38217b800/0x25c454990262c08c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262c085 expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639000.272829:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae38217b800/0x25c454990262c08c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c085 expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639000.272838:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae38217b800, rc 0) 00000100:00100000:2.0:1788639000.272870:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+18:6513:x1875523772918400:12345-0@lo:101: Request processed in 101us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639000.272875:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788639000.272905:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242efaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772918400:0@lo:101: 00010000:00010000:2.0:1788639000.272917:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae3750fba00/0x25c454990262c085 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c08c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639000.272926:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae3750fba00/0x25c454990262c085 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262c08c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639000.272970:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f68a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772918528:0@lo:501: 00000100:00100000:2.0:1788639000.272994:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639000.273006:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3471f0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788639000.273018:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772918528 00000100:00100000:2.0:1788639000.273022:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772918528 00000100:00100000:2.0:1788639000.273038:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788639000.273043:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+18:6513:x1875523772918528:12345-0@lo:501: 00000100:00100000:2.0:1788639000.273147:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+18:6513:x1875523772918528:12345-0@lo:501: Request processed in 103us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639000.273154:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788639000.273180:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f68a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772918528:0@lo:501: 00000100:00100000:2.0:1788639000.273203:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f68a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772918656:0@lo:503: 00000100:00100000:2.0:1788639000.273528:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639000.273588:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3471f0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788639000.276591:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772918656 00000100:00100000:0.0:1788639000.276605:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772918656 00000100:00100000:0.0:1788639000.277769:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788639000.277782:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b678c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+18:6513:x1875523772918656:12345-0@lo:503: 00000100:00100000:0.0:1788639000.277956:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b678c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+18:6513:x1875523772918656:12345-0@lo:503: Request processed in 177us (4427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639000.277965:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788639000.279396:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f68a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772918656:0@lo:503: 00000100:00100000:1.0:1788639000.282707:0:9832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242efa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:9832:1875523772918784:0@lo:502: 00000100:00100000:1.0:1788639000.282786:0:9832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639000.282823:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772918784 00000100:00100000:1.0:1788639000.282829:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772918784 00000100:00100000:1.0:1788639000.282874:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788639000.282883:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b679c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+18:9832:x1875523772918784:12345-0@lo:502: 00000100:00100000:1.0:1788639000.282984:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b679c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+18:9832:x1875523772918784:12345-0@lo:502: Request processed in 102us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639000.282998:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788639000.283039:0:9832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae242351f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788639000.283057:0:9832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242efa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:9832:1875523772918784:0@lo:502: 00000100:00100000:1.0:1788639000.283113:0:9832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242efa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:9832:1875523772918912:0@lo:502: 00000100:00100000:1.0:1788639000.283144:0:9832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639000.283156:0:9832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae242351f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788639000.283332:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772918912 00000100:00100000:3.0:1788639000.283336:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772918912 00000100:00100000:3.0:1788639000.283366:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788639000.283373:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+18:9832:x1875523772918912:12345-0@lo:502: 00000100:00100000:3.0:1788639000.283440:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+18:9832:x1875523772918912:12345-0@lo:502: Request processed in 68us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639000.283447:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788639000.283524:0:9832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242efa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:9832:1875523772918912:0@lo:502: 00000040:00080000:1.0:1788639000.283543:0:9832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1788639000.283880:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1788639000.283901:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788639000.283909:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3750fba00/0x25c454990262c085 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c08c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639000.283919:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae3750fba00/0x25c454990262c085 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c08c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639000.283928:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788639000.283931:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ae3506e9000 from 6 10000000:01000000:3.0:1788639000.283934:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788639000.283960:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5000/0x25c454990262c093 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639000.283968:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5000/0x25c454990262c093 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639000.283977:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5000/0x25c454990262c093 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639000.283990:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f36300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772919040:0@lo:101: 00000100:00100000:3.0:1788639000.284028:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639000.284058:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243066780 going to sleep for 11 seconds 00000100:00100000:0.0:1788639000.284106:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772919040 00000100:00100000:0.0:1788639000.284110:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772919040 00000100:00100000:0.0:1788639000.284137:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788639000.284143:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+18:6513:x1875523772919040:12345-0@lo:101: 00010000:00010000:0.0:1788639000.284151:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639000.284162:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae375f54000/0x25c454990262c09a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262c093 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639000.284182:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae375f54000/0x25c454990262c09a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262c093 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639000.284191:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae375f54000/0x25c454990262c09a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c093 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639000.284211:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375f54000, rc 0) 00000100:00100000:0.0:1788639000.284313:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+19:6513:x1875523772919040:12345-0@lo:101: Request processed in 170us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639000.284319:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788639000.284378:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f36300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772919040:0@lo:101: 00010000:00010000:3.0:1788639000.284388:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5000/0x25c454990262c093 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c09a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639000.284397:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5000/0x25c454990262c093 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262c09a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639000.284433:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f36300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772919168:0@lo:256: 00000100:00100000:3.0:1788639000.284459:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639000.284477:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243066780 going to sleep for 11 seconds 00000100:00100000:0.0:1788639000.284750:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772919168 00000100:00100000:0.0:1788639000.284754:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772919168 00000100:00100000:0.0:1788639000.284777:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788639000.284782:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b679450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+19:6513:x1875523772919168:12345-0@lo:256: 20000000:01000000:0.0:1788639000.284794:0:6508:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788639000.284809:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788639000.284812:0:6508:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788639000.284872:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b679450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+19:6513:x1875523772919168:12345-0@lo:256: Request processed in 89us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639000.284879:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788639000.284948:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f36300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772919168:0@lo:256: 10000000:01000000:3.0:1788639000.284987:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788639000.284994:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5000/0x25c454990262c093 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c09a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639000.285001:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5000/0x25c454990262c093 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c09a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639000.285008:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788639000.285010:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:3.0:1788639000.285012:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788639000.285029:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5800/0x25c454990262c0a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639000.285036:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5800/0x25c454990262c0a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639000.285053:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5800/0x25c454990262c0a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639000.285065:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f36300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772919296:0@lo:101: 00000100:00100000:3.0:1788639000.285119:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639000.285144:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243066780 going to sleep for 11 seconds 00000100:00100000:0.0:1788639000.285301:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772919296 00000100:00100000:0.0:1788639000.285305:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772919296 00000100:00100000:0.0:1788639000.285324:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788639000.285329:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b679050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+19:6513:x1875523772919296:12345-0@lo:101: 00010000:00010000:0.0:1788639000.285336:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639000.285344:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae375f54a00/0x25c454990262c0a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262c0a1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639000.285359:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae375f54a00/0x25c454990262c0a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262c0a1 expref: 20 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639000.285367:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae375f54a00/0x25c454990262c0a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c0a1 expref: 20 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639000.285384:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375f54a00, rc 0) 00000100:00100000:0.0:1788639000.285417:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b679050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+20:6513:x1875523772919296:12345-0@lo:101: Request processed in 87us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639000.285422:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788639000.285562:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f36300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772919296:0@lo:101: 00010000:00010000:3.0:1788639000.285573:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5800/0x25c454990262c0a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c0a8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639000.285581:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5800/0x25c454990262c0a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262c0a8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639000.285833:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772919424:0@lo:501: 00000100:00100000:0.0:1788639000.285857:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639000.285886:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d2d4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788639000.285924:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772919424 00000100:00100000:1.0:1788639000.285928:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772919424 00000100:00100000:1.0:1788639000.285959:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788639000.285965:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+20:6513:x1875523772919424:12345-0@lo:501: 00000100:00100000:1.0:1788639000.286071:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+20:6513:x1875523772919424:12345-0@lo:501: Request processed in 106us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639000.286088:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788639000.286157:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772919424:0@lo:501: 00000100:00100000:3.0:1788639000.286185:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f36300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772919552:0@lo:503: 00000100:00100000:3.0:1788639000.286220:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639000.286299:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243066780 going to sleep for 11 seconds 00000100:00100000:1.0:1788639000.286332:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772919552 00000100:00100000:1.0:1788639000.286336:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772919552 00000100:00100000:1.0:1788639000.286361:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788639000.286366:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+20:6513:x1875523772919552:12345-0@lo:503: 00000100:00100000:1.0:1788639000.286436:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+20:6513:x1875523772919552:12345-0@lo:503: Request processed in 69us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639000.286442:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788639000.286567:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f36300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772919552:0@lo:503: 00000100:00100000:1.0:1788639000.289545:0:9833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242efa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:9833:1875523772919680:0@lo:502: 00000100:00100000:1.0:1788639000.289679:0:9833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639000.289713:0:9833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae242351300 going to sleep for 11 seconds 00000100:00100000:3.0:1788639000.289830:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772919680 00000100:00100000:3.0:1788639000.289838:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772919680 00000100:00100000:3.0:1788639000.289881:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788639000.289891:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+20:9833:x1875523772919680:12345-0@lo:502: 00000100:00100000:3.0:1788639000.290008:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+20:9833:x1875523772919680:12345-0@lo:502: Request processed in 118us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639000.290016:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788639000.290114:0:9833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242efa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:9833:1875523772919680:0@lo:502: 00000020:01000000:1.0:1788639000.290140:0:9833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788639000.290147:0:9833:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788639000.290154:0:9833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788639000.290156:0:9833:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788639000.290161:0:9833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788639000.290164:0:9833:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.118@tcp to nid 0x20000c0a8ce76 (192.168.206.118@tcp) 00000020:01000000:1.0:1788639000.290184:0:9833:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788639000.290187:0:9833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788639000.290201:0:9833:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9ae37f718000) 00000020:00000080:1.0:1788639000.290223:0:9833:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1788639000.290229:0:9833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788639000.290409:0:9833:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1788639000.290415:0:9833:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788639000.290422:0:9833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x25c454990262c0b6 00010000:00080000:1.0:1788639000.290450:0:9833:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ae2431af000@lustre-OST0001-osc-MDT0001: add connection 192.168.206.118@tcp at head 00010000:00010000:1.0:1788639000.290804:0:9833:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:1.0:1788639000.290940:0:9833:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788639000.290951:0:9833:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788639000.291134:0:9833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788639000.291463:0:9833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788639000.291591:0:9833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788639000.291713:0:9833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788639000.292088:0:9834:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788639000.292093:0:9834:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788639000.298407:0:9833:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788639000.298421:0:9833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788639000.298465:0:9833:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788639000.298493:0:9833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x25c454990262c0bd 00000100:00080000:1.0:1788639000.298505:0:9833:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788639000.298519:0:9833:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ae2431af000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:1.0:1788639000.298554:0:9833:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae242efa300 x1875523772919808/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788639000.298585:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242efa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523772919808:0@lo:8: 00000100:00100000:1.0:1788639000.298675:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639000.298729:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772919808 00000100:00100000:1.0:1788639000.298736:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772919808 00000100:00100000:1.0:1788639000.298762:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788639000.298769:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3640:x1875523772919808:12345-0@lo:8: 00010000:00080000:1.0:1788639000.298793:0:8829:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 259 last 0 00000020:00000080:1.0:1788639000.298814:0:8829:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x25c454990262c0c4 00002000:00100000:1.0:1788639000.298826:0:8829:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9ae2431ac000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1788639000.298830:0:8829:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:1.0:1788639000.298834:0:8829:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788639000.298892:0:8829:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788639000.299104:0:8829:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1788639000.299127:0:8829:0:(import.c:65:import_set_state_nolock()) ffff9ae2431a8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788639000.299172:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3640:x1875523772919808:12345-0@lo:8: Request processed in 401us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639000.299180:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788639000.299217:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae242efa300 x1875523772919808/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788639010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639000.299227:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788639000.299234:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788639000.299240:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788639000.299245:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788639000.299254:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae2431af000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788639000.299266:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788639000.299271:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242efa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523772919808:0@lo:8: 00000004:00080000:1.0:1788639000.299293:0:9834:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788639000.299336:0:9834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 259093719184ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788639000.299342:0:9834:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00080000:1.0:1788639000.300932:0:9833:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788639000.301038:0:9833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:0.0:1788639000.301968:0:9835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9835:1875523772919936:0@lo:700: 00000100:00100000:0.0:1788639000.302032:0:9835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639000.302086:0:9835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d2d4600 going to sleep for 11 seconds 00000100:00100000:2.0:1788639000.302279:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772919936 00000100:00100000:2.0:1788639000.302287:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772919936 00000100:00100000:2.0:1788639000.302349:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788639000.302359:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9835:x1875523772919936:12345-0@lo:700: 00000100:00100000:2.0:1788639000.302392:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f6aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8439:1875523772920064:0@lo:700: 00000100:00100000:2.0:1788639000.302421:0:8439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639000.302440:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae348544000 going to sleep for 11 seconds 00000100:00100000:2.0:1788639000.302456:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772920064 00000100:00100000:2.0:1788639000.302460:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772920064 00000100:00100000:2.0:1788639000.302483:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788639000.302490:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8439:x1875523772920064:12345-0@lo:700: 00000100:00080000:0.0:1788639000.303738:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:1.0:1788639000.304566:0:9833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788639000.304572:0:9833:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788639000.304582:0:9833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788639000.304602:0:9833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788639000.304604:0:9833:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788639000.304609:0:9833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788639000.304611:0:9833:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788639000.305556:0:9833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242efa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:9833:1875523772920192:0@lo:502: 00000100:00100000:1.0:1788639000.305773:0:9833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639000.305805:0:9833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3498cbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788639000.305874:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772920192 00000100:00100000:0.0:1788639000.305881:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772920192 00000100:00100000:0.0:1788639000.305935:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788639000.305944:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+20:9833:x1875523772920192:12345-0@lo:502: 00000100:00100000:0.0:1788639000.306065:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+20:9833:x1875523772920192:12345-0@lo:502: Request processed in 121us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639000.306071:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788639000.306255:0:9833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242efa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:9833:1875523772920192:0@lo:502: 00000020:01000000:1.0:1788639000.306281:0:9833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788639000.306287:0:9833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788639000.306289:0:9833:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788639000.306293:0:9833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:1.0:1788639000.306353:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:1.0:1788639000.306369:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788639000.306378:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5800/0x25c454990262c0a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c0a8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639000.306389:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5800/0x25c454990262c0a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c0a8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788639000.306409:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788639000.306413:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ae3461e3800 from 39 10000000:01000000:1.0:1788639000.306415:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788639000.306439:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb600/0x25c454990262c0cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639000.306446:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb600/0x25c454990262c0cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639000.306455:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb600/0x25c454990262c0cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639000.306469:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242efa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772920320:0@lo:101: 00000100:00100000:1.0:1788639000.306496:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639000.306511:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24202fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788639000.306524:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772920320 00000100:00100000:1.0:1788639000.306528:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772920320 00000100:00100000:1.0:1788639000.306551:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788639000.306558:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b678050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+20:6513:x1875523772920320:12345-0@lo:101: 00010000:00010000:1.0:1788639000.306567:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639000.306588:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae3750fbe00/0x25c454990262c0d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262c0cb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639000.306607:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae3750fbe00/0x25c454990262c0d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262c0cb expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639000.306820:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae3750fbe00/0x25c454990262c0d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c0cb expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639000.306838:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fbe00, rc 0) 00000100:00100000:1.0:1788639000.306869:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b678050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+21:6513:x1875523772920320:12345-0@lo:101: Request processed in 310us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639000.306875:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788639000.306906:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242efa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772920320:0@lo:101: 00010000:00010000:1.0:1788639000.306919:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb600/0x25c454990262c0cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c0d2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639000.306927:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb600/0x25c454990262c0cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262c0d2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639000.306974:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242efa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772920448:0@lo:501: 00000100:00100000:1.0:1788639000.306998:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639000.307017:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24202fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788639000.307028:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772920448 00000100:00100000:1.0:1788639000.307031:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772920448 00000100:00100000:1.0:1788639000.307052:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788639000.307059:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+21:6513:x1875523772920448:12345-0@lo:501: 00000100:00100000:1.0:1788639000.307164:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+21:6513:x1875523772920448:12345-0@lo:501: Request processed in 105us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639000.307171:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788639000.307198:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242efa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772920448:0@lo:501: 00000100:00100000:1.0:1788639000.307221:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242efa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772920576:0@lo:503: 00000100:00100000:1.0:1788639000.307310:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639000.307323:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24202fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788639000.307339:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772920576 00000100:00100000:1.0:1788639000.307342:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772920576 00000100:00100000:1.0:1788639000.307362:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788639000.307367:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+21:6513:x1875523772920576:12345-0@lo:503: 00000100:00100000:1.0:1788639000.307435:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+21:6513:x1875523772920576:12345-0@lo:503: Request processed in 67us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639000.307441:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788639000.307480:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242efa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772920576:0@lo:503: 00000004:00080000:0.0:1788639000.307807:0:7446:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:0.0:1788639000.308176:0:9836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:9836:1875523772920704:0@lo:502: 00000100:00100000:0.0:1788639000.308216:0:9836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639000.308311:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772920704 00000100:00100000:1.0:1788639000.308316:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772920704 00000100:00100000:1.0:1788639000.308343:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788639000.308350:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+21:9836:x1875523772920704:12345-0@lo:502: 00000100:00100000:1.0:1788639000.308424:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+21:9836:x1875523772920704:12345-0@lo:502: Request processed in 74us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639000.308430:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788639000.308491:0:9836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae343e856c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788639000.308506:0:9836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:9836:1875523772920704:0@lo:502: 00000100:00100000:0.0:1788639000.308547:0:9836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:9836:1875523772920832:0@lo:502: 00000100:00100000:0.0:1788639000.308588:0:9836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639000.308766:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772920832 00000100:00100000:1.0:1788639000.308770:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772920832 00000100:00100000:1.0:1788639000.308793:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788639000.308799:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+21:9836:x1875523772920832:12345-0@lo:502: 00000100:00100000:1.0:1788639000.308856:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+21:9836:x1875523772920832:12345-0@lo:502: Request processed in 57us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639000.308862:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788639000.308919:0:9836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae343e856c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788639000.308932:0:9836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:9836:1875523772920832:0@lo:502: 00000040:00080000:0.0:1788639000.308951:0:9836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1788639000.309083:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1788639000.309100:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788639000.309108:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb600/0x25c454990262c0cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c0d2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639000.309127:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb600/0x25c454990262c0cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c0d2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788639000.309135:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788639000.309138:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ae3461e3800 from 6 10000000:01000000:1.0:1788639000.309140:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788639000.309160:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3750fbc00/0x25c454990262c0d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639000.309168:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae3750fbc00/0x25c454990262c0d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639000.309177:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae3750fbc00/0x25c454990262c0d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639000.309188:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242efa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772920960:0@lo:101: 00000100:00100000:1.0:1788639000.309214:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639000.309244:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24202fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788639000.309430:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772920960 00000100:00100000:0.0:1788639000.309435:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772920960 00000100:00100000:0.0:1788639000.309465:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788639000.309472:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+21:6513:x1875523772920960:12345-0@lo:101: 00010000:00010000:0.0:1788639000.309482:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639000.309494:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae375f55000/0x25c454990262c0e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262c0d9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639000.309513:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae375f55000/0x25c454990262c0e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262c0d9 expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639000.309522:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae375f55000/0x25c454990262c0e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c0d9 expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639000.309529:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375f55000, rc 0) 00000100:00100000:0.0:1788639000.309560:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+22:6513:x1875523772920960:12345-0@lo:101: Request processed in 88us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639000.309566:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788639000.309798:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242efa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772920960:0@lo:101: 00010000:00010000:1.0:1788639000.309811:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae3750fbc00/0x25c454990262c0d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c0e0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639000.309820:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae3750fbc00/0x25c454990262c0d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262c0e0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639000.309862:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242efa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772921088:0@lo:256: 00000100:00100000:1.0:1788639000.309891:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639000.309925:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24202fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788639000.309993:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772921088 00000100:00100000:0.0:1788639000.309998:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772921088 00000100:00100000:0.0:1788639000.310025:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788639000.310032:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+22:6513:x1875523772921088:12345-0@lo:256: 20000000:01000000:0.0:1788639000.310043:0:6511:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788639000.310059:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788639000.310062:0:6511:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788639000.310154:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+22:6513:x1875523772921088:12345-0@lo:256: Request processed in 122us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639000.310166:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788639000.310234:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242efa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772921088:0@lo:256: 10000000:01000000:3.0:1788639000.310346:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788639000.310352:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3750fbc00/0x25c454990262c0d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c0e0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639000.310361:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae3750fbc00/0x25c454990262c0d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c0e0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639000.310368:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788639000.310370:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1788639000.310372:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788639000.310391:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4600/0x25c454990262c0e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639000.310397:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4600/0x25c454990262c0e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639000.310404:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4600/0x25c454990262c0e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639000.310416:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f36300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772921216:0@lo:101: 00000100:00100000:3.0:1788639000.310440:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639000.310462:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243066300 going to sleep for 11 seconds 00000100:00100000:0.0:1788639000.310504:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772921216 00000100:00100000:0.0:1788639000.310509:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772921216 00000100:00100000:0.0:1788639000.310531:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788639000.310537:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+22:6513:x1875523772921216:12345-0@lo:101: 00010000:00010000:0.0:1788639000.310543:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639000.310552:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae375f55e00/0x25c454990262c0ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262c0e7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639000.310566:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae375f55e00/0x25c454990262c0ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262c0e7 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639000.310572:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae375f55e00/0x25c454990262c0ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c0e7 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639000.310591:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375f55e00, rc 0) 00000100:00100000:0.0:1788639000.310738:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+23:6513:x1875523772921216:12345-0@lo:101: Request processed in 201us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639000.310744:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788639000.312915:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f36300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772921216:0@lo:101: 00010000:00010000:3.0:1788639000.312941:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4600/0x25c454990262c0e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c0ee expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639000.312954:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4600/0x25c454990262c0e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262c0ee expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639000.313536:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772921344:0@lo:501: 00000100:00100000:0.0:1788639000.313598:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639000.313798:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772921344 00000100:00100000:1.0:1788639000.313804:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772921344 00000100:00100000:1.0:1788639000.313839:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788639000.313847:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+23:6513:x1875523772921344:12345-0@lo:501: 00000100:00100000:1.0:1788639000.314036:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+23:6513:x1875523772921344:12345-0@lo:501: Request processed in 189us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639000.314043:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788639000.314588:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae343e85c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788639000.314608:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772921344:0@lo:501: 00000100:00100000:0.0:1788639000.314674:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772921472:0@lo:503: 00000100:00100000:0.0:1788639000.314714:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639000.314732:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae343e85c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788639000.314882:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772921472 00000100:00100000:1.0:1788639000.314888:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772921472 00000100:00100000:1.0:1788639000.314924:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788639000.314932:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+23:6513:x1875523772921472:12345-0@lo:503: 00000100:00100000:1.0:1788639000.315019:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+23:6513:x1875523772921472:12345-0@lo:503: Request processed in 88us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639000.315026:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788639000.315065:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772921472:0@lo:503: 40000000:02000000:1.0:1788639000.316449:0:6523:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:1.0:1788639000.322216:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8439:x1875523772920064:12345-0@lo:700: Request processed in 19719us (19786us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639000.322230:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788639000.322296:0:8439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f6aa00 x1875523772920064/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788639016 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639000.322311:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f6aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8439:1875523772920064:0@lo:700: 40000000:02000000:1.0:1788639000.322324:0:8439:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000001:00100000:0.0:1788639000.329407:0:9509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1788639000.329542:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9835:x1875523772919936:12345-0@lo:700: Request processed in 27181us (27505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639000.329554:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788639000.329747:0:9835:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae24233ea00 x1875523772919936/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788639016 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639000.329761:0:9835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9835:1875523772919936:0@lo:700: 00000100:00100000:3.0:1788639000.331033:0:9837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f36300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:9837:1875523772921600:0@lo:502: 00000100:00100000:3.0:1788639000.331108:0:9837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639000.331147:0:9837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243066540 going to sleep for 11 seconds 00000100:00100000:1.0:1788639000.331745:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772921600 00000100:00100000:1.0:1788639000.331753:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772921600 00000100:00100000:1.0:1788639000.331807:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788639000.331816:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+23:9837:x1875523772921600:12345-0@lo:502: 00000100:00100000:1.0:1788639000.331941:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+23:9837:x1875523772921600:12345-0@lo:502: Request processed in 126us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639000.331949:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788639000.332004:0:9837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f36300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:9837:1875523772921600:0@lo:502: 00000020:01000000:1.0:1788639000.332033:0:9837:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788639000.332040:0:9837:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788639000.332046:0:9837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788639000.332048:0:9837:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788639000.332069:0:9837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788639000.332083:0:9837:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.118@tcp to nid 0x20000c0a8ce76 (192.168.206.118@tcp) 00000020:01000000:1.0:1788639000.332174:0:9837:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788639000.332177:0:9837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788639000.332193:0:9837:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9ae37f7199c0) 00000020:00000080:1.0:1788639000.332216:0:9837:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:1.0:1788639000.332221:0:9837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788639000.334052:0:9837:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788639000.334062:0:9837:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:0.0:1788639000.334085:0:9837:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x25c454990262c0fc 00010000:00080000:0.0:1788639000.334118:0:9837:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ae2431e2000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.118@tcp at head 00010000:00010000:0.0:1788639000.335862:0:9837:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:0.0:1788639000.336018:0:9837:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788639000.336031:0:9837:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788639000.336194:0:9837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788639000.336472:0:9837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788639000.336797:0:9837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788639000.336884:0:9837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1788639000.339814:0:9838:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788639000.339822:0:9838:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000004:00080000:1.0:1788639000.344950:0:9835:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788639000.344981:0:9835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242efaa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9835:1875523772921856:0@lo:7: 00000100:00100000:1.0:1788639000.345042:0:9835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639000.345068:0:9835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d2d46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788639000.345099:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242efa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772921728:0@lo:13: 00000100:00100000:1.0:1788639000.345125:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639000.345164:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772921856 00000100:00100000:1.0:1788639000.345170:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772921856 00000100:00100000:1.0:1788639000.345212:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788639000.345221:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242081880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9835:x1875523772921856:12345-0@lo:7: 00000020:00000080:2.0:1788639000.348545:0:9837:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788639000.348560:0:9837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788639000.348800:0:9837:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788639000.348829:0:9837:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x25c454990262c103 00000100:00080000:2.0:1788639000.348839:0:9837:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788639000.348844:0:9837:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ae2431e2000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788639000.348878:0:9837:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae375f68e00 x1875523772921984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788639000.348908:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523772921984:0@lo:8: 00000100:00100000:2.0:1788639000.348965:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639000.349016:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772921984 00000100:00100000:2.0:1788639000.349022:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772921984 00000100:00100000:2.0:1788639000.349046:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788639000.349052:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3640:x1875523772921984:12345-0@lo:8: 00010000:00080000:2.0:1788639000.349096:0:8829:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 259 last 0 00000020:00000080:2.0:1788639000.349118:0:8829:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x25c454990262c10a 00002000:00100000:2.0:1788639000.349129:0:8829:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9ae241e9a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788639000.349133:0:8829:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788639000.349135:0:8829:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788639000.349206:0:8829:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788639000.349227:0:8829:0:(import.c:65:import_set_state_nolock()) ffff9ae241e9c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788639000.349325:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3640:x1875523772921984:12345-0@lo:8: Request processed in 271us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639000.349332:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1788639000.349368:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f68e00 x1875523772921984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788639010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639000.349377:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788639000.349384:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788639000.349391:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788639000.349395:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788639000.349397:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae2431e2000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788639000.349405:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788639000.349409:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523772921984:0@lo:8: 00000100:00080000:2.0:1788639000.349423:0:9837:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788639000.349479:0:9837:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788639000.349484:0:9837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639000.349486:0:9837:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788639000.349489:0:9837:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788639000.349493:0:9837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639000.349494:0:9837:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788639000.349498:0:9837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788639000.349505:0:9837:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788639000.349529:0:9837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f68e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:9837:1875523772922112:0@lo:502: 00000100:00100000:2.0:1788639000.349569:0:9837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639000.349734:0:9837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae348544a80 going to sleep for 11 seconds 00000004:00080000:2.0:1788639000.349748:0:9838:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788639000.349796:0:9838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 259144179703ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788639000.349803:0:9838:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1788639000.349911:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772922112 00000100:00100000:0.0:1788639000.349917:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772922112 00000100:00100000:0.0:1788639000.349947:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788639000.349953:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+23:9837:x1875523772922112:12345-0@lo:502: 00000100:00100000:0.0:1788639000.350065:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+23:9837:x1875523772922112:12345-0@lo:502: Request processed in 111us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639000.350082:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788639000.350333:0:9837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f68e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:9837:1875523772922112:0@lo:502: 00000020:01000000:2.0:1788639000.350356:0:9837:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788639000.350361:0:9837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639000.350363:0:9837:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788639000.350367:0:9837:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000100:00100000:1.0:1788639000.350519:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772921728 00000100:00100000:1.0:1788639000.350532:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772921728 00000100:00100000:1.0:1788639000.350562:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788639000.350568:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36914d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1875523772921728:12345-0@lo:13: 00000020:01000000:2.0:1788639000.350762:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:2.0:1788639000.350786:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788639000.350795:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4600/0x25c454990262c0e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c0ee expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639000.350805:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4600/0x25c454990262c0e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c0ee expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788639000.350815:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788639000.350817:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ae342e50000 from 1 10000000:01000000:2.0:1788639000.350820:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788639000.350848:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae38217b600/0x25c454990262c111 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639000.350856:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae38217b600/0x25c454990262c111 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639000.350865:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae38217b600/0x25c454990262c111 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639000.350886:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f68e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772922240:0@lo:101: 00000100:00100000:2.0:1788639000.350920:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639000.350945:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae348544a80 going to sleep for 11 seconds 00002000:00000024:1.0:1788639000.351035:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:1.0:1788639000.351095:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36914d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1875523772921728:12345-0@lo:13: Request processed in 527us (5969us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639000.351103:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788639000.351122:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772922240 00000100:00100000:1.0:1788639000.351126:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772922240 00000100:00100000:1.0:1788639000.351148:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788639000.351155:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+23:6513:x1875523772922240:12345-0@lo:101: 00010000:00010000:1.0:1788639000.351163:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639000.351175:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae3750fa800/0x25c454990262c118 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262c111 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639000.351196:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae3750fa800/0x25c454990262c118 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262c111 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639000.351206:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae3750fa800/0x25c454990262c118 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c111 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639000.351215:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fa800, rc 0) 00010000:00080000:2.0:1788639000.352369:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae242efa300 x1875523772921728/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639016 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639000.352392:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242efa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772921728:0@lo:13: 00000100:00100000:1.0:1788639000.352475:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+24:6513:x1875523772922240:12345-0@lo:101: Request processed in 1319us (1552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639000.352482:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788639000.352538:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f68e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772922240:0@lo:101: 00010000:00010000:1.0:1788639000.352555:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae38217b600/0x25c454990262c111 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c118 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639000.352577:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae38217b600/0x25c454990262c111 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262c118 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639000.353186:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f38380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772922368:0@lo:501: 00000100:00100000:1.0:1788639000.353229:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639000.353388:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3498cbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788639000.356841:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772922368 00000100:00100000:2.0:1788639000.356856:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772922368 00000100:00100000:2.0:1788639000.356956:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788639000.356966:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+24:6513:x1875523772922368:12345-0@lo:501: 00000100:00100000:2.0:1788639000.357390:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+24:6513:x1875523772922368:12345-0@lo:501: Request processed in 424us (4159us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788639000.357398:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788639000.359407:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f38380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772922368:0@lo:501: 10000000:01000000:1.0:1788639000.359475:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788639000.359486:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae38217b600/0x25c454990262c111 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c118 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639000.359497:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae38217b600/0x25c454990262c111 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c118 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788639000.363603:0:8430:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1788639000.363613:0:8430:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788639000.365362:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242081880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9835:x1875523772921856:12345-0@lo:7: Request processed in 20137us (20314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639000.365372:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788639000.365465:0:9835:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae242efaa00 x1875523772921856/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788639016 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639000.365480:0:9835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242efaa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9835:1875523772921856:0@lo:7: 00000004:00080000:1.0:1788639000.365507:0:9835:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788639000.365543:0:9835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f38380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9835:1875523772922496:0@lo:5: 00000100:00100000:1.0:1788639000.365575:0:9835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639000.365808:0:9835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d2d46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788639000.365829:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772922496 00000100:00100000:1.0:1788639000.365835:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772922496 00000100:00100000:1.0:1788639000.365873:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788639000.365882:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9835:x1875523772922496:12345-0@lo:5: 00002000:00080000:1.0:1788639000.365905:0:8829:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1788639000.365935:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9835:x1875523772922496:12345-0@lo:5: Request processed in 54us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639000.365941:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1788639000.365968:0:9835:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f38380 x1875523772922496/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788639016 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639000.365978:0:9835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f38380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9835:1875523772922496:0@lo:5: 00000004:00080000:1.0:1788639000.365985:0:9835:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788639000.366008:0:9835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f38380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9835:1875523772922624:0@lo:5: 00000100:00100000:1.0:1788639000.366028:0:9835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639000.366044:0:9835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d2d46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788639000.366056:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772922624 00000100:00100000:1.0:1788639000.366059:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772922624 00000100:00100000:1.0:1788639000.366092:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788639000.366099:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9835:x1875523772922624:12345-0@lo:5: 00002000:00080000:1.0:1788639000.366122:0:8431:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000004:00080000:2.0:1788639000.369787:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1788639000.370948:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:9835:x1875523772922624:12345-0@lo:5: Request processed in 4843us (4912us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788639000.370960:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788639000.371344:0:9835:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f38380 x1875523772922624/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788639016 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639000.371361:0:9835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f38380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9835:1875523772922624:0@lo:5: 00000004:00080000:2.0:1788639000.371377:0:9835:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1788639000.371416:0:9835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f69500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9835:1875523772922752:0@lo:900: 00000100:00100000:2.0:1788639000.371451:0:9835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639000.371479:0:9835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae348544cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788639000.371529:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772922752 00000100:00100000:3.0:1788639000.371536:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772922752 00000100:00100000:3.0:1788639000.371579:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788639000.371588:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9835:x1875523772922752:12345-0@lo:900: 00000100:00100000:3.0:1788639000.371663:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9835:x1875523772922752:12345-0@lo:900: Request processed in 77us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639000.371679:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788639000.372441:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788639000.372455:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772922880:0@lo:13: 00010000:00080000:1.0:1788639000.373231:0:9835:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f69500 x1875523772922752/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788639016 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639000.373255:0:9835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f69500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9835:1875523772922752:0@lo:900: 00000004:00080000:3.0:1788639000.375228:0:9839:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788639000.375279:0:9839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f34e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9839:1875523772923008:0@lo:7: 00000100:00100000:3.0:1788639000.375349:0:9839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639000.375385:0:9839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243066e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788639000.375412:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639000.375545:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772922880 00000100:00100000:1.0:1788639000.375548:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772923008 00000100:00100000:3.0:1788639000.375553:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772922880 00000100:00100000:1.0:1788639000.375555:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772923008 00000100:00100000:3.0:1788639000.375636:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788639000.375647:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1875523772922880:12345-0@lo:13: 00000100:00100000:1.0:1788639000.375659:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00002000:00000024:3.0:1788639000.375667:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923808256 avail 3692285952 00000100:00100000:1.0:1788639000.375669:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:9839:x1875523772923008:12345-0@lo:7: 00000100:00100000:3.0:1788639000.375716:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1875523772922880:12345-0@lo:13: Request processed in 71us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639000.375724:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1788639000.378734:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f68e00 x1875523772922880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639016 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639000.378758:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772922880:0@lo:13: 00000100:00080000:0.0:1788639000.378899:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:1.0:1788639000.381907:0:8432:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1788639000.381916:0:8432:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788639000.382005:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9839:x1875523772923008:12345-0@lo:7: Request processed in 6334us (6652us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639000.382016:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788639000.382369:0:9839:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f34e00 x1875523772923008/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788639016 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639000.382397:0:9839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f34e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9839:1875523772923008:0@lo:7: 00000004:00080000:3.0:1788639000.382416:0:9839:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788639000.382456:0:9839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f34e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9839:1875523772923136:0@lo:5: 00000100:00100000:3.0:1788639000.382506:0:9839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639000.386649:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772923136 00000100:00100000:3.0:1788639000.386664:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772923136 00000100:00100000:2.0:1788639000.386809:0:9839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243066e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788639000.387456:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788639000.387466:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9839:x1875523772923136:12345-0@lo:5: 00002000:00080000:3.0:1788639000.387495:0:8829:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788639000.387498:0:8829:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000001:00080000:0.0:1788639000.399944:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00080000:0.0:1788639000.399962:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1788639000.399969:0:9509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788639000.400187:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9839:x1875523772923136:12345-0@lo:5: Request processed in 12718us (17678us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788639000.400198:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1788639000.401041:0:9839:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f34e00 x1875523772923136/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788639016 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639000.401054:0:9839:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788639000.401061:0:9839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f34e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9839:1875523772923136:0@lo:5: 00000004:00080000:3.0:1788639000.401091:0:9839:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788639000.401136:0:9839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f34e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9839:1875523772923264:0@lo:700: 00000100:00100000:3.0:1788639000.401177:0:9839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639000.401236:0:9839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243066e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788639000.401336:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772923264 00000100:00100000:1.0:1788639000.401344:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772923264 00000100:00100000:1.0:1788639000.401396:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788639000.401407:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9839:x1875523772923264:12345-0@lo:700: 00000100:00100000:0.0:1788639000.418689:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9839:x1875523772923264:12345-0@lo:700: Request processed in 17277us (17504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639000.418710:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788639000.418812:0:9839:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f34e00 x1875523772923264/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788639016 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639000.418826:0:9839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f34e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9839:1875523772923264:0@lo:700: 00000004:02000040:2.0:1788639000.424468:0:9839:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:0.0:1788639000.434470:0:9839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9839:1875523772923392:0@lo:5: 00000100:00100000:0.0:1788639000.434538:0:9839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639000.434599:0:9839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae343e85c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788639000.434929:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772923392 00000100:00100000:2.0:1788639000.434937:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772923392 00000100:00100000:2.0:1788639000.434992:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788639000.435001:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9839:x1875523772923392:12345-0@lo:5: 00002000:00080000:1.0:1788639000.440390:0:8431:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1788639000.440410:0:8431:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:1.0:1788639000.443852:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9839:x1875523772923392:12345-0@lo:5: Request processed in 8846us (9307us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788639000.443865:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1788639000.444150:0:9839:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae24233ea00 x1875523772923392/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788639016 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639000.444169:0:9839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9839:1875523772923392:0@lo:5: 00000004:00080000:2.0:1788639000.444184:0:9839:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000001:02000400:3.0:1788639000.713784:0:9881:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg618-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788639000.756844:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788639000.756869:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772923520:0@lo:41: 00000100:00100000:0.0:1788639000.756933:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639000.757061:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772923520 00000100:00100000:1.0:1788639000.757068:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772923520 00000100:00100000:1.0:1788639000.758002:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788639000.758015:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772923520:12345-0@lo:41: 00000004:00000024:1.0:1788639000.758123:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788639000.758270:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772923520:12345-0@lo:41: Request processed in 258us (1335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639000.758287:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788639000.758395:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772923520:0@lo:41: 00010000:00010000:3.0:1788639001.015606:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639001.268819:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788639001.268845:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772923648:0@lo:41: 00000100:00100000:1.0:1788639001.268906:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639001.269404:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772923648 00000100:00100000:0.0:1788639001.269413:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772923648 00000100:00100000:0.0:1788639001.269464:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788639001.269474:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772923648:12345-0@lo:41: 00000004:00000024:0.0:1788639001.269517:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788639001.269650:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772923648:12345-0@lo:41: Request processed in 177us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639001.269658:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788639001.269703:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772923648:0@lo:41: 00000020:00000004:1.0:1788639001.518411:0:9934:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788639001.523030:0:9934:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788639002.038536:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788639002.398835:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:3.0:1788639002.805208:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772923776:0@lo:13: 00000100:00100000:3.0:1788639002.805303:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639002.805420:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772923776 00000100:00100000:2.0:1788639002.805430:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772923776 00000100:00100000:2.0:1788639002.805505:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788639002.805520:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772923776:12345-0@lo:13: 00002000:00000024:2.0:1788639002.805558:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788639002.805640:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772923776:12345-0@lo:13: Request processed in 104us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639002.805647:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788639002.805722:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788639002.805885:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae24233df80 x1875523772923776/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639018 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639002.806042:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772923776:0@lo:13: 00000100:00100000:3.0:1788639002.806099:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788639002.806108:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772923904:0@lo:13: 00000100:00100000:3.0:1788639002.806144:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639002.806291:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772923904 00000100:00100000:2.0:1788639002.806297:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772923904 00000100:00100000:2.0:1788639002.806353:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788639002.806361:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772923904:12345-0@lo:13: 00002000:00000024:2.0:1788639002.806395:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788639002.806431:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772923904:12345-0@lo:13: Request processed in 71us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639002.806437:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1788639002.806562:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788639002.806644:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f68e00 x1875523772923904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639018 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639002.806660:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772923904:0@lo:13: 00010000:00010000:3.0:1788639003.061549:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639004.085874:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788639004.266256:0:10035:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788639004.266857:0:10035:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:2.0:1788639005.080166:0:10083:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788639005.080177:0:10083:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:1.0:1788639005.109828:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639005.369948:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523772924416:0@lo:400: 00000100:00100000:2.0:1788639005.370011:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639005.370078:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242efa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772924928:0@lo:400: 00000100:00100000:2.0:1788639005.370104:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639005.370122:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae360686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772925440:0@lo:400: 00000100:00100000:2.0:1788639005.370141:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639005.370167:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788639005.370173:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772924288:0@lo:400: 00000100:00100000:2.0:1788639005.370195:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639005.370210:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242efaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875523772924800:0@lo:400: 00000100:00100000:2.0:1788639005.370244:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639005.370265:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342e3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875523772925312:0@lo:400: 00000100:00100000:2.0:1788639005.370288:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639005.370375:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875523772924160:0@lo:400: 00000100:00100000:3.0:1788639005.370405:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639005.370418:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875523772924672:0@lo:400: 00000100:00100000:3.0:1788639005.370436:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639005.370447:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342e3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875523772925184:0@lo:400: 00000100:00100000:3.0:1788639005.370473:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639005.370485:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1788639005.370490:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01f1eef9-e690-4065-bf99-bf821af7b626:3644:1875523772924032:0@lo:400: 00000100:00100000:3.0:1788639005.370527:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639005.370556:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772924544:0@lo:400: 00000100:00100000:3.0:1788639005.370576:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639005.370593:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342e3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772925056:0@lo:400: 00000100:00100000:3.0:1788639005.370611:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639005.370661:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae360687b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772925568:0@lo:400: 00000100:00100000:3.0:1788639005.370682:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639005.370711:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772924416 00000100:00100000:3.0:1788639005.370717:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772924416 00000100:00100000:3.0:1788639005.370751:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772924800 00000100:00100000:3.0:1788639005.370754:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772924800 00000100:00100000:3.0:1788639005.370777:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772925312 00000100:00100000:3.0:1788639005.370779:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772925312 00000100:00100000:3.0:1788639005.370790:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772924160 00000100:00100000:3.0:1788639005.370792:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772924160 00000100:00100000:3.0:1788639005.370802:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772924672 00000100:00100000:3.0:1788639005.370804:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772924672 00000100:00100000:3.0:1788639005.370813:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772925184 00000100:00100000:3.0:1788639005.370816:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772925184 00000100:00100000:3.0:1788639005.370829:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788639005.370836:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae360687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523772924416:12345-0@lo:400: 00000100:00100000:3.0:1788639005.370885:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae360687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523772924416:12345-0@lo:400: Request processed in 48us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639005.370892:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788639005.370906:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788639005.370912:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae360684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875523772924800:12345-0@lo:400: 00000100:00100000:3.0:1788639005.370939:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae360684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875523772924800:12345-0@lo:400: Request processed in 27us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639005.370945:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788639005.370955:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788639005.370961:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae360685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875523772925312:12345-0@lo:400: 00000100:00100000:3.0:1788639005.370986:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae360685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875523772925312:12345-0@lo:400: Request processed in 26us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639005.370992:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788639005.371011:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788639005.371017:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875523772924160:12345-0@lo:400: 00000100:00100000:3.0:1788639005.371060:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875523772924160:12345-0@lo:400: Request processed in 31us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639005.371070:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788639005.371082:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788639005.371088:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875523772924672:12345-0@lo:400: 00000100:00100000:3.0:1788639005.371115:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875523772924672:12345-0@lo:400: Request processed in 27us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639005.371121:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788639005.371132:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788639005.371138:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875523772925184:12345-0@lo:400: 00000100:00100000:3.0:1788639005.371162:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875523772925184:12345-0@lo:400: Request processed in 24us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639005.371168:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788639005.371184:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772924288 00000100:00100000:3.0:1788639005.371188:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772924288 00000100:00100000:3.0:1788639005.371204:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772924544 00000100:00100000:3.0:1788639005.371206:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772924544 00000100:00100000:3.0:1788639005.371216:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788639005.371223:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae360686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772924288:12345-0@lo:400: 00000100:00100000:3.0:1788639005.371254:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae360686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772924288:12345-0@lo:400: Request processed in 31us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639005.371260:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788639005.371271:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788639005.371276:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772924544:12345-0@lo:400: 00000100:00100000:3.0:1788639005.371303:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772924544:12345-0@lo:400: Request processed in 27us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639005.371315:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788639005.371332:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772924928 00000100:00100000:3.0:1788639005.371336:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772924928 00000100:00100000:3.0:1788639005.371355:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772925440 00000100:00100000:3.0:1788639005.371357:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772925440 00000100:00100000:3.0:1788639005.371367:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772925056 00000100:00100000:3.0:1788639005.371370:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772925056 00000100:00100000:3.0:1788639005.371379:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772925568 00000100:00100000:3.0:1788639005.371381:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772925568 00000100:00100000:3.0:1788639005.371392:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788639005.371398:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae360685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772924928:12345-0@lo:400: 00000100:00100000:3.0:1788639005.371428:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae360685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772924928:12345-0@lo:400: Request processed in 30us (1323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639005.371434:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788639005.371445:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788639005.371451:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae360686a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772925440:12345-0@lo:400: 00000100:00100000:3.0:1788639005.371476:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae360686a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772925440:12345-0@lo:400: Request processed in 26us (1334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639005.371482:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788639005.371492:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788639005.371498:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772925056:12345-0@lo:400: 00000100:00100000:3.0:1788639005.371524:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772925056:12345-0@lo:400: Request processed in 26us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639005.371529:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788639005.371539:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788639005.371544:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772925568:12345-0@lo:400: 00000100:00100000:3.0:1788639005.371571:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772925568:12345-0@lo:400: Request processed in 26us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639005.371582:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788639005.371599:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788639005.371604:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788639005.371606:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788639005.371608:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788639005.371658:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772924544:0@lo:400: 00010000:00080000:3.0:1788639005.371672:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae342e3d500 x1875523772925056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639005.371683:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342e3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772925056:0@lo:400: 00010000:00080000:3.0:1788639005.371692:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae360687b80 x1875523772925568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639005.371700:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1788639005.371720:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae360687b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772925568:0@lo:400: 00010000:00080000:3.0:1788639005.371732:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f68700 x1875523772924160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639005.371740:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875523772924160:0@lo:400: 00010000:00080000:3.0:1788639005.371749:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f69500 x1875523772924672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639005.371757:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875523772924672:0@lo:400: 00010000:00080000:3.0:1788639005.371767:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae342e3d180 x1875523772925184/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639005.371775:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342e3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875523772925184:0@lo:400: 00000100:00100000:3.0:1788639005.371808:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772924288:0@lo:400: 00010000:00080000:3.0:1788639005.371830:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae242efaa00 x1875523772924800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639005.371839:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242efaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875523772924800:0@lo:400: 00010000:00080000:3.0:1788639005.371853:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae342e3ed80 x1875523772925312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639005.371862:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342e3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875523772925312:0@lo:400: 00010000:00080000:3.0:1788639005.371872:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f68380 x1875523772924416/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639005.371880:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523772924416:0@lo:400: 00010000:00080000:3.0:1788639005.371889:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae242efa300 x1875523772924928/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639005.371897:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242efa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772924928:0@lo:400: 00010000:00080000:3.0:1788639005.371921:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae360686d80 x1875523772925440/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639005.371929:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788639005.371939:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae360686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772925440:0@lo:400: 00000100:00100000:0.0:1788639005.372156:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788639005.372168:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772925696:0@lo:13: 00000100:00100000:0.0:1788639005.372201:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639005.372296:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772925696 00000100:00100000:1.0:1788639005.372302:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772925696 00000100:00100000:1.0:1788639005.372340:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788639005.372348:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772925696:12345-0@lo:13: 00002000:00000024:1.0:1788639005.372370:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788639005.372410:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772925696:12345-0@lo:13: Request processed in 64us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639005.372417:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1788639005.372442:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f3bb80 x1875523772925696/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639021 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639005.372455:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772925696:0@lo:13: 00000100:00100000:2.0:1788639005.372957:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772924032 00000100:00100000:2.0:1788639005.372963:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772924032 00000100:00100000:2.0:1788639005.373002:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788639005.373010:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+24:3644:x1875523772924032:12345-0@lo:400: 00000100:00100000:2.0:1788639005.373068:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+24:3644:x1875523772924032:12345-0@lo:400: Request processed in 59us (2538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639005.373084:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788639005.373318:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01f1eef9-e690-4065-bf99-bf821af7b626:3644:1875523772924032:0@lo:400: 00000100:00100000:3.0:1788639005.508435:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639005.508574:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754000512 00000100:00100000:2.0:1788639005.508588:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754000512 00000100:00100000:2.0:1788639005.508671:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 181 00000100:00100000:2.0:1788639005.508683:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2404:x1875523754000512:12345-192.168.206.18@tcp:250: 00010000:00080000:2.0:1788639005.508721:0:6510:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from d1343f14-ed5c-4943-b596-61180b04fa87@192.168.206.18@tcp t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:2.0:1788639005.508757:0:6510:0:(genops.c:1385:class_connect()) connect: client d1343f14-ed5c-4943-b596-61180b04fa87, cookie 0x25c454990262c11f 00000100:00080000:2.0:1788639005.508941:0:6510:0:(import.c:65:import_set_state_nolock()) ffff9ae242df5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788639005.509030:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+5:2404:x1875523754000512:12345-192.168.206.18@tcp:250: Request processed in 347us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639005.509593:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 181 00000100:00100000:3.0:1788639005.519156:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639005.519845:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754000640 00000100:00100000:0.0:1788639005.519860:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754000640 00000100:00100000:0.0:1788639005.519942:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 182 00000100:00100000:0.0:1788639005.519955:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+5:6163:x1875523754000640:12345-192.168.206.18@tcp:101: 00010000:00010000:0.0:1788639005.519996:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639005.520020:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae375f54400/0x25c454990262c126 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85335 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639005.520071:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae375f54400/0x25c454990262c126 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85335 expref: 6 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639005.520085:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae375f54400/0x25c454990262c126 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85335 expref: 6 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639005.520098:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375f54400, rc 0) 00000100:00100000:0.0:1788639005.520177:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+6:6163:x1875523754000640:12345-192.168.206.18@tcp:101: Request processed in 212us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639005.520186:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 182 00000100:00100000:0.0:1788639005.528316:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639005.528657:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754000768 00000100:00100000:2.0:1788639005.528680:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754000768 00000100:00100000:2.0:1788639005.528737:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 183 00000100:00100000:2.0:1788639005.528747:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+6:6163:x1875523754000768:12345-192.168.206.18@tcp:501: 00000100:00100000:2.0:1788639005.528898:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+6:6163:x1875523754000768:12345-192.168.206.18@tcp:501: Request processed in 151us (595us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788639005.528907:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 183 00000100:00100000:3.0:1788639005.530738:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639005.530903:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754000896 00000100:00100000:1.0:1788639005.530916:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754000896 00000100:00100000:1.0:1788639005.530972:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 184 00000100:00100000:1.0:1788639005.530984:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+6:6163:x1875523754000896:12345-192.168.206.18@tcp:101: 00010000:00010000:1.0:1788639005.531004:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639005.531028:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae3750fb200/0x25c454990262c12d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e8533c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639005.531074:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae3750fb200/0x25c454990262c12d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8533c expref: 7 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639005.531108:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae3750fb200/0x25c454990262c12d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8533c expref: 7 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639005.531120:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fb200, rc 0) 00000100:00100000:1.0:1788639005.531193:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+7:6163:x1875523754000896:12345-192.168.206.18@tcp:101: Request processed in 210us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639005.531200:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 184 00000100:00100000:3.0:1788639005.532737:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639005.533118:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754001024 00000100:00100000:2.0:1788639005.533129:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754001024 00000100:00100000:2.0:1788639005.533186:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 185 00000100:00100000:2.0:1788639005.533197:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370fff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+7:6163:x1875523754001024:12345-192.168.206.18@tcp:501: 00000100:00100000:2.0:1788639005.533392:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370fff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+8:6163:x1875523754001024:12345-192.168.206.18@tcp:501: Request processed in 195us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639005.533400:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 185 00000100:00100000:3.0:1788639005.539414:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639005.539544:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754001152 00000100:00100000:0.0:1788639005.539565:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754001152 00000100:00100000:0.0:1788639005.539724:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 186 00000100:00100000:0.0:1788639005.539739:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+8:6163:x1875523754001152:12345-192.168.206.18@tcp:503: 00000100:00100000:0.0:1788639005.540095:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+8:6163:x1875523754001152:12345-192.168.206.18@tcp:503: Request processed in 358us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639005.540104:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 186 00000100:00100000:3.0:1788639005.546115:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639005.547485:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754001280 00000100:00100000:1.0:1788639005.547505:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754001280 00000100:00100000:1.0:1788639005.547599:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 187 00000100:00100000:1.0:1788639005.547613:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+8:6181:x1875523754001280:12345-192.168.206.18@tcp:502: 00000100:00100000:0.0:1788639005.548207:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+8:6181:x1875523754001280:12345-192.168.206.18@tcp:502: Request processed in 592us (2102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639005.548219:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 187 00000100:00100000:3.0:1788639005.579442:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639005.579666:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754001408 00000100:00100000:0.0:1788639005.579680:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754001408 00000100:00100000:0.0:1788639005.579768:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 188 00000100:00100000:0.0:1788639005.579779:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+8:6181:x1875523754001408:12345-192.168.206.18@tcp:502: 00000100:00100000:0.0:1788639005.580252:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+8:6181:x1875523754001408:12345-192.168.206.18@tcp:502: Request processed in 473us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639005.580261:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 188 00000100:00100000:3.0:1788639005.586821:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639005.587156:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754001536 00000100:00100000:0.0:1788639005.587180:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754001536 00000100:00100000:0.0:1788639005.587252:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 189 00000100:00100000:0.0:1788639005.587264:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370fff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+8:6163:x1875523754001536:12345-192.168.206.18@tcp:101: 00010000:00010000:0.0:1788639005.587285:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639005.587307:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae375f54e00/0x25c454990262c134 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e8536d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639005.587345:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae375f54e00/0x25c454990262c134 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8536d expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639005.587358:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae375f54e00/0x25c454990262c134 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8536d expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639005.587368:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375f54e00, rc 0) 00000100:00100000:0.0:1788639005.587433:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370fff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+9:6163:x1875523754001536:12345-192.168.206.18@tcp:101: Request processed in 172us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639005.587440:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 189 00000100:00100000:2.0:1788639005.591470:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639005.591582:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754001664 00000100:00100000:0.0:1788639005.591595:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754001664 00000100:00100000:0.0:1788639005.591913:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 190 00000100:00100000:0.0:1788639005.591926:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+9:6163:x1875523754001664:12345-192.168.206.18@tcp:256: 20000000:01000000:0.0:1788639005.591979:0:6511:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788639005.592000:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788639005.592005:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788639005.592009:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788639005.592012:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788639005.592015:0:6511:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1788639005.593992:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+9:6163:x1875523754001664:12345-192.168.206.18@tcp:256: Request processed in 2054us (2521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639005.594007:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 190 00000100:00100000:3.0:1788639005.600782:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639005.601000:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754001792 00000100:00100000:2.0:1788639005.601013:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754001792 00000100:00100000:2.0:1788639005.601097:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 191 00000100:00100000:2.0:1788639005.601109:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+9:6163:x1875523754001792:12345-192.168.206.18@tcp:101: 00010000:00010000:2.0:1788639005.601128:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639005.601150:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae242f22e00/0x25c454990262c13b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85374 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639005.601184:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae242f22e00/0x25c454990262c13b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85374 expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639005.601196:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae242f22e00/0x25c454990262c13b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85374 expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639005.601206:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f22e00, rc 0) 00000100:00100000:2.0:1788639005.601273:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+10:6163:x1875523754001792:12345-192.168.206.18@tcp:101: Request processed in 166us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639005.601280:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 191 00000100:00100000:3.0:1788639005.604956:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639005.605137:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754001920 00000100:00100000:0.0:1788639005.605150:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754001920 00000100:00100000:0.0:1788639005.605217:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 192 00000100:00100000:0.0:1788639005.605229:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae369901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+10:6163:x1875523754001920:12345-192.168.206.18@tcp:501: 00000100:00100000:0.0:1788639005.605538:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae369901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+10:6163:x1875523754001920:12345-192.168.206.18@tcp:501: Request processed in 309us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639005.605546:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 192 00000100:00100000:3.0:1788639005.607826:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639005.608120:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754002048 00000100:00100000:0.0:1788639005.608131:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754002048 00000100:00100000:0.0:1788639005.608261:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 193 00000100:00100000:0.0:1788639005.608272:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae369903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+10:6163:x1875523754002048:12345-192.168.206.18@tcp:503: 00000100:00100000:0.0:1788639005.608455:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae369903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+10:6163:x1875523754002048:12345-192.168.206.18@tcp:503: Request processed in 184us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639005.608463:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 193 00000100:00100000:1.0:1788639005.611021:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639005.611138:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754002176 00000100:00100000:0.0:1788639005.611151:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754002176 00000100:00100000:0.0:1788639005.611280:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 194 00000100:00100000:0.0:1788639005.611292:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae369902c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+10:6186:x1875523754002176:12345-192.168.206.18@tcp:502: 00000100:00100000:0.0:1788639005.611501:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae369902c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+10:6186:x1875523754002176:12345-192.168.206.18@tcp:502: Request processed in 211us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639005.611509:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 194 00000100:00100000:3.0:1788639005.614086:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639005.614237:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754002304 00000100:00100000:2.0:1788639005.614251:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754002304 00000100:00100000:2.0:1788639005.614322:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 195 00000100:00100000:2.0:1788639005.614334:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae369902850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+10:6186:x1875523754002304:12345-192.168.206.18@tcp:502: 00000100:00100000:2.0:1788639005.614730:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae369902850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+10:6186:x1875523754002304:12345-192.168.206.18@tcp:502: Request processed in 397us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639005.614740:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 195 00000100:00100000:3.0:1788639005.618243:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639005.618304:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639005.619011:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754002432 00000100:00100000:0.0:1788639005.619025:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754002432 00000100:00100000:0.0:1788639005.619096:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754002688 00000100:00100000:0.0:1788639005.619100:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754002688 00000100:00100000:0.0:1788639005.619119:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 7 00000100:00100000:0.0:1788639005.619128:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242efa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2404:x1875523754002432:12345-192.168.206.18@tcp:38: 00010000:00080000:0.0:1788639005.619170:0:6517:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 5deb128c-4fe3-4f51-b21e-f30846e08445@192.168.206.18@tcp t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:0.0:1788639005.619233:0:6517:0:(genops.c:1385:class_connect()) connect: client 5deb128c-4fe3-4f51-b21e-f30846e08445, cookie 0x25c454990262c142 00000004:00100000:0.0:1788639005.619265:0:6517:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788639005.619534:0:6517:0:(import.c:65:import_set_state_nolock()) ffff9ae2431e5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788639005.619671:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242efa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2404:x1875523754002432:12345-192.168.206.18@tcp:38: Request processed in 541us (1443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639005.619680:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 7 00000100:00100000:0.0:1788639005.619704:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 8 00000100:00100000:0.0:1788639005.619709:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242efaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2404:x1875523754002688:12345-192.168.206.18@tcp:38: 00010000:00080000:0.0:1788639005.619727:0:6517:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 5deb128c-4fe3-4f51-b21e-f30846e08445@192.168.206.18@tcp t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:0.0:1788639005.619767:0:6517:0:(genops.c:1385:class_connect()) connect: client 5deb128c-4fe3-4f51-b21e-f30846e08445, cookie 0x25c454990262c149 00000004:00100000:0.0:1788639005.619782:0:6517:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788639005.619953:0:6517:0:(import.c:65:import_set_state_nolock()) ffff9ae2431e4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788639005.619982:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242efaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2404:x1875523754002688:12345-192.168.206.18@tcp:38: Request processed in 271us (1676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639005.619989:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 8 00000100:00100000:0.0:1788639005.876945:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788639005.876979:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae360685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772925824:0@lo:13: 00000100:00100000:0.0:1788639005.877083:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639005.877272:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772925824 00000100:00100000:2.0:1788639005.877282:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772925824 00000100:00100000:2.0:1788639005.877363:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788639005.877374:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772925824:12345-0@lo:13: 00002000:00000024:2.0:1788639005.877401:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788639005.877456:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772925824:12345-0@lo:13: Request processed in 83us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639005.877463:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788639005.877568:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae360685500 x1875523772925824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639021 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639005.877590:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae360685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772925824:0@lo:13: 00000100:00100000:3.0:1788639005.877898:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788639005.877911:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772925952:0@lo:41: 00000100:00100000:3.0:1788639005.877952:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639005.878134:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772925952 00000100:00100000:2.0:1788639005.878140:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772925952 00000100:00100000:2.0:1788639005.878180:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788639005.878188:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae342e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772925952:12345-0@lo:41: 00000004:00000024:2.0:1788639005.878223:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788639005.878278:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae342e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772925952:12345-0@lo:41: Request processed in 91us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639005.878285:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788639005.878398:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772925952:0@lo:41: 00010000:00010000:3.0:1788639006.133135:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639006.389327:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788639006.389367:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772926080:0@lo:41: 00000100:00100000:3.0:1788639006.389472:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639006.390015:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772926080 00000100:00100000:2.0:1788639006.390026:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772926080 00000100:00100000:2.0:1788639006.390111:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788639006.390122:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae342e3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772926080:12345-0@lo:41: 00000004:00000024:2.0:1788639006.390167:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788639006.390232:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae342e3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772926080:12345-0@lo:41: Request processed in 111us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639006.390240:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788639006.391388:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772926080:0@lo:41: 00000100:00100000:1.0:1788639006.624769:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639006.624800:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639006.624896:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639006.624936:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754002944 00000100:00100000:1.0:1788639006.624947:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754002944 00000100:00100000:1.0:1788639006.625010:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754002560 00000100:00100000:1.0:1788639006.625013:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754002560 00000100:00100000:1.0:1788639006.625024:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754002816 00000100:00100000:1.0:1788639006.625026:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754002816 00000100:00100000:1.0:1788639006.625058:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 9 00000100:00100000:1.0:1788639006.625069:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+7:6163:x1875523754002944:12345-192.168.206.18@tcp:41: 00000004:00000024:1.0:1788639006.625119:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788639006.625195:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+7:6163:x1875523754002944:12345-192.168.206.18@tcp:41: Request processed in 127us (438us total) trans 0 rc 0/0 00000100:00080000:3.0:1788639006.625207:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788639006.625213:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788639006.625225:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 9 00000100:00100000:1.0:1788639006.625247:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 10 00000100:00100000:1.0:1788639006.625255:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+6:0:x1875523754002560:12345-192.168.206.18@tcp:41: 00000004:00000024:1.0:1788639006.625269:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788639006.625293:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+6:0:x1875523754002560:12345-192.168.206.18@tcp:41: Request processed in 40us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639006.625299:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 10 00000100:00100000:1.0:1788639006.625311:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 11 00000100:00100000:1.0:1788639006.625317:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+6:0:x1875523754002816:12345-192.168.206.18@tcp:41: 00000004:00000024:1.0:1788639006.625327:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788639006.625348:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+6:0:x1875523754002816:12345-192.168.206.18@tcp:41: Request processed in 32us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639006.625354:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 11 00000100:00100000:3.0:1788639006.632013:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639006.632341:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754003072 00000100:00100000:1.0:1788639006.632355:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754003072 00000100:00100000:1.0:1788639006.632482:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 12 00000100:00100000:1.0:1788639006.632495:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae342e3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+6:6163:x1875523754003072:12345-192.168.206.18@tcp:40: 00000100:00100000:1.0:1788639006.632668:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae342e3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+6:6163:x1875523754003072:12345-192.168.206.18@tcp:40: Request processed in 175us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639006.632676:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 12 00000100:00100000:3.0:1788639006.636236:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639006.636300:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639006.636665:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754003456 00000100:00100000:0.0:1788639006.636679:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754003456 00000100:00100000:0.0:1788639006.636764:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 4 00000100:00100000:0.0:1788639006.636777:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5deb128c-4fe3-4f51-b21e-f30846e08445+6:6163:x1875523754003456:12345-192.168.206.18@tcp:900: 00000100:00100000:0.0:1788639006.636897:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5deb128c-4fe3-4f51-b21e-f30846e08445+6:6163:x1875523754003456:12345-192.168.206.18@tcp:900: Request processed in 122us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639006.636906:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 4 00000100:00100000:0.0:1788639006.636937:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754003584 00000100:00100000:0.0:1788639006.636941:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754003584 00000100:00100000:0.0:1788639006.636970:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 196 00000100:00100000:0.0:1788639006.636976:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae369903c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+10:2406:x1875523754003584:12345-192.168.206.18@tcp:400: 00000100:00100000:0.0:1788639006.637004:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae369903c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+10:2406:x1875523754003584:12345-192.168.206.18@tcp:400: Request processed in 28us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639006.637010:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 196 00000100:00100000:0.0:1788639006.643242:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639006.643296:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639006.645821:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754003200 00000100:00100000:3.0:1788639006.645842:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754003200 00000100:00100000:3.0:1788639006.645910:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754003328 00000100:00100000:3.0:1788639006.645914:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754003328 00000100:00100000:3.0:1788639006.645944:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 16 00000100:00100000:3.0:1788639006.645955:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2404:x1875523754003200:12345-192.168.206.18@tcp:8: 00010000:00080000:3.0:1788639006.646017:0:8432:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 5deb128c-4fe3-4f51-b21e-f30846e08445@192.168.206.18@tcp t0 exp 0000000000000000 cur 265 last 0 00000020:00000080:3.0:1788639006.646067:0:8432:0:(genops.c:1385:class_connect()) connect: client 5deb128c-4fe3-4f51-b21e-f30846e08445, cookie 0x25c454990262c150 00002000:00100000:3.0:1788639006.646082:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5deb128c-4fe3-4f51-b21e-f30846e08445/ffff9ae2416e8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788639006.646104:0:8432:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788639006.646539:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788639006.646687:0:8432:0:(import.c:65:import_set_state_nolock()) ffff9ae2416e8000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788639006.646841:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2404:x1875523754003200:12345-192.168.206.18@tcp:8: Request processed in 886us (3613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639006.646850:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 16 00000100:00100000:3.0:1788639006.646874:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 17 00000100:00100000:3.0:1788639006.646880:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2404:x1875523754003328:12345-192.168.206.18@tcp:8: 00010000:00080000:3.0:1788639006.646904:0:8432:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 5deb128c-4fe3-4f51-b21e-f30846e08445@192.168.206.18@tcp t0 exp 0000000000000000 cur 265 last 0 00000020:00000080:3.0:1788639006.646924:0:8432:0:(genops.c:1385:class_connect()) connect: client 5deb128c-4fe3-4f51-b21e-f30846e08445, cookie 0x25c454990262c157 00002000:00100000:3.0:1788639006.646932:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5deb128c-4fe3-4f51-b21e-f30846e08445/ffff9ae2416ef000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788639006.646939:0:8432:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788639006.647655:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788639006.647705:0:8432:0:(import.c:65:import_set_state_nolock()) ffff9ae2416ea000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788639006.647768:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2404:x1875523754003328:12345-192.168.206.18@tcp:8: Request processed in 886us (4471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639006.647779:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 17 00000100:00100000:2.0:1788639006.651242:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639006.651319:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754003712 00000100:00100000:2.0:1788639006.651332:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754003712 00000100:00100000:2.0:1788639006.651388:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 0 00000100:00100000:2.0:1788639006.651401:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae360687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+6:6163:x1875523754003712:12345-192.168.206.18@tcp:33: 00000004:00080000:2.0:1788639006.677888:0:6519:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 26353us 00000004:00200000:3.0:1788639006.722982:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788639006.723126:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae360687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+6:6163:x1875523754003712:12345-192.168.206.18@tcp:33: Request processed in 71722us (71902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639006.723141:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 0 00000100:00100000:3.0:1788639006.972500:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639006.972681:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754003840 00000100:00100000:0.0:1788639006.972701:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754003840 00000100:00100000:0.0:1788639006.972799:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 13 00000100:00100000:0.0:1788639006.972811:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+6:6204:x1875523754003840:12345-192.168.206.18@tcp:101: 00010000:00010000:0.0:1788639006.972862:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639006.973772:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375f54c00/0x25c454990262c15e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e853a5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639006.974129:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375f55200/0x25c454990262c165 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639006.974144:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375f55200/0x25c454990262c165 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639006.974161:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375f55200/0x25c454990262c165 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788639006.974209:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788639006.974409:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788639006.974428:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375f55200/0x25c454990262c165 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639006.974455:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375f54c00/0x25c454990262c15e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e853a5 expref: 8 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639006.974473:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375f55200/0x25c454990262c165 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e853a5 expref: 7 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639006.974549:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae375d62d00) 00010000:00010000:0.0:1788639006.974552:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788639006.974556:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375f55200, rc 0) 00000100:00100000:0.0:1788639006.974859:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+7:6204:x1875523754003840:12345-192.168.206.18@tcp:101: Request processed in 2047us (2373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639006.974869:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 13 00010000:00010000:0.0:1788639007.158133:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639007.925393:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae360686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772926336:0@lo:13: 00000100:00100000:0.0:1788639007.925487:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639007.925521:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772926208:0@lo:13: 00000100:00100000:3.0:1788639007.925563:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639007.925677:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772926336 00000100:00100000:0.0:1788639007.925688:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772926336 00000100:00100000:2.0:1788639007.925753:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772926208 00000100:00100000:2.0:1788639007.925758:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772926208 00000100:00100000:0.0:1788639007.933401:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788639007.933425:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772926336:12345-0@lo:13: 00002000:00000024:0.0:1788639007.933464:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788639007.933570:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772926336:12345-0@lo:13: Request processed in 154us (8083us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639007.933578:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788639007.933598:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788639007.933604:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772926208:12345-0@lo:13: 00002000:00000024:0.0:1788639007.933630:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788639007.933661:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772926208:12345-0@lo:13: Request processed in 58us (8099us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639007.933667:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788639007.933722:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae360686680 x1875523772926336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639023 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639007.933748:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae360686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772926336:0@lo:13: 00000100:00080000:0.0:1788639007.933817:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788639007.933951:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae24233df80 x1875523772926208/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639023 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639007.934104:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772926208:0@lo:13: 00010000:00010000:3.0:1788639008.183702:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639008.977580:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639008.977831:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754003968 00000100:00100000:3.0:1788639008.977843:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754003968 00000100:00100000:3.0:1788639008.977929:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 14 00000100:00100000:3.0:1788639008.977942:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36e148700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+7:6256:x1875523754003968:12345-192.168.206.18@tcp:41: 00000004:00000024:3.0:1788639008.977995:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00080000:0.0:1788639008.978154:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788639008.978399:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36e148700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+7:6256:x1875523754003968:12345-192.168.206.18@tcp:41: Request processed in 456us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639008.978409:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 14 00000100:00100000:2.0:1788639008.985120:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639008.985338:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754004096 00000100:00100000:0.0:1788639008.985352:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754004096 00000100:00100000:0.0:1788639008.985446:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 15 00000100:00100000:0.0:1788639008.985459:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae360685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+6:6256:x1875523754004096:12345-192.168.206.18@tcp:41: 00000004:00000024:0.0:1788639008.985510:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788639008.985678:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae360685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+6:6256:x1875523754004096:12345-192.168.206.18@tcp:41: Request processed in 221us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639008.985686:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 15 00000100:00080000:3.0:1788639008.985941:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788639008.998609:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639008.998777:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754004224 00000100:00100000:2.0:1788639008.998793:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754004224 00000100:00100000:2.0:1788639008.998897:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 16 00000100:00100000:2.0:1788639008.998909:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5deb128c-4fe3-4f51-b21e-f30846e08445+6:6256:x1875523754004224:12345-192.168.206.18@tcp:13: 00002000:00000024:2.0:1788639008.998957:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788639008.999062:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5deb128c-4fe3-4f51-b21e-f30846e08445+6:6256:x1875523754004224:12345-192.168.206.18@tcp:13: Request processed in 154us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639008.999071:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 16 00000100:00080000:3.0:1788639008.999311:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788639009.002794:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639009.003334:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754004352 00000100:00100000:2.0:1788639009.003348:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754004352 00000100:00100000:2.0:1788639009.003447:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 17 00000100:00100000:2.0:1788639009.003462:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36e148a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5deb128c-4fe3-4f51-b21e-f30846e08445+6:6256:x1875523754004352:12345-192.168.206.18@tcp:13: 00002000:00000024:2.0:1788639009.003507:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1788639009.003777:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788639009.003946:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36e148a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5deb128c-4fe3-4f51-b21e-f30846e08445+6:6256:x1875523754004352:12345-192.168.206.18@tcp:13: Request processed in 486us (1166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639009.003957:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 17 00010000:00010000:1.0:1788639009.208241:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639010.230091:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639010.486204:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788639010.487027:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523772926592:0@lo:400: 00000100:00100000:2.0:1788639010.487135:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639010.487233:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788639010.487247:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24319aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772926720:0@lo:400: 00000100:00100000:2.0:1788639010.487285:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639010.487356:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e14ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772926976:0@lo:13: 00000100:00100000:2.0:1788639010.487387:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639010.487410:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788639010.487416:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24319a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523772926848:0@lo:400: 00000100:00100000:2.0:1788639010.487439:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639010.487471:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772926592 00000100:00100000:2.0:1788639010.487480:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772926592 00000100:00100000:2.0:1788639010.487564:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772926848 00000100:00100000:2.0:1788639010.487568:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772926848 00000100:00100000:2.0:1788639010.487594:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788639010.487602:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae360687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523772926592:12345-0@lo:400: 00000100:00100000:2.0:1788639010.487695:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae360687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523772926592:12345-0@lo:400: Request processed in 93us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639010.487703:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788639010.487723:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788639010.487730:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae360684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523772926848:12345-0@lo:400: 00000100:00100000:2.0:1788639010.487762:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae360684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523772926848:12345-0@lo:400: Request processed in 33us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639010.487768:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788639010.487808:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772926720 00000100:00100000:2.0:1788639010.487813:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772926720 00000100:00100000:2.0:1788639010.487852:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788639010.487859:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae360684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772926720:12345-0@lo:400: 00000100:00100000:2.0:1788639010.487900:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae360684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772926720:12345-0@lo:400: Request processed in 41us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639010.487906:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788639010.487943:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772926976 00000100:00100000:2.0:1788639010.487947:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772926976 00000100:00100000:2.0:1788639010.488007:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788639010.488014:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae360685880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772926976:12345-0@lo:13: 00002000:00000024:2.0:1788639010.488051:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788639010.488098:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae360685880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772926976:12345-0@lo:13: Request processed in 85us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639010.488105:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788639010.488168:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24319aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772926720:0@lo:400: 00000100:00100000:2.0:1788639010.488190:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523772926592:0@lo:400: 00000100:00100000:2.0:1788639010.488297:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24319a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523772926848:0@lo:400: 00010000:00080000:2.0:1788639010.488312:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae36e14ad80 x1875523772926976/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639026 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639010.488340:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e14ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772926976:0@lo:13: 00000100:00080000:2.0:1788639010.488368:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788639010.494224:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772926464:0@lo:400: 00000100:00100000:2.0:1788639010.494356:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639010.494705:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772926464 00000100:00100000:3.0:1788639010.494717:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772926464 00000100:00100000:3.0:1788639010.494783:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788639010.494795:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae369900050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+24:3641:x1875523772926464:12345-0@lo:400: 00000100:00100000:3.0:1788639010.494864:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae369900050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+24:3641:x1875523772926464:12345-0@lo:400: Request processed in 71us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639010.494885:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788639010.495119:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772927104:0@lo:400: 00000100:00100000:0.0:1788639010.495161:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639010.495209:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772927104 00000100:00100000:0.0:1788639010.495213:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772927104 00000100:00100000:0.0:1788639010.495257:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788639010.495266:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772927104:12345-0@lo:400: 00000100:00100000:0.0:1788639010.495323:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772927104:12345-0@lo:400: Request processed in 58us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639010.495344:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788639010.495391:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772927104:0@lo:400: 00000100:00100000:0.0:1788639010.495446:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875523772927232:0@lo:400: 00000100:00100000:0.0:1788639010.495505:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639010.496057:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772927232 00000100:00100000:0.0:1788639010.496063:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772927232 00000100:00100000:0.0:1788639010.496278:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788639010.496286:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875523772927232:12345-0@lo:400: 00000100:00080000:3.0:1788639010.496394:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788639010.496511:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875523772927232:12345-0@lo:400: Request processed in 225us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639010.496519:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788639010.496575:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788639010.496585:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24319b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875523772927360:0@lo:400: 00000100:00100000:0.0:1788639010.496640:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639010.496682:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772927360 00000100:00100000:0.0:1788639010.496687:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772927360 00000100:00100000:0.0:1788639010.496718:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788639010.496724:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24319a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875523772927360:12345-0@lo:400: 00000100:00100000:0.0:1788639010.496759:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24319a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875523772927360:12345-0@lo:400: Request processed in 35us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639010.496765:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1788639010.496779:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788639010.496804:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae24319b800 x1875523772927360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639010.496818:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24319b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875523772927360:0@lo:400: 00000100:00100000:0.0:1788639010.496859:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24319b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772927488:0@lo:400: 00000100:00100000:0.0:1788639010.496901:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639010.496934:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772927488 00000100:00100000:0.0:1788639010.496938:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772927488 00000100:00100000:0.0:1788639010.496974:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788639010.496981:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243199c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772927488:12345-0@lo:400: 00000100:00100000:0.0:1788639010.497033:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243199c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772927488:12345-0@lo:400: Request processed in 40us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639010.497041:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1788639010.497061:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788639010.497093:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae24319b800 x1875523772927488/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639010.497104:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24319b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772927488:0@lo:400: 00000100:00100000:0.0:1788639010.497137:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24319b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772927616:0@lo:400: 00000100:00100000:0.0:1788639010.497164:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639010.497204:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772927616 00000100:00100000:0.0:1788639010.497208:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772927616 00000100:00100000:0.0:1788639010.497241:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788639010.497248:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24319b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772927616:12345-0@lo:400: 00000100:00100000:0.0:1788639010.497308:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24319b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772927616:12345-0@lo:400: Request processed in 59us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639010.497316:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788639010.497350:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788639010.497366:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae24319b800 x1875523772927616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639010.497376:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24319b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772927616:0@lo:400: 00000100:00100000:0.0:1788639010.497405:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788639010.497412:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24319b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875523772927744:0@lo:400: 00000100:00100000:0.0:1788639010.497445:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639010.497471:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772927744 00000100:00100000:0.0:1788639010.497475:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772927744 00000100:00100000:0.0:1788639010.497508:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788639010.497514:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243198380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875523772927744:12345-0@lo:400: 00000100:00100000:0.0:1788639010.497548:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243198380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875523772927744:12345-0@lo:400: Request processed in 35us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639010.497553:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1788639010.497568:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788639010.497587:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24319b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875523772927744:0@lo:400: 00000100:00100000:0.0:1788639010.497641:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788639010.497650:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24319b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875523772927872:0@lo:400: 00000100:00100000:0.0:1788639010.497692:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639010.497717:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772927872 00000100:00100000:0.0:1788639010.497727:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772927872 00000100:00100000:0.0:1788639010.497756:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788639010.497763:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243199880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875523772927872:12345-0@lo:400: 00000100:00100000:0.0:1788639010.497797:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243199880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875523772927872:12345-0@lo:400: Request processed in 35us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639010.497803:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1788639010.497818:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788639010.497834:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae24319b800 x1875523772927872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639010.497843:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24319b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875523772927872:0@lo:400: 00000100:00100000:0.0:1788639010.497873:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24319b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772928000:0@lo:400: 00000100:00100000:0.0:1788639010.497897:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639010.497922:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772928000 00000100:00100000:0.0:1788639010.497927:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772928000 00000100:00100000:0.0:1788639010.497954:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788639010.497960:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243198000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772928000:12345-0@lo:400: 00000100:00100000:0.0:1788639010.497996:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243198000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772928000:12345-0@lo:400: Request processed in 36us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639010.498003:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1788639010.498031:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788639010.498048:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae24319b800 x1875523772928000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639010.498058:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24319b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772928000:0@lo:400: 00000100:00100000:2.0:1788639010.498682:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772926464:0@lo:400: 00000100:00100000:3.0:1788639010.506981:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875523772927232:0@lo:400: 00000100:00100000:3.0:1788639010.996954:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788639010.996994:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e14bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772928128:0@lo:41: 00000100:00100000:3.0:1788639010.997100:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639010.997319:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772928128 00000100:00100000:2.0:1788639010.997329:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772928128 00000100:00100000:2.0:1788639010.997395:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788639010.997408:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772928128:12345-0@lo:41: 00000004:00000024:2.0:1788639010.997450:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788639010.997514:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772928128:12345-0@lo:41: Request processed in 107us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639010.997521:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788639010.997595:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e14bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772928128:0@lo:41: 00000100:00100000:0.0:1788639011.000475:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788639011.000521:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772928256:0@lo:13: 00000100:00100000:0.0:1788639011.000641:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639011.002668:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772928256 00000100:00100000:2.0:1788639011.002690:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772928256 00000100:00100000:2.0:1788639011.002778:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788639011.002793:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24319b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772928256:12345-0@lo:13: 00002000:00000024:2.0:1788639011.002824:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788639011.002922:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24319b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772928256:12345-0@lo:13: Request processed in 133us (2307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639011.002932:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1788639011.002977:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f68700 x1875523772928256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639026 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639011.003004:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772928256:0@lo:13: 00000001:00100000:3.0:1788639011.006510:0:6494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5deb128c-4fe3-4f51-b21e-f30846e08445 00000001:00100000:1.0:1788639011.007234:0:9509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5deb128c-4fe3-4f51-b21e-f30846e08445 00000001:00100000:0.0:1788639011.008039:0:7446:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 5deb128c-4fe3-4f51-b21e-f30846e08445 00010000:00010000:3.0:1788639011.253743:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639011.509030:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772928384:0@lo:41: 00000100:00100000:2.0:1788639011.509131:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639011.509432:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772928384 00000100:00100000:3.0:1788639011.509443:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772928384 00000100:00100000:3.0:1788639011.509510:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788639011.509522:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae360684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772928384:12345-0@lo:41: 00000004:00000024:3.0:1788639011.509566:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788639011.509651:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae360684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772928384:12345-0@lo:41: Request processed in 132us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639011.509659:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788639011.509776:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772928384:0@lo:41: 00000100:00100000:3.0:1788639011.806934:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639011.806991:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639011.807046:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639011.807083:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639011.807114:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639011.807152:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754004608 00000100:00100000:3.0:1788639011.807166:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754004608 00000100:00100000:3.0:1788639011.807249:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754004736 00000100:00100000:3.0:1788639011.807253:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754004736 00000100:00100000:3.0:1788639011.807279:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 51 00000100:00100000:2.0:1788639011.807422:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754004864 00000100:00100000:2.0:1788639011.807428:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754004864 00000100:00100000:2.0:1788639011.807469:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754004992 00000100:00100000:2.0:1788639011.807473:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754004992 00000100:00100000:2.0:1788639011.807522:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 14 00000100:00100000:2.0:1788639011.807532:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2406:x1875523754004864:12345-192.168.206.18@tcp:400: 00000100:00100000:2.0:1788639011.807688:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2406:x1875523754004864:12345-192.168.206.18@tcp:400: Request processed in 158us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639011.807697:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 14 00000100:00100000:2.0:1788639011.807719:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 15 00000100:00100000:2.0:1788639011.807725:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36d1abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2406:x1875523754004992:12345-192.168.206.18@tcp:400: 00000100:00100000:2.0:1788639011.807749:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36d1abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2406:x1875523754004992:12345-192.168.206.18@tcp:400: Request processed in 24us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639011.807755:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 15 00000100:00080000:2.0:1788639011.807954:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788639011.807959:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788639011.807962:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788639011.807964:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788639011.807987:0:6518:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788639011.807996:0:6518:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788639011.808140:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 52 00000100:00100000:2.0:1788639011.808149:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3691a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2406:x1875523754004736:12345-192.168.206.18@tcp:400: 00000100:00100000:2.0:1788639011.808189:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3691a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2406:x1875523754004736:12345-192.168.206.18@tcp:400: Request processed in 42us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639011.808195:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 52 00000100:00100000:0.0:1788639011.808482:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754004480 00000100:00100000:3.0:1788639011.808683:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2406:x1875523754004608:12345-192.168.206.18@tcp:400: 00000100:00100000:3.0:1788639011.808870:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2406:x1875523754004608:12345-192.168.206.18@tcp:400: Request processed in 1580us (1954us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639011.808893:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 51 00000100:00100000:0.0:1788639011.809049:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754004480 00000100:00100000:0.0:1788639011.809099:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 198 00000100:00100000:0.0:1788639011.809108:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae369900850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+10:2406:x1875523754004480:12345-192.168.206.18@tcp:400: 00000100:00100000:0.0:1788639011.809147:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae369900850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+10:2406:x1875523754004480:12345-192.168.206.18@tcp:400: Request processed in 42us (2102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639011.809153:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 198 00000001:02000400:0.0:1788639011.974076:0:10182:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1788639012.024992:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5deb128c-4fe3-4f51-b21e-f30846e08445 00010000:00010000:0.0:1788639012.279077:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639013.045241:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788639013.045282:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae360684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772928512:0@lo:13: 00000100:00100000:1.0:1788639013.045379:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639013.045813:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e149180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772928640:0@lo:13: 00000100:00100000:3.0:1788639013.045854:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639013.045946:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772928512 00000100:00100000:1.0:1788639013.045957:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772928512 00000100:00100000:1.0:1788639013.046035:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772928640 00000100:00100000:1.0:1788639013.046039:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772928640 00000100:00100000:1.0:1788639013.046063:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788639013.046074:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36e14b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772928512:12345-0@lo:13: 00002000:00000024:1.0:1788639013.046113:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788639013.046171:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36e14b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772928512:12345-0@lo:13: Request processed in 98us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639013.046178:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788639013.046198:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788639013.046204:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36d1a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772928640:12345-0@lo:13: 00002000:00000024:1.0:1788639013.046215:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788639013.046244:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36d1a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772928640:12345-0@lo:13: Request processed in 41us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639013.046250:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1788639013.046291:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae36e149180 x1875523772928640/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639029 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639013.046312:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e149180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772928640:0@lo:13: 00010000:00080000:1.0:1788639013.046344:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae360684a80 x1875523772928512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639029 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639013.046356:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae360684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772928512:0@lo:13: 00000100:00080000:3.0:1788639013.046825:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788639013.300881:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639014.326820:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639015.351169:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788639015.580181:0:10329:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffb1b95690 20000000:00000080:2.0:1788639015.580206:0:10329:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ae375ef1000 uarg=0000000000000000 20000000:01000000:2.0:1788639015.580275:0:10329:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1788639015.580278:0:10329:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1788639015.580281:0:10329:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788639015.580288:0:10329:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788639015.580294:0:10329:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1788639015.580369:0:10329:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788639015.580372:0:10329:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788639015.580913:0:10330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:2.0:1788639015.581218:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:2.0:1788639015.581258:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:2.0:1788639015.581275:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:2.0:1788639015.581285:0:10329:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788639015.581287:0:10329:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788639015.581585:0:10331:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:2.0:1788639015.582066:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:2.0:1788639015.582093:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:2.0:1788639015.582110:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:2.0:1788639015.582121:0:10329:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788639015.582123:0:10329:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788639015.582430:0:10332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:2.0:1788639015.582608:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:2.0:1788639015.583070:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:2.0:1788639015.583088:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:2.0:1788639015.583102:0:10329:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788639015.583105:0:10329:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788639015.583436:0:10333:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:2.0:1788639015.583610:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:2.0:1788639015.583823:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:2.0:1788639015.583838:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:2.0:1788639015.583849:0:10329:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788639015.583851:0:10329:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788639015.584214:0:10334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:2.0:1788639015.584368:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:2.0:1788639015.584388:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:2.0:1788639015.584404:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 10000000:01000000:2.0:1788639015.584420:0:10329:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788639015.584446:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ae242f23800/0x25c454990262c16c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639015.584468:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae38217b000/0x25c454990262c007 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c000 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639015.584476:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae38217a800/0x25c454990262c031 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c02a expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639015.584485:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae375f55a00/0x25c454990262c070 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c069 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639015.584494:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae38217be00/0x25c454990262c07e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c077 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639015.584502:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae38217b800/0x25c454990262c08c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c085 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639015.584509:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae375f54a00/0x25c454990262c0a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c0a1 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639015.584525:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae3750fbe00/0x25c454990262c0d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c0cb expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639015.584532:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae375f55e00/0x25c454990262c0ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c0e7 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639015.584539:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae3750fa800/0x25c454990262c118 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c111 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639015.584550:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae375f54400/0x25c454990262c126 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85335 expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639015.584559:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae3750fb200/0x25c454990262c12d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8533c expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639015.584567:0:10329:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ae242f23800/0x25c454990262c16c lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639015.584731:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae3750fb200/0x25c454990262c12d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8533c expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639015.584750:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae3750fb200/0x25c454990262c12d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8533c expref: 9 pid: 6510 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639015.584768:0:10329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae360684a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1875523772928768:192.168.206.18@tcp:104: 00010000:00010000:2.0:1788639015.584950:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae375f54400/0x25c454990262c126 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85335 expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639015.584959:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae375f54400/0x25c454990262c126 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85335 expref: 9 pid: 6511 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639015.584975:0:10329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae360686680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1875523772928896:192.168.206.18@tcp:104: 00010000:00010000:2.0:1788639015.585022:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae3750fa800/0x25c454990262c118 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262c111 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639015.585030:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ae3750fa800/0x25c454990262c118 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262c111 expref: 23 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639015.585040:0:10329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae360685500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1875523772929024:0@lo:104: 00000100:00100000:2.0:1788639015.585087:0:10329:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788639015.585130:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae375f55e00/0x25c454990262c0ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262c0e7 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639015.585139:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ae375f55e00/0x25c454990262c0ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262c0e7 expref: 23 pid: 6508 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639015.585148:0:10329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae360687b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1875523772929152:0@lo:104: 00000100:00100000:2.0:1788639015.585170:0:10329:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788639015.585219:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae3750fbe00/0x25c454990262c0d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262c0cb expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639015.585228:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ae3750fbe00/0x25c454990262c0d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262c0cb expref: 23 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639015.585236:0:10329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1875523772929280:0@lo:104: 00000100:00100000:2.0:1788639015.585272:0:10329:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788639015.585291:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae375f54a00/0x25c454990262c0a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262c0a1 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639015.585311:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ae375f54a00/0x25c454990262c0a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262c0a1 expref: 23 pid: 6508 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639015.585320:0:10329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1875523772929408:0@lo:104: 00000100:00100000:2.0:1788639015.585347:0:10329:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788639015.585363:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae38217b800/0x25c454990262c08c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262c085 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639015.585371:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ae38217b800/0x25c454990262c08c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262c085 expref: 23 pid: 6508 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639015.585379:0:10329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1875523772929536:0@lo:104: 00010000:00010000:2.0:1788639015.585398:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae38217be00/0x25c454990262c07e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262c077 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639015.585406:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ae38217be00/0x25c454990262c07e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262c077 expref: 23 pid: 6508 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639015.585412:0:10329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1875523772929664:0@lo:104: 00010000:00010000:2.0:1788639015.585431:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae375f55a00/0x25c454990262c070 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262c069 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639015.585438:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ae375f55a00/0x25c454990262c070 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262c069 expref: 23 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639015.585445:0:10329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1875523772929792:0@lo:104: 00010000:00010000:2.0:1788639015.585467:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae38217a800/0x25c454990262c031 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262c02a expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639015.585484:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ae38217a800/0x25c454990262c031 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262c02a expref: 23 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639015.585492:0:10329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1875523772929920:0@lo:104: 00010000:00010000:2.0:1788639015.585517:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae38217b000/0x25c454990262c007 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262c000 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639015.585525:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ae38217b000/0x25c454990262c007 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262c000 expref: 23 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639015.585533:0:10329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1875523772930048:0@lo:104: 00000100:00100000:2.0:1788639015.585550:0:10329:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344398480 going to sleep for 11 seconds 00000100:00100000:0.0:1788639015.585666:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788639015.585688:0:6499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639015.585700:0:6499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639015.585708:0:6499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639015.585716:0:6499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639015.585725:0:6499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639015.585735:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772929024 00000100:00100000:0.0:1788639015.585743:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772929024 00000100:00100000:0.0:1788639015.585790:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772929152 00000100:00100000:0.0:1788639015.585794:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772929152 00000100:00100000:0.0:1788639015.585805:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772929280 00000100:00100000:0.0:1788639015.585814:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772929280 00000100:00100000:0.0:1788639015.585827:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772929408 00000100:00100000:0.0:1788639015.585829:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772929408 00000100:00100000:0.0:1788639015.585838:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772929536 00000100:00100000:0.0:1788639015.585840:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772929536 00000100:00100000:0.0:1788639015.585849:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772929664 00000100:00100000:0.0:1788639015.585851:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772929664 00000100:00100000:0.0:1788639015.585859:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772929792 00000100:00100000:0.0:1788639015.585861:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772929792 00000100:00100000:0.0:1788639015.585869:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772929920 00000100:00100000:0.0:1788639015.585872:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772929920 00000100:00100000:0.0:1788639015.585880:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772930048 00000100:00100000:0.0:1788639015.585882:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772930048 00000100:00100000:0.0:1788639015.585896:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788639015.585905:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae360686d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+11:10329:x1875523772929024:12345-0@lo:104: 00010000:00010000:0.0:1788639015.585922:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae38217b600/0x25c454990262c111 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262c118 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.585984:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788639015.586001:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae360686d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+11:10329:x1875523772929024:12345-0@lo:104: Request processed in 88us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639015.586010:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788639015.586031:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788639015.586037:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+10:10329:x1875523772929152:12345-0@lo:104: 00010000:00010000:0.0:1788639015.586045:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4600/0x25c454990262c0e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262c0ee expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.586079:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788639015.586084:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+10:10329:x1875523772929152:12345-0@lo:104: Request processed in 48us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639015.586099:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788639015.586112:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788639015.586118:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+9:10329:x1875523772929280:12345-0@lo:104: 00010000:00010000:0.0:1788639015.586126:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb600/0x25c454990262c0cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262c0d2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.586156:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788639015.586160:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+9:10329:x1875523772929280:12345-0@lo:104: Request processed in 43us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639015.586165:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788639015.586174:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788639015.586179:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37d1edc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+8:10329:x1875523772929408:12345-0@lo:104: 00010000:00010000:0.0:1788639015.586185:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5800/0x25c454990262c0a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262c0a8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.586213:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788639015.586218:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37d1edc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+8:10329:x1875523772929408:12345-0@lo:104: Request processed in 39us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639015.586223:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788639015.586292:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788639015.586298:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243198700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+7:10329:x1875523772929536:12345-0@lo:104: 00010000:00010000:0.0:1788639015.586306:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae3750fba00/0x25c454990262c085 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262c08c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.586330:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788639015.586334:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243198700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+7:10329:x1875523772929536:12345-0@lo:104: Request processed in 37us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639015.586345:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788639015.586358:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788639015.586363:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243198a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+6:10329:x1875523772929664:12345-0@lo:104: 00010000:00010000:0.0:1788639015.586371:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4800/0x25c454990262c077 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262c07e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.586398:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1788639015.586403:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243198a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+6:10329:x1875523772929664:12345-0@lo:104: Request processed in 41us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639015.586409:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788639015.586420:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788639015.586425:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24319ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+5:10329:x1875523772929792:12345-0@lo:104: 00010000:00010000:0.0:1788639015.586433:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae375f55600/0x25c454990262c069 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262c070 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.586457:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1788639015.586463:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24319ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+5:10329:x1875523772929792:12345-0@lo:104: Request processed in 38us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639015.586468:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788639015.586480:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788639015.586486:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24319bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+4:10329:x1875523772929920:12345-0@lo:104: 00010000:00010000:0.0:1788639015.586493:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa400/0x25c454990262c02a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262c031 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.586516:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:0.0:1788639015.586521:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24319bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+4:10329:x1875523772929920:12345-0@lo:104: Request processed in 36us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639015.586889:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788639015.586903:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788639015.586910:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24319b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+3:10329:x1875523772930048:12345-0@lo:104: 00010000:00010000:0.0:1788639015.586920:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae375f55400/0x25c454990262c000 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262c007 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.586950:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:0.0:1788639015.586955:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24319b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+3:10329:x1875523772930048:12345-0@lo:104: Request processed in 47us (1229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639015.586961:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1788639015.586983:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1788639015.586990:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae38217b600/0x25c454990262c111 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262c118 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.587006:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae38217b600 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:0.0:1788639015.587011:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae38217b600/0x25c454990262c111 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262c118 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.587021:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae38217b600/0x25c454990262c111 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262c118 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788639015.587028:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae38217b600/0x25c454990262c111 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262c118 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639015.587034:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788639015.587080:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae38217b600/0x25c454990262c111 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c118 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.587087:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788639015.587115:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae38217b600/0x25c454990262c111 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c118 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.587122:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae38217b600/0x25c454990262c111 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c118 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.587138:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1788639015.587141:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4600/0x25c454990262c0e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262c0ee expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.587146:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3429e4600 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:0.0:1788639015.587149:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4600/0x25c454990262c0e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262c0ee expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.587154:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4600/0x25c454990262c0e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262c0ee expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788639015.587159:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4600/0x25c454990262c0e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262c0ee expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639015.587164:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788639015.587178:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4600/0x25c454990262c0e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c0ee expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.587184:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788639015.587198:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4600/0x25c454990262c0e7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c0ee expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.587204:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4600/0x25c454990262c0e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c0ee expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.587214:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788639015.587223:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb600/0x25c454990262c0cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262c0d2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.587229:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fb600 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:0.0:1788639015.587231:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb600/0x25c454990262c0cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262c0d2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.587238:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb600/0x25c454990262c0cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262c0d2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788639015.587244:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb600/0x25c454990262c0cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262c0d2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639015.587249:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788639015.587263:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb600/0x25c454990262c0cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c0d2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.587269:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788639015.587274:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb600/0x25c454990262c0cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c0d2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.587280:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb600/0x25c454990262c0cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c0d2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.587289:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788639015.587292:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5800/0x25c454990262c0a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262c0a8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.587297:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3429e5800 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:0.0:1788639015.587300:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5800/0x25c454990262c0a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262c0a8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.587317:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5800/0x25c454990262c0a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262c0a8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788639015.587324:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5800/0x25c454990262c0a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262c0a8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639015.587329:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788639015.587342:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5800/0x25c454990262c0a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c0a8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.587348:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788639015.587353:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5800/0x25c454990262c0a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c0a8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.587360:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5800/0x25c454990262c0a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c0a8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.587370:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788639015.587373:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae3750fba00/0x25c454990262c085 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262c08c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.587379:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fba00 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:0.0:1788639015.587382:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae3750fba00/0x25c454990262c085 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262c08c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.587388:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae3750fba00/0x25c454990262c085 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262c08c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788639015.587394:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae3750fba00/0x25c454990262c085 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262c08c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639015.587406:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788639015.587420:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae3750fba00/0x25c454990262c085 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c08c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.587426:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788639015.587431:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae3750fba00/0x25c454990262c085 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c08c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.587437:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae3750fba00/0x25c454990262c085 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c08c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.587445:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788639015.587449:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4800/0x25c454990262c077 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262c07e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.587454:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3429e4800 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:0.0:1788639015.587457:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4800/0x25c454990262c077 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262c07e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.587464:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4800/0x25c454990262c077 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262c07e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788639015.587470:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4800/0x25c454990262c077 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262c07e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639015.587476:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788639015.587486:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4800/0x25c454990262c077 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c07e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.587491:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788639015.587500:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4800/0x25c454990262c077 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c07e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.587507:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4800/0x25c454990262c077 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c07e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.587516:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788639015.587520:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae375f55600/0x25c454990262c069 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262c070 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.587526:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375f55600 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:0.0:1788639015.587529:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae375f55600/0x25c454990262c069 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262c070 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.587536:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae375f55600/0x25c454990262c069 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262c070 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788639015.587542:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae375f55600/0x25c454990262c069 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262c070 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639015.587548:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788639015.587558:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae375f55600/0x25c454990262c069 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c070 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.587563:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788639015.587566:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae375f55600/0x25c454990262c069 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c070 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.587572:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae375f55600/0x25c454990262c069 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c070 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.587581:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788639015.587589:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa400/0x25c454990262c02a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262c031 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.587594:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fa400 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:0.0:1788639015.587597:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa400/0x25c454990262c02a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262c031 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.587604:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa400/0x25c454990262c02a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262c031 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788639015.587609:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa400/0x25c454990262c02a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262c031 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639015.587644:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788639015.587658:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa400/0x25c454990262c02a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c031 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.587665:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788639015.587670:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa400/0x25c454990262c02a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c031 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.587677:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa400/0x25c454990262c02a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c031 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.587686:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639015.587689:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae375f55400/0x25c454990262c000 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262c007 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.587696:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375f55400 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:0.0:1788639015.587700:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae375f55400/0x25c454990262c000 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262c007 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.587717:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae375f55400/0x25c454990262c000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262c007 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788639015.587724:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae375f55400/0x25c454990262c000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262c007 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639015.587730:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788639015.587743:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae375f55400/0x25c454990262c000 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c007 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.587750:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788639015.587754:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae375f55400/0x25c454990262c000 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c007 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.587761:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae375f55400/0x25c454990262c000 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c007 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639015.587777:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639015.587779:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639015.587781:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639015.587815:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01f1eef9-e690-4065-bf99-bf821af7b626:3644:1875523772930176:0@lo:103: 00000100:00100000:0.0:1788639015.587868:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639015.587903:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01f1eef9-e690-4065-bf99-bf821af7b626:3644:1875523772930688:0@lo:103: 00000100:00100000:0.0:1788639015.587941:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639015.587959:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01f1eef9-e690-4065-bf99-bf821af7b626:3644:1875523772931200:0@lo:103: 00000100:00100000:0.0:1788639015.587978:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639015.588020:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788639015.588027:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24319aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01f1eef9-e690-4065-bf99-bf821af7b626:3644:1875523772930560:0@lo:103: 00000100:00100000:0.0:1788639015.588053:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639015.588064:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae360686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01f1eef9-e690-4065-bf99-bf821af7b626:3644:1875523772931072:0@lo:103: 00000100:00100000:0.0:1788639015.588080:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639015.588098:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24319a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01f1eef9-e690-4065-bf99-bf821af7b626:3642:1875523772930432:0@lo:103: 00000100:00100000:0.0:1788639015.588131:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639015.588142:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01f1eef9-e690-4065-bf99-bf821af7b626:3642:1875523772930944:0@lo:103: 00000100:00100000:0.0:1788639015.588161:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639015.588172:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788639015.588177:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01f1eef9-e690-4065-bf99-bf821af7b626:3642:1875523772930304:0@lo:103: 00000100:00100000:0.0:1788639015.588195:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639015.588204:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01f1eef9-e690-4065-bf99-bf821af7b626:3642:1875523772930816:0@lo:103: 00000100:00100000:0.0:1788639015.588220:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639015.588343:0:10329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae360685500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1875523772929024:0@lo:104: 00000100:00100000:2.0:1788639015.588356:0:10329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae360687b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1875523772929152:0@lo:104: 00000100:00100000:2.0:1788639015.588365:0:10329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1875523772929280:0@lo:104: 00000100:00100000:2.0:1788639015.588373:0:10329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1875523772929408:0@lo:104: 00000100:00100000:2.0:1788639015.588382:0:10329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1875523772929536:0@lo:104: 00000100:00100000:2.0:1788639015.588391:0:10329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1875523772929664:0@lo:104: 00000100:00100000:2.0:1788639015.588399:0:10329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1875523772929792:0@lo:104: 00000100:00100000:2.0:1788639015.588407:0:10329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1875523772929920:0@lo:104: 00000100:00100000:2.0:1788639015.588415:0:10329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1875523772930048:0@lo:104: 00010000:00010000:3.0:1788639015.588493:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639015.588501:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639015.588507:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639015.588521:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772930176 00000100:00100000:3.0:1788639015.588529:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772930176 00010000:00010000:3.0:1788639015.588561:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae3750fa800/0x25c454990262c118 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262c111 expref: 24 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639015.588581:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772930688 00000100:00100000:3.0:1788639015.588583:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772930688 00010000:00010000:3.0:1788639015.588594:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae38217b800/0x25c454990262c08c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262c085 expref: 25 pid: 6508 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639015.588604:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772931200 00000100:00100000:3.0:1788639015.588607:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772931200 00010000:00010000:3.0:1788639015.588651:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae38217b000/0x25c454990262c007 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262c000 expref: 26 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639015.588664:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772930560 00000100:00100000:3.0:1788639015.588666:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772930560 00010000:00010000:3.0:1788639015.588677:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae375f54a00/0x25c454990262c0a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262c0a1 expref: 27 pid: 6508 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639015.588687:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772931072 00000100:00100000:3.0:1788639015.588689:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772931072 00010000:00010000:3.0:1788639015.588709:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae38217a800/0x25c454990262c031 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262c02a expref: 28 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639015.588721:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772930432 00000100:00100000:3.0:1788639015.588723:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772930432 00010000:00010000:3.0:1788639015.588733:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae3750fbe00/0x25c454990262c0d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262c0cb expref: 29 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639015.588742:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772930944 00000100:00100000:3.0:1788639015.588744:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772930944 00010000:00010000:3.0:1788639015.588754:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae375f55a00/0x25c454990262c070 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262c069 expref: 30 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639015.588763:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772930304 00000100:00100000:3.0:1788639015.588765:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772930304 00010000:00010000:3.0:1788639015.588775:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae375f55e00/0x25c454990262c0ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262c0e7 expref: 31 pid: 6508 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639015.588784:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772930816 00000100:00100000:3.0:1788639015.588787:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772930816 00010000:00010000:3.0:1788639015.588797:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae38217be00/0x25c454990262c07e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262c077 expref: 32 pid: 6508 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639015.588810:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788639015.588818:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ff8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+32:3644:x1875523772930176:12345-0@lo:103: 00010000:00010000:3.0:1788639015.588833:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639015.588839:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae3750fa800/0x25c454990262c118 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262c111 expref: 32 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639015.588849:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae3750fa800/0x25c454990262c118 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262c111 expref: 32 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639015.588876:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae3750fa800/0x25c454990262c118 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262c111 expref: 32 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639015.588892:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639015.588938:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ff8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+31:3644:x1875523772930176:12345-0@lo:103: Request processed in 121us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639015.588945:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788639015.589002:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788639015.589009:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+30:3644:x1875523772930688:12345-0@lo:103: 00010000:00010000:3.0:1788639015.589016:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639015.589021:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae38217b800/0x25c454990262c08c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262c085 expref: 30 pid: 6508 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639015.589029:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae38217b800/0x25c454990262c08c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262c085 expref: 30 pid: 6508 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639015.589039:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae38217b800/0x25c454990262c08c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262c085 expref: 30 pid: 6508 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639015.589049:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639015.589070:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+29:3644:x1875523772930688:12345-0@lo:103: Request processed in 62us (1129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639015.589075:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788639015.589089:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788639015.589094:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+28:3644:x1875523772931200:12345-0@lo:103: 00010000:00010000:3.0:1788639015.589102:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639015.589106:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae38217b000/0x25c454990262c007 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262c000 expref: 28 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639015.589121:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae38217b000/0x25c454990262c007 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262c000 expref: 28 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639015.589130:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae38217b000/0x25c454990262c007 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262c000 expref: 28 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639015.589138:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639015.589160:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+27:3644:x1875523772931200:12345-0@lo:103: Request processed in 66us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639015.589165:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788639015.589177:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788639015.589182:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+26:3644:x1875523772930560:12345-0@lo:103: 00010000:00010000:3.0:1788639015.589190:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639015.589194:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae375f54a00/0x25c454990262c0a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262c0a1 expref: 26 pid: 6508 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639015.589202:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae375f54a00/0x25c454990262c0a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262c0a1 expref: 26 pid: 6508 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639015.589211:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae375f54a00/0x25c454990262c0a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262c0a1 expref: 26 pid: 6508 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639015.589219:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639015.589238:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+25:3644:x1875523772930560:12345-0@lo:103: Request processed in 56us (1184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639015.589243:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788639015.589253:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788639015.589259:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+24:3644:x1875523772931072:12345-0@lo:103: 00010000:00010000:3.0:1788639015.589273:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639015.589278:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae38217a800/0x25c454990262c031 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262c02a expref: 24 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639015.589285:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae38217a800/0x25c454990262c031 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262c02a expref: 24 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639015.589294:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae38217a800/0x25c454990262c031 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262c02a expref: 24 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639015.589304:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639015.589325:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+23:3644:x1875523772931072:12345-0@lo:103: Request processed in 67us (1245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639015.589331:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788639015.589345:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788639015.589350:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+22:3642:x1875523772930432:12345-0@lo:103: 00010000:00010000:3.0:1788639015.589358:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639015.589361:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae3750fbe00/0x25c454990262c0d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262c0cb expref: 22 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639015.589369:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae3750fbe00/0x25c454990262c0d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262c0cb expref: 22 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639015.589379:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae3750fbe00/0x25c454990262c0d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262c0cb expref: 22 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639015.589388:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639015.589420:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+21:3642:x1875523772930432:12345-0@lo:103: Request processed in 71us (1290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639015.589436:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788639015.589449:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788639015.589455:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+20:3642:x1875523772930944:12345-0@lo:103: 00010000:00010000:3.0:1788639015.589464:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639015.589468:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae375f55a00/0x25c454990262c070 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262c069 expref: 20 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639015.589476:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae375f55a00/0x25c454990262c070 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262c069 expref: 20 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639015.589486:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae375f55a00/0x25c454990262c070 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262c069 expref: 20 pid: 6510 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639015.589495:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639015.589517:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+19:3642:x1875523772930944:12345-0@lo:103: Request processed in 63us (1355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639015.589523:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788639015.589534:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788639015.589540:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ff8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+18:3642:x1875523772930304:12345-0@lo:103: 00010000:00010000:3.0:1788639015.589547:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639015.589550:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae375f55e00/0x25c454990262c0ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262c0e7 expref: 18 pid: 6508 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639015.589558:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae375f55e00/0x25c454990262c0ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262c0e7 expref: 18 pid: 6508 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639015.589568:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae375f55e00/0x25c454990262c0ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262c0e7 expref: 18 pid: 6508 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639015.589587:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639015.589611:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ff8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+17:3642:x1875523772930304:12345-0@lo:103: Request processed in 71us (1415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639015.589643:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788639015.589671:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788639015.589678:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+16:3642:x1875523772930816:12345-0@lo:103: 00010000:00010000:3.0:1788639015.589685:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639015.589690:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae38217be00/0x25c454990262c07e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262c077 expref: 16 pid: 6508 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639015.589698:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae38217be00/0x25c454990262c07e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262c077 expref: 16 pid: 6508 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639015.589708:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae38217be00/0x25c454990262c07e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262c077 expref: 16 pid: 6508 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639015.589717:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639015.589739:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+15:3642:x1875523772930816:12345-0@lo:103: Request processed in 62us (1518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639015.589744:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788639015.589863:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01f1eef9-e690-4065-bf99-bf821af7b626:3642:1875523772930304:0@lo:103: 00000100:00100000:2.0:1788639015.589873:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01f1eef9-e690-4065-bf99-bf821af7b626:3642:1875523772930816:0@lo:103: 00000100:00100000:2.0:1788639015.589894:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24319a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01f1eef9-e690-4065-bf99-bf821af7b626:3642:1875523772930432:0@lo:103: 00000100:00100000:2.0:1788639015.589902:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01f1eef9-e690-4065-bf99-bf821af7b626:3642:1875523772930944:0@lo:103: 00000100:00100000:0.0:1788639015.590016:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24319aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01f1eef9-e690-4065-bf99-bf821af7b626:3644:1875523772930560:0@lo:103: 00000100:00100000:0.0:1788639015.590025:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae360686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01f1eef9-e690-4065-bf99-bf821af7b626:3644:1875523772931072:0@lo:103: 00000100:00100000:0.0:1788639015.590033:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01f1eef9-e690-4065-bf99-bf821af7b626:3644:1875523772930176:0@lo:103: 00000100:00100000:0.0:1788639015.590040:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01f1eef9-e690-4065-bf99-bf821af7b626:3644:1875523772930688:0@lo:103: 00000100:00100000:0.0:1788639015.590047:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01f1eef9-e690-4065-bf99-bf821af7b626:3644:1875523772931200:0@lo:103: 00010000:00010000:1.0:1788639015.590172:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639015.594456:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639015.594809:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639015.594852:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754005120 00000100:00100000:3.0:1788639015.594865:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754005120 00010000:00010000:3.0:1788639015.594912:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae3750fb200/0x25c454990262c12d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8533c expref: 10 pid: 6510 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639015.594947:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754005248 00000100:00100000:3.0:1788639015.594966:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754005248 00010000:00010000:3.0:1788639015.594980:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae375f54400/0x25c454990262c126 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85335 expref: 11 pid: 6511 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639015.595005:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 33 00000100:00100000:3.0:1788639015.595015:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36d1ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1343f14-ed5c-4943-b596-61180b04fa87+11:2408:x1875523754005120:12345-192.168.206.18@tcp:103: 00010000:00010000:3.0:1788639015.595032:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639015.595038:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae3750fb200/0x25c454990262c12d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8533c expref: 11 pid: 6510 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639015.595053:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae3750fb200/0x25c454990262c12d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8533c expref: 11 pid: 6510 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639015.595078:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639015.595137:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36d1ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1343f14-ed5c-4943-b596-61180b04fa87+11:2408:x1875523754005120:12345-192.168.206.18@tcp:103: Request processed in 123us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639015.595145:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 33 00000100:00100000:3.0:1788639015.595163:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 34 00000100:00100000:3.0:1788639015.595169:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242080a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1343f14-ed5c-4943-b596-61180b04fa87+10:2408:x1875523754005248:12345-192.168.206.18@tcp:103: 00010000:00010000:3.0:1788639015.595176:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639015.595180:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae375f54400/0x25c454990262c126 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85335 expref: 10 pid: 6511 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639015.595189:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae375f54400/0x25c454990262c126 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85335 expref: 10 pid: 6511 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639015.595203:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ae242f23800/0x25c454990262c16c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639015.595224:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae242f23800/0x25c454990262c16c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639015.595242:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae242f23800/0x25c454990262c16c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639015.595250:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae242f23800/0x25c454990262c16c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639015.595257:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ae242f23800/0x25c454990262c16c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639015.595265:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ae242f23800/0x25c454990262c16c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639015.595272:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f23800 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:3.0:1788639015.595278:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ae242f23800/0x25c454990262c16c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639015.595287:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ae242f23800/0x25c454990262c16c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639015.595296:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ae242f23800/0x25c454990262c16c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639015.595308:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639015.595327:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242080a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1343f14-ed5c-4943-b596-61180b04fa87+10:2408:x1875523754005248:12345-192.168.206.18@tcp:103: Request processed in 159us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639015.595334:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 34 00010000:00010000:2.0:1788639015.595953:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae3750fb200/0x25c454990262c12d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8533c expref: 9 pid: 6510 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639015.595971:0:10329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae360684a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1875523772928768:192.168.206.18@tcp:104: 00010000:00010000:2.0:1788639015.595983:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae375f54400/0x25c454990262c126 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85335 expref: 8 pid: 6511 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639015.595989:0:10329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae360686680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1875523772928896:192.168.206.18@tcp:104: 00010000:00010000:2.0:1788639015.596074:0:10329:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ae242f23800/0x25c454990262c16c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639015.596084:0:10329:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ae242f23800/0x25c454990262c16c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639015.596090:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ae242f23800/0x25c454990262c16c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639015.596097:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae242f23800/0x25c454990262c16c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639015.605810:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e149180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772931328:0@lo:13: 00000100:00100000:2.0:1788639015.605927:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639015.606059:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772931328 00000100:00100000:1.0:1788639015.606070:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772931328 00000100:00100000:1.0:1788639015.606147:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788639015.606159:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772931328:12345-0@lo:13: 00002000:00000024:1.0:1788639015.606199:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788639015.606252:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772931328:12345-0@lo:13: Request processed in 96us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639015.606259:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1788639015.606376:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788639015.606415:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae36e149180 x1875523772931328/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639031 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639015.606462:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e149180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772931328:0@lo:13: 00000100:00100000:2.0:1788639015.607091:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875523772931456:0@lo:400: 00000100:00100000:2.0:1788639015.607135:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639015.607215:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772931456 00000100:00100000:1.0:1788639015.607221:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772931456 00000100:00100000:1.0:1788639015.607263:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788639015.607271:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875523772931456:12345-0@lo:400: 00000100:00100000:1.0:1788639015.607713:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875523772931456:12345-0@lo:400: Request processed in 441us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639015.607721:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788639015.608308:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772931584:0@lo:400: 00000100:00100000:3.0:1788639015.608369:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639015.608865:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875523772932096:0@lo:400: 00000100:00100000:3.0:1788639015.608899:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639015.608920:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875523772932608:0@lo:400: 00000100:00100000:3.0:1788639015.608941:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639015.608971:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788639015.608979:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875523772931712:0@lo:400: 00000100:00100000:3.0:1788639015.609012:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639015.609030:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772932224:0@lo:400: 00000100:00100000:3.0:1788639015.609054:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639015.609070:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772932736:0@lo:400: 00000100:00100000:3.0:1788639015.609106:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639015.610394:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875523772931456:0@lo:400: 00000100:00100000:2.0:1788639015.610444:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772932096 00000100:00100000:2.0:1788639015.610451:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772932096 00000100:00100000:2.0:1788639015.610508:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772932608 00000100:00100000:2.0:1788639015.610512:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772932608 00000100:00100000:2.0:1788639015.610530:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772931712 00000100:00100000:2.0:1788639015.610534:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772931712 00000100:00100000:2.0:1788639015.610553:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788639015.610562:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2416e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875523772932096:12345-0@lo:400: 00000100:00100000:2.0:1788639015.610666:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2416e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875523772932096:12345-0@lo:400: Request processed in 104us (1765us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639015.610673:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788639015.610693:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788639015.610700:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2416e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875523772932608:12345-0@lo:400: 00000100:00100000:2.0:1788639015.610730:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2416e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875523772932608:12345-0@lo:400: Request processed in 32us (1788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639015.610737:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788639015.610749:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788639015.610756:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2416e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875523772931712:12345-0@lo:400: 00000100:00100000:2.0:1788639015.610786:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2416e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875523772931712:12345-0@lo:400: Request processed in 31us (1773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639015.610792:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788639015.610823:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772932224 00000100:00100000:2.0:1788639015.610828:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772932224 00000100:00100000:2.0:1788639015.610854:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772932736 00000100:00100000:2.0:1788639015.610857:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772932736 00000100:00100000:2.0:1788639015.610879:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788639015.610886:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2416e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772932224:12345-0@lo:400: 00000100:00100000:2.0:1788639015.610924:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2416e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772932224:12345-0@lo:400: Request processed in 39us (1868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639015.610930:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788639015.610942:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788639015.610949:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772932736:12345-0@lo:400: 00000100:00100000:2.0:1788639015.610977:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772932736:12345-0@lo:400: Request processed in 29us (1870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639015.610982:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788639015.612283:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875523772931712:0@lo:400: 00010000:00080000:2.0:1788639015.612304:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f37100 x1875523772932224/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639015.612316:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772932224:0@lo:400: 00010000:00080000:2.0:1788639015.612328:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2416e7800 x1875523772932736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639015.612336:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772932736:0@lo:400: 00010000:00080000:2.0:1788639015.612347:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f34700 x1875523772932096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639015.612357:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875523772932096:0@lo:400: 00010000:00080000:2.0:1788639015.612369:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2416e5500 x1875523772932608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639015.612384:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875523772932608:0@lo:400: 00000100:00100000:1.0:1788639015.612865:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772931584 00000100:00100000:1.0:1788639015.612876:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772931584 00000100:00100000:1.0:1788639015.612933:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788639015.612944:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2416e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772931584:12345-0@lo:400: 00000100:00100000:1.0:1788639015.613057:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2416e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772931584:12345-0@lo:400: Request processed in 114us (4687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639015.613066:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788639015.613121:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772931584:0@lo:400: 00000100:00080000:2.0:1788639015.613781:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788639015.613788:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788639015.613792:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788639015.613816:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772931840:0@lo:400: 00000100:00100000:2.0:1788639015.613873:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639015.613949:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772932352:0@lo:400: 00000100:00100000:2.0:1788639015.613975:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639015.614036:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772932352 00000100:00100000:2.0:1788639015.614042:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772932352 00000100:00100000:2.0:1788639015.614091:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788639015.614099:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772932352:12345-0@lo:400: 00000100:00100000:2.0:1788639015.614141:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772932352:12345-0@lo:400: Request processed in 43us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639015.614148:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1788639015.614169:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788639015.614192:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f35180 x1875523772932352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639015.614204:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772932352:0@lo:400: 00000100:00100000:2.0:1788639015.614223:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875523772931968:0@lo:400: 00000100:00100000:2.0:1788639015.614250:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639015.614277:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875523772932480:0@lo:400: 00000100:00100000:2.0:1788639015.614295:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639015.614321:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772931968 00000100:00100000:2.0:1788639015.614324:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772931968 00000100:00100000:2.0:1788639015.614359:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772932480 00000100:00100000:2.0:1788639015.614361:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772932480 00000100:00100000:2.0:1788639015.614379:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788639015.614384:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875523772931968:12345-0@lo:400: 00000100:00100000:2.0:1788639015.614423:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875523772931968:12345-0@lo:400: Request processed in 39us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639015.614429:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788639015.614441:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788639015.614446:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875523772932480:12345-0@lo:400: 00000100:00100000:2.0:1788639015.614471:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875523772932480:12345-0@lo:400: Request processed in 25us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639015.614477:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1788639015.614490:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788639015.614505:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875523772931968:0@lo:400: 00000100:00100000:2.0:1788639015.614514:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875523772932480:0@lo:400: 00000100:00100000:1.0:1788639015.614561:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772931840 00000100:00100000:1.0:1788639015.614566:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772931840 00000100:00100000:1.0:1788639015.614681:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788639015.614689:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772931840:12345-0@lo:400: 00000100:00100000:1.0:1788639015.614739:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772931840:12345-0@lo:400: Request processed in 51us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639015.614747:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788639015.614795:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772931840:0@lo:400: 00000100:00100000:3.0:1788639016.118192:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788639016.118227:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e14aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772932864:0@lo:41: 00000100:00100000:3.0:1788639016.118316:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639016.118696:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788639016.118708:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772932992:0@lo:13: 00000100:00100000:2.0:1788639016.118755:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639016.119152:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772932992 00000100:00100000:0.0:1788639016.119163:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772932992 00000100:00100000:0.0:1788639016.119225:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788639016.119237:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772932992:12345-0@lo:13: 00002000:00000024:0.0:1788639016.119267:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788639016.119333:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772932992:12345-0@lo:13: Request processed in 97us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639016.119363:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788639016.119436:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2432c8a80 x1875523772932992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639032 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639016.119453:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772932864 00000100:00100000:1.0:1788639016.119459:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772932864 00000100:00100000:3.0:1788639016.119462:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772932992:0@lo:13: 00000100:00100000:1.0:1788639016.119501:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788639016.119509:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772932864:12345-0@lo:41: 00000004:00000024:1.0:1788639016.119539:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788639016.119590:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772932864:12345-0@lo:41: Request processed in 82us (1273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639016.119596:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788639016.119657:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e14aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772932864:0@lo:41: 00010000:00010000:0.0:1788639016.373146:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639016.629264:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788639016.629305:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772933120:0@lo:41: 00000100:00100000:0.0:1788639016.629397:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639016.629532:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772933120 00000100:00100000:2.0:1788639016.629550:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772933120 00000100:00100000:2.0:1788639016.629607:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788639016.629639:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772933120:12345-0@lo:41: 00000004:00000024:2.0:1788639016.629683:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788639016.629754:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772933120:12345-0@lo:41: Request processed in 137us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639016.629792:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788639016.630270:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772933120:0@lo:41: 00000100:00100000:1.0:1788639016.928966:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639016.929020:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639016.929108:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639016.929141:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639016.929172:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639016.929232:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754005504 00000100:00100000:2.0:1788639016.929245:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754005504 00000100:00100000:2.0:1788639016.929319:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754005632 00000100:00100000:2.0:1788639016.929322:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754005632 00000100:00100000:2.0:1788639016.929361:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 59 00000100:00100000:2.0:1788639016.929372:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36e14a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2407:x1875523754005504:12345-192.168.206.18@tcp:400: 00000100:00100000:2.0:1788639016.929465:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36e14a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2407:x1875523754005504:12345-192.168.206.18@tcp:400: Request processed in 94us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639016.929485:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 59 00000100:00100000:2.0:1788639016.929505:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 60 00000100:00100000:2.0:1788639016.929511:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36e149f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2407:x1875523754005632:12345-192.168.206.18@tcp:400: 00000100:00100000:2.0:1788639016.929536:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36e149f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2407:x1875523754005632:12345-192.168.206.18@tcp:400: Request processed in 25us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639016.929542:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 60 00000100:00080000:2.0:1788639016.929561:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788639016.929565:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788639016.930001:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754005376 00000100:00100000:0.0:1788639016.930008:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754005376 00000100:00100000:0.0:1788639016.930058:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 199 00000100:00100000:0.0:1788639016.930065:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+8:2407:x1875523754005376:12345-192.168.206.18@tcp:400: 00000100:00100000:0.0:1788639016.930103:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+8:2407:x1875523754005376:12345-192.168.206.18@tcp:400: Request processed in 39us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639016.930110:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 199 00000100:00100000:3.0:1788639016.941361:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754005760 00000100:00100000:3.0:1788639016.941382:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754005760 00000100:00100000:2.0:1788639016.941885:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754005888 00000100:00100000:2.0:1788639016.941893:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754005888 00000100:00100000:3.0:1788639016.942073:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 19 00000100:00100000:3.0:1788639016.942088:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36e148e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2407:x1875523754005760:12345-192.168.206.18@tcp:400: 00000100:00100000:2.0:1788639016.942206:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 20 00000100:00100000:2.0:1788639016.942216:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36e149500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2407:x1875523754005888:12345-192.168.206.18@tcp:400: 00000100:00100000:3.0:1788639016.942229:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36e148e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2407:x1875523754005760:12345-192.168.206.18@tcp:400: Request processed in 142us (13206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639016.942239:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 19 00000100:00100000:2.0:1788639016.942255:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36e149500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2407:x1875523754005888:12345-192.168.206.18@tcp:400: Request processed in 41us (13081us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639016.942264:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 20 00000100:00080000:0.0:1788639016.942744:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788639016.942750:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:1.0:1788639017.272355:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788639017.272365:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ae375f89000 from 48 10000000:01000000:1.0:1788639017.272371:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788639017.272432:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262c173 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639017.272446:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262c173 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639017.272459:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262c173 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639017.272490:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772933248:0@lo:101: 00000100:00100000:1.0:1788639017.272597:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639017.272715:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788639017.272981:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772933248 00000100:00100000:3.0:1788639017.273001:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772933248 00000100:00100000:3.0:1788639017.273070:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788639017.273081:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+15:6513:x1875523772933248:12345-0@lo:101: 00010000:00010000:3.0:1788639017.273108:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639017.273126:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae3429e5e00/0x25c454990262c17a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262c173 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639017.273155:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae3429e5e00/0x25c454990262c17a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262c173 expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639017.273167:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae3429e5e00/0x25c454990262c17a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c173 expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639017.273177:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3429e5e00, rc 0) 00000100:00100000:3.0:1788639017.273237:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+16:6513:x1875523772933248:12345-0@lo:101: Request processed in 156us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639017.273244:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788639017.273383:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772933248:0@lo:101: 00010000:00010000:1.0:1788639017.273400:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262c173 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c17a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639017.273411:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262c173 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262c17a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639017.273487:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772933376:0@lo:501: 00000100:00100000:1.0:1788639017.273516:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639017.273540:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788639017.273695:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772933376 00000100:00100000:2.0:1788639017.273700:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772933376 00000100:00100000:2.0:1788639017.273744:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788639017.273751:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+16:6513:x1875523772933376:12345-0@lo:501: 00000100:00100000:2.0:1788639017.273882:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+16:6513:x1875523772933376:12345-0@lo:501: Request processed in 132us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639017.273890:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788639017.274307:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772933376:0@lo:501: 00000100:00100000:1.0:1788639017.274341:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772933504:0@lo:503: 00000100:00100000:1.0:1788639017.274391:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639017.274425:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788639017.274493:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772933504 00000100:00100000:0.0:1788639017.274499:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772933504 00000100:00100000:0.0:1788639017.274521:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788639017.274528:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+16:6513:x1875523772933504:12345-0@lo:503: 00000100:00100000:0.0:1788639017.274666:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+16:6513:x1875523772933504:12345-0@lo:503: Request processed in 137us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639017.274674:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788639017.276704:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772933504:0@lo:503: 00000100:00100000:2.0:1788639017.278177:0:10347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10347:1875523772933632:0@lo:502: 00000100:00100000:2.0:1788639017.278277:0:10347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639017.278325:0:10347:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344267240 going to sleep for 11 seconds 00000100:00100000:0.0:1788639017.278389:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772933632 00000100:00100000:0.0:1788639017.278398:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772933632 00000100:00100000:3.0:1788639017.278528:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788639017.278541:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+16:10347:x1875523772933632:12345-0@lo:502: 00000100:00100000:3.0:1788639017.278787:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+16:10347:x1875523772933632:12345-0@lo:502: Request processed in 248us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639017.278795:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788639017.281247:0:10347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10347:1875523772933632:0@lo:502: 00000100:00100000:2.0:1788639017.281356:0:10347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10347:1875523772933760:0@lo:502: 00000100:00100000:2.0:1788639017.281500:0:10347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639017.281611:0:10347:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344267240 going to sleep for 11 seconds 00000100:00100000:0.0:1788639017.281798:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772933760 00000100:00100000:0.0:1788639017.281807:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772933760 00000100:00100000:0.0:1788639017.281922:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788639017.281934:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+16:10347:x1875523772933760:12345-0@lo:502: 00000100:00100000:0.0:1788639017.282120:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+16:10347:x1875523772933760:12345-0@lo:502: Request processed in 187us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639017.282128:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788639017.282211:0:10347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10347:1875523772933760:0@lo:502: 00000040:00080000:2.0:1788639017.282235:0:10347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788639017.283252:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788639017.283286:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788639017.283299:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262c173 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c17a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639017.283314:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262c173 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c17a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788639017.283326:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1788639017.283329:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1788639017.283345:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788639017.283390:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb200/0x25c454990262c181 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639017.283400:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb200/0x25c454990262c181 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639017.283411:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb200/0x25c454990262c181 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639017.283432:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772933888:0@lo:101: 00000100:00100000:1.0:1788639017.283501:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639017.285867:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788639017.285991:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772933888 00000100:00100000:3.0:1788639017.286022:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772933888 00000100:00100000:3.0:1788639017.286082:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788639017.286147:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+16:6513:x1875523772933888:12345-0@lo:101: 00010000:00010000:3.0:1788639017.286168:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639017.286196:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae3429e4e00/0x25c454990262c188 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262c181 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639017.286233:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae3429e4e00/0x25c454990262c188 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262c181 expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639017.286246:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae3429e4e00/0x25c454990262c188 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c181 expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639017.286256:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3429e4e00, rc 0) 00000100:00100000:3.0:1788639017.286340:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+17:6513:x1875523772933888:12345-0@lo:101: Request processed in 247us (2838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639017.286346:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788639017.286523:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772933888:0@lo:101: 00010000:00010000:1.0:1788639017.286543:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb200/0x25c454990262c181 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c188 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639017.286554:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb200/0x25c454990262c181 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262c188 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639017.286807:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772934016:0@lo:501: 00000100:00100000:1.0:1788639017.286847:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639017.286868:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788639017.286921:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772934016 00000100:00100000:3.0:1788639017.286926:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772934016 00000100:00100000:3.0:1788639017.286947:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788639017.286954:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+17:6513:x1875523772934016:12345-0@lo:501: 00000100:00100000:3.0:1788639017.287182:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+17:6513:x1875523772934016:12345-0@lo:501: Request processed in 227us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639017.287190:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788639017.287261:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772934016:0@lo:501: 00000100:00100000:1.0:1788639017.287289:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772934144:0@lo:503: 00000100:00100000:1.0:1788639017.287334:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639017.287361:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788639017.287419:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772934144 00000100:00100000:0.0:1788639017.287425:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772934144 00000100:00100000:0.0:1788639017.287509:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788639017.287518:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+17:6513:x1875523772934144:12345-0@lo:503: 00000100:00100000:0.0:1788639017.288885:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+17:6513:x1875523772934144:12345-0@lo:503: Request processed in 1360us (1541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639017.288895:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788639017.289346:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772934144:0@lo:503: 00000100:00100000:3.0:1788639017.290918:0:10348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10348:1875523772934272:0@lo:502: 00000100:00100000:3.0:1788639017.291242:0:10348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639017.291327:0:10348:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3750e2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788639017.291546:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772934272 00000100:00100000:2.0:1788639017.291556:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772934272 00000100:00100000:2.0:1788639017.291800:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788639017.291812:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+17:10348:x1875523772934272:12345-0@lo:502: 00000100:00100000:2.0:1788639017.291971:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+17:10348:x1875523772934272:12345-0@lo:502: Request processed in 161us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639017.291980:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788639017.292126:0:10348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10348:1875523772934272:0@lo:502: 00000020:01000000:3.0:1788639017.292166:0:10348:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788639017.292177:0:10348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788639017.292180:0:10348:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788639017.292187:0:10348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788639017.292217:0:10348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10348:1875523772934400:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788639017.292257:0:10348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639017.292401:0:10348:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3750e2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788639017.292476:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772934400 00000100:00100000:0.0:1788639017.292482:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772934400 00000100:00100000:0.0:1788639017.292511:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788639017.292518:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+17:10348:x1875523772934400:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788639017.292641:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+17:10348:x1875523772934400:12345-0@lo:502:llog_process_th.0 Request processed in 98us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639017.292649:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788639017.292885:0:10348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10348:1875523772934400:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788639017.292908:0:10348:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788639017.292913:0:10348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788639017.292915:0:10348:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788639017.292919:0:10348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:0.0:1788639017.293570:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1788639017.293597:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788639017.293801:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb200/0x25c454990262c181 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c188 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639017.293814:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb200/0x25c454990262c181 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c188 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639017.293824:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788639017.293827:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ae375ea2800 from 48 10000000:01000000:0.0:1788639017.293843:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788639017.293878:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae375f55600/0x25c454990262c18f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639017.293888:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae375f55600/0x25c454990262c18f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639017.293898:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae375f55600/0x25c454990262c18f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639017.293918:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772934528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788639017.293967:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639017.294013:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2410b5300 going to sleep for 11 seconds 00000100:00100000:2.0:1788639017.294070:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772934528 00000100:00100000:2.0:1788639017.294077:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772934528 00000100:00100000:2.0:1788639017.294179:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788639017.294189:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+17:6513:x1875523772934528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788639017.294201:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639017.294222:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae242f22a00/0x25c454990262c196 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262c18f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639017.294249:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae242f22a00/0x25c454990262c196 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262c18f expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639017.294262:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae242f22a00/0x25c454990262c196 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c18f expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639017.294273:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f22a00, rc 0) 00000100:00100000:2.0:1788639017.294316:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+18:6513:x1875523772934528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639017.294323:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788639017.294422:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772934528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788639017.294447:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae375f55600/0x25c454990262c18f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c196 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639017.294457:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae375f55600/0x25c454990262c18f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262c196 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639017.294855:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772934656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788639017.294888:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639017.294922:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2410b5300 going to sleep for 11 seconds 00000100:00100000:2.0:1788639017.294970:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772934656 00000100:00100000:2.0:1788639017.294975:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772934656 00000100:00100000:2.0:1788639017.295017:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788639017.295025:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+18:6513:x1875523772934656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788639017.295417:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+18:6513:x1875523772934656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 392us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639017.295425:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788639017.295821:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772934656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788639017.295859:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772934784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788639017.295907:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639017.295928:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2410b5300 going to sleep for 11 seconds 00000100:00100000:3.0:1788639017.296314:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772934784 00000100:00100000:3.0:1788639017.296321:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772934784 00000100:00100000:3.0:1788639017.296369:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788639017.296378:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+18:6513:x1875523772934784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788639017.296836:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+18:6513:x1875523772934784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 458us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639017.296844:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788639017.296939:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772934784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788639017.301800:0:10349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10349:1875523772934912:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788639017.301918:0:10349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639017.302218:0:10349:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235a900 going to sleep for 11 seconds 00000100:00100000:2.0:1788639017.302305:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772934912 00000100:00100000:2.0:1788639017.302315:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772934912 00000100:00100000:2.0:1788639017.302384:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788639017.302394:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+18:10349:x1875523772934912:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788639017.302806:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+18:10349:x1875523772934912:12345-0@lo:502:llog_process_th.0 Request processed in 411us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639017.302815:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788639017.305672:0:10349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10349:1875523772934912:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788639017.305790:0:10349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10349:1875523772935040:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788639017.305880:0:10349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639017.305940:0:10349:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235a900 going to sleep for 11 seconds 00000100:00100000:0.0:1788639017.306135:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772935040 00000100:00100000:0.0:1788639017.306144:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772935040 00000100:00100000:0.0:1788639017.306206:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1788639017.306217:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+18:10349:x1875523772935040:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788639017.306375:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+18:10349:x1875523772935040:12345-0@lo:502:llog_process_th.0 Request processed in 159us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639017.306383:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788639017.306792:0:10349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10349:1875523772935040:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788639017.306821:0:10349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788639017.307013:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1788639017.307052:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788639017.307086:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae375f55600/0x25c454990262c18f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c196 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639017.307098:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae375f55600/0x25c454990262c18f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c196 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639017.307108:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788639017.307111:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1788639017.307113:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788639017.307149:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae375f54c00/0x25c454990262c19d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639017.307157:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae375f54c00/0x25c454990262c19d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639017.307166:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae375f54c00/0x25c454990262c19d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639017.307183:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772935168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788639017.307233:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639017.307261:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2410b5540 going to sleep for 11 seconds 00000100:00100000:0.0:1788639017.307275:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772935168 00000100:00100000:0.0:1788639017.307279:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772935168 00000100:00100000:0.0:1788639017.307304:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1788639017.307311:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b678850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+18:6513:x1875523772935168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788639017.307322:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639017.307348:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae375f55c00/0x25c454990262c1a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262c19d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639017.307374:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae375f55c00/0x25c454990262c1a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262c19d expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639017.307385:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae375f55c00/0x25c454990262c1a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c19d expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639017.307395:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375f55c00, rc 0) 00000100:00100000:0.0:1788639017.307426:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b678850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+19:6513:x1875523772935168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639017.307432:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1788639017.307475:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772935168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788639017.307488:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae375f54c00/0x25c454990262c19d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c1a4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639017.307498:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae375f54c00/0x25c454990262c19d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262c1a4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639017.307550:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772935296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788639017.307726:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639017.307740:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2410b5540 going to sleep for 11 seconds 00000100:00100000:0.0:1788639017.307753:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772935296 00000100:00100000:0.0:1788639017.307756:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772935296 00000100:00100000:0.0:1788639017.307776:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788639017.307781:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b678450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+19:6513:x1875523772935296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788639017.307894:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b678450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+19:6513:x1875523772935296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639017.307901:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788639017.308000:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772935296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788639017.308026:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772935424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788639017.308062:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639017.308074:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2410b5540 going to sleep for 11 seconds 00000100:00100000:0.0:1788639017.308084:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772935424 00000100:00100000:0.0:1788639017.308087:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772935424 00000100:00100000:0.0:1788639017.308104:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788639017.308110:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b679850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+19:6513:x1875523772935424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788639017.308181:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b679850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+19:6513:x1875523772935424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639017.308187:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788639017.308222:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772935424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788639017.309220:0:10350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10350:1875523772935552:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788639017.309275:0:10350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639017.309311:0:10350:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235a480 going to sleep for 11 seconds 00000100:00100000:0.0:1788639017.309905:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772935552 00000100:00100000:0.0:1788639017.309914:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772935552 00000100:00100000:0.0:1788639017.310051:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788639017.310061:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+19:10350:x1875523772935552:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788639017.310196:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+19:10350:x1875523772935552:12345-0@lo:502:llog_process_th.0 Request processed in 136us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639017.310204:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788639017.310280:0:10350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10350:1875523772935552:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788639017.310309:0:10350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788639017.310319:0:10350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788639017.310322:0:10350:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788639017.310328:0:10350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788639017.310364:0:10350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10350:1875523772935680:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788639017.310397:0:10350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639017.310808:0:10350:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235a480 going to sleep for 11 seconds 00000100:00100000:2.0:1788639017.310843:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772935680 00000100:00100000:2.0:1788639017.310857:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772935680 00000100:00100000:2.0:1788639017.310886:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788639017.310894:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+19:10350:x1875523772935680:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788639017.311101:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+19:10350:x1875523772935680:12345-0@lo:502:llog_process_th.0 Request processed in 208us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639017.311108:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788639017.311212:0:10350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10350:1875523772935680:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788639017.311236:0:10350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788639017.311242:0:10350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788639017.311243:0:10350:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788639017.311254:0:10350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:0.0:1788639017.311814:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1788639017.311836:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788639017.311848:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae375f54c00/0x25c454990262c19d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c1a4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639017.311860:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae375f54c00/0x25c454990262c19d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c1a4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639017.311872:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788639017.311874:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ae3506e9000 from 48 10000000:01000000:0.0:1788639017.311877:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788639017.311911:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae375f55400/0x25c454990262c1ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639017.311920:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae375f55400/0x25c454990262c1ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639017.312003:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae375f55400/0x25c454990262c1ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639017.312023:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772935808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788639017.312067:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639017.312138:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2410b5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788639017.312180:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772935808 00000100:00100000:2.0:1788639017.312186:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772935808 00000100:00100000:2.0:1788639017.312258:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788639017.312267:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b678c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+19:6513:x1875523772935808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788639017.312278:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639017.312292:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae242f22000/0x25c454990262c1b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262c1ab expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639017.312317:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae242f22000/0x25c454990262c1b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262c1ab expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639017.312414:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae242f22000/0x25c454990262c1b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c1ab expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639017.312427:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f22000, rc 0) 00000100:00100000:2.0:1788639017.312540:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b678c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+20:6513:x1875523772935808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 273us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639017.312547:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788639017.312685:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772935808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788639017.312701:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae375f55400/0x25c454990262c1ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c1b2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639017.312711:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae375f55400/0x25c454990262c1ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262c1b2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639017.312775:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772935936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788639017.312802:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639017.313041:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235a480 going to sleep for 11 seconds 00000100:00100000:2.0:1788639017.313082:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772935936 00000100:00100000:2.0:1788639017.313087:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772935936 00000100:00100000:0.0:1788639017.313129:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788639017.313138:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b679c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+20:6513:x1875523772935936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788639017.314178:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b679c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+20:6513:x1875523772935936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1035us (1368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639017.314189:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788639017.315215:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772935936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788639017.315284:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772936064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788639017.315362:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639017.315451:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235a480 going to sleep for 11 seconds 00000100:00100000:2.0:1788639017.315657:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772936064 00000100:00100000:2.0:1788639017.315665:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772936064 00000100:00100000:0.0:1788639017.315805:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788639017.315817:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+20:6513:x1875523772936064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788639017.315949:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+20:6513:x1875523772936064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 134us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639017.315957:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788639017.316079:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772936064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788639017.316609:0:10351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10351:1875523772936192:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788639017.316682:0:10351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639017.316708:0:10351:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788639017.316931:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772936192 00000100:00100000:2.0:1788639017.316945:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772936192 00000100:00100000:2.0:1788639017.316972:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788639017.316992:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+20:10351:x1875523772936192:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788639017.317266:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+20:10351:x1875523772936192:12345-0@lo:502:llog_process_th.0 Request processed in 285us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639017.317274:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788639017.317467:0:10351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10351:1875523772936192:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788639017.317528:0:10351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10351:1875523772936320:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788639017.317560:0:10351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639017.317733:0:10351:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788639017.317819:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772936320 00000100:00100000:2.0:1788639017.317824:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772936320 00000100:00100000:2.0:1788639017.317860:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788639017.317868:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b679450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+20:10351:x1875523772936320:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788639017.317956:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b679450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+20:10351:x1875523772936320:12345-0@lo:502:llog_process_th.0 Request processed in 89us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639017.317963:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788639017.318139:0:10351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10351:1875523772936320:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788639017.318174:0:10351:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788639017.318750:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1788639017.318779:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788639017.318792:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae375f55400/0x25c454990262c1ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c1b2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639017.318806:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae375f55400/0x25c454990262c1ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c1b2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639017.318817:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788639017.318820:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:0.0:1788639017.318823:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788639017.318856:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae375f54400/0x25c454990262c1b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639017.318865:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae375f54400/0x25c454990262c1b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639017.318876:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae375f54400/0x25c454990262c1b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639017.318893:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772936448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788639017.318957:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639017.319000:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2410b5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788639017.319166:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772936448 00000100:00100000:2.0:1788639017.319173:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772936448 00000100:00100000:2.0:1788639017.319212:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788639017.319220:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b679050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+20:6513:x1875523772936448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788639017.319231:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639017.319246:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae242f23a00/0x25c454990262c1c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262c1b9 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639017.319273:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae242f23a00/0x25c454990262c1c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262c1b9 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639017.319286:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae242f23a00/0x25c454990262c1c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c1b9 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639017.319295:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f23a00, rc 0) 00000100:00100000:2.0:1788639017.320937:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b679050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+21:6513:x1875523772936448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1699us (1961us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639017.320948:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788639017.321296:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772936448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788639017.321324:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae375f54400/0x25c454990262c1b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c1c0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639017.321338:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae375f54400/0x25c454990262c1b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262c1c0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639017.321421:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772936576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788639017.321532:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639017.321701:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788639017.321814:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772936576 00000100:00100000:0.0:1788639017.321822:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772936576 00000100:00100000:0.0:1788639017.321896:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788639017.321906:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+21:6513:x1875523772936576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788639017.324886:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+21:6513:x1875523772936576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2968us (3340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639017.324905:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788639017.325221:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772936576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788639017.325288:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772936704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788639017.325362:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639017.325745:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788639017.325804:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772936704 00000100:00100000:0.0:1788639017.325811:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772936704 00000100:00100000:0.0:1788639017.325857:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788639017.325866:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+21:6513:x1875523772936704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788639017.326027:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+21:6513:x1875523772936704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 162us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639017.326034:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788639017.326132:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772936704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788639017.327041:0:10352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10352:1875523772936832:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788639017.327098:0:10352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639017.327130:0:10352:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235a900 going to sleep for 11 seconds 00000100:00100000:0.0:1788639017.327180:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772936832 00000100:00100000:0.0:1788639017.327185:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772936832 00000100:00100000:0.0:1788639017.327222:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788639017.327231:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+21:10352:x1875523772936832:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788639017.327347:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+21:10352:x1875523772936832:12345-0@lo:502:llog_process_th.0 Request processed in 116us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639017.327355:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788639017.327543:0:10352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10352:1875523772936832:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788639017.327701:0:10352:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788639017.327728:0:10352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788639017.327731:0:10352:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788639017.327739:0:10352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788639017.327764:0:10352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10352:1875523772936960:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788639017.327804:0:10352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639017.327902:0:10352:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235a900 going to sleep for 11 seconds 00000100:00100000:3.0:1788639017.327928:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772936960 00000100:00100000:3.0:1788639017.327932:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772936960 00000100:00100000:3.0:1788639017.328007:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788639017.328015:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+21:10352:x1875523772936960:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788639017.328141:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+21:10352:x1875523772936960:12345-0@lo:502:llog_process_th.0 Request processed in 126us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639017.328147:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788639017.328200:0:10352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10352:1875523772936960:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788639017.328219:0:10352:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788639017.328224:0:10352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788639017.328226:0:10352:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788639017.328229:0:10352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:2.0:1788639017.328534:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:2.0:1788639017.328557:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788639017.328651:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae375f54400/0x25c454990262c1b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c1c0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639017.328664:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae375f54400/0x25c454990262c1b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c1c0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788639017.328676:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788639017.328679:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ae3461e3800 from 48 10000000:01000000:2.0:1788639017.328683:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788639017.328716:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f23600/0x25c454990262c1c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639017.328725:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae242f23600/0x25c454990262c1c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639017.328735:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae242f23600/0x25c454990262c1c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639017.328752:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772937088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788639017.328790:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639017.328817:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae360f4f780 going to sleep for 11 seconds 00000100:00100000:0.0:1788639017.328917:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772937088 00000100:00100000:0.0:1788639017.328923:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772937088 00000100:00100000:0.0:1788639017.328962:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788639017.328971:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b678050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+21:6513:x1875523772937088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788639017.329002:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639017.329019:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae375f55e00/0x25c454990262c1ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262c1c7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639017.329046:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae375f55e00/0x25c454990262c1ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262c1c7 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639017.329058:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae375f55e00/0x25c454990262c1ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c1c7 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639017.329067:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375f55e00, rc 0) 00000100:00100000:0.0:1788639017.329109:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b678050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+22:6513:x1875523772937088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639017.329115:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788639017.329191:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772937088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788639017.329207:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae242f23600/0x25c454990262c1c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c1ce expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639017.329217:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae242f23600/0x25c454990262c1c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262c1ce expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639017.329273:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772937216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788639017.329299:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639017.329329:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235a900 going to sleep for 11 seconds 00000100:00100000:0.0:1788639017.329375:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772937216 00000100:00100000:0.0:1788639017.329380:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772937216 00000100:00100000:0.0:1788639017.329399:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788639017.329404:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+22:6513:x1875523772937216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788639017.329766:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+22:6513:x1875523772937216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 361us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639017.329774:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788639017.329965:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772937216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788639017.330006:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772937344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788639017.330044:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639017.330103:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235a900 going to sleep for 11 seconds 00000100:00100000:0.0:1788639017.330132:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772937344 00000100:00100000:0.0:1788639017.330137:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772937344 00000100:00100000:0.0:1788639017.330199:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788639017.330206:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+22:6513:x1875523772937344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788639017.330296:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+22:6513:x1875523772937344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639017.330311:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788639017.330371:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772937344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788639017.330957:0:10353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10353:1875523772937472:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788639017.331013:0:10353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639017.331284:0:10353:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235a180 going to sleep for 11 seconds 00000100:00100000:2.0:1788639017.331335:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772937472 00000100:00100000:2.0:1788639017.331341:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772937472 00000100:00100000:2.0:1788639017.331369:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788639017.331376:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+22:10353:x1875523772937472:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788639017.331576:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+22:10353:x1875523772937472:12345-0@lo:502:llog_process_th.0 Request processed in 199us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639017.331582:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788639017.332009:0:10353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10353:1875523772937472:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788639017.332056:0:10353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10353:1875523772937600:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788639017.332095:0:10353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639017.332159:0:10353:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235a180 going to sleep for 11 seconds 00000100:00100000:3.0:1788639017.332186:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772937600 00000100:00100000:3.0:1788639017.332197:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772937600 00000100:00100000:2.0:1788639017.332235:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788639017.332243:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+22:10353:x1875523772937600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788639017.332314:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+22:10353:x1875523772937600:12345-0@lo:502:llog_process_th.0 Request processed in 71us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639017.332320:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788639017.332418:0:10353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10353:1875523772937600:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788639017.332435:0:10353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788639017.332878:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1788639017.332917:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788639017.332929:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f23600/0x25c454990262c1c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c1ce expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639017.332939:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae242f23600/0x25c454990262c1c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c1ce expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639017.332949:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788639017.332952:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:0.0:1788639017.332956:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788639017.333000:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae375f55a00/0x25c454990262c1d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639017.333009:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae375f55a00/0x25c454990262c1d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639017.333018:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae375f55a00/0x25c454990262c1d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639017.333033:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772937728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788639017.333069:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639017.333144:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2420b3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788639017.333202:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772937728 00000100:00100000:2.0:1788639017.333206:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772937728 00000100:00100000:2.0:1788639017.333228:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788639017.333234:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+22:6513:x1875523772937728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788639017.333244:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639017.333257:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae242f23000/0x25c454990262c1dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262c1d5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639017.333281:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae242f23000/0x25c454990262c1dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262c1d5 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639017.333293:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae242f23000/0x25c454990262c1dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c1d5 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639017.333302:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f23000, rc 0) 00000100:00100000:2.0:1788639017.333337:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+23:6513:x1875523772937728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639017.333342:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788639017.333455:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772937728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788639017.333469:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae375f55a00/0x25c454990262c1d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c1dc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639017.333492:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae375f55a00/0x25c454990262c1d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262c1dc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639017.333542:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772937856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788639017.333574:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639017.333583:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2420b3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788639017.333736:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772937856 00000100:00100000:2.0:1788639017.333747:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772937856 00000100:00100000:2.0:1788639017.333766:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788639017.333772:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+23:6513:x1875523772937856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788639017.333889:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+23:6513:x1875523772937856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639017.333896:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788639017.333970:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772937856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788639017.334007:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772937984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788639017.334042:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639017.334067:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2420b3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788639017.334118:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772937984 00000100:00100000:2.0:1788639017.334122:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772937984 00000100:00100000:2.0:1788639017.334140:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788639017.334145:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+23:6513:x1875523772937984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788639017.334232:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+23:6513:x1875523772937984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639017.334239:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788639017.334315:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772937984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788639017.335041:0:10354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10354:1875523772938112:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788639017.335089:0:10354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639017.335155:0:10354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3750e2480 going to sleep for 11 seconds 00000100:00100000:2.0:1788639017.335190:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772938112 00000100:00100000:2.0:1788639017.335195:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772938112 00000100:00100000:2.0:1788639017.335259:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788639017.335268:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+23:10354:x1875523772938112:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788639017.335369:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+23:10354:x1875523772938112:12345-0@lo:502:llog_process_th.0 Request processed in 102us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639017.335377:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788639017.335455:0:10354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10354:1875523772938112:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788639017.335479:0:10354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788639017.335490:0:10354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788639017.335493:0:10354:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788639017.335499:0:10354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788639017.335519:0:10354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10354:1875523772938240:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788639017.335552:0:10354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639017.335942:0:10354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2420b3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788639017.336016:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772938240 00000100:00100000:3.0:1788639017.336021:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772938240 00000100:00100000:3.0:1788639017.336046:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788639017.336053:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+23:10354:x1875523772938240:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788639017.336142:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+23:10354:x1875523772938240:12345-0@lo:502:llog_process_th.0 Request processed in 88us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639017.336149:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788639017.336225:0:10354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10354:1875523772938240:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788639017.336246:0:10354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788639017.336251:0:10354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788639017.336253:0:10354:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788639017.336257:0:10354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1788639017.336771:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:3.0:1788639017.336793:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788639017.336804:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae375f55a00/0x25c454990262c1d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c1dc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639017.336815:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae375f55a00/0x25c454990262c1d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c1dc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639017.336826:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788639017.336829:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ae342e50000 from 1 10000000:01000000:3.0:1788639017.336832:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788639017.336864:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4200/0x25c454990262c1e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639017.336872:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4200/0x25c454990262c1e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639017.336882:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4200/0x25c454990262c1e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639017.336908:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772938368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788639017.336945:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639017.336980:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3750e2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788639017.337038:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772938368 00000100:00100000:0.0:1788639017.337043:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772938368 00000100:00100000:0.0:1788639017.337066:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788639017.337073:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+23:6513:x1875523772938368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788639017.337083:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639017.337097:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae375f54a00/0x25c454990262c1ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262c1e3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639017.337121:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae375f54a00/0x25c454990262c1ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262c1e3 expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639017.337132:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae375f54a00/0x25c454990262c1ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c1e3 expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639017.337141:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375f54a00, rc 0) 00000100:00100000:0.0:1788639017.337181:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+24:6513:x1875523772938368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639017.337187:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788639017.337257:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772938368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788639017.337270:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4200/0x25c454990262c1e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c1ea expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639017.337280:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4200/0x25c454990262c1e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262c1ea expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639017.337334:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772938496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788639017.337359:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639017.337380:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3750e2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788639017.337424:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772938496 00000100:00100000:0.0:1788639017.337428:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772938496 00000100:00100000:0.0:1788639017.337456:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788639017.337463:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+24:6513:x1875523772938496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788639017.337538:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+24:6513:x1875523772938496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 76us (178us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788639017.337545:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788639017.337711:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772938496:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788639017.337732:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788639017.337738:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4200/0x25c454990262c1e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c1ea expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639017.337745:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4200/0x25c454990262c1e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c1ea expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639017.396938:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639018.165908:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772938752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788639018.165935:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788639018.165958:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772938624:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788639018.171199:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639018.171537:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639018.171723:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772938752 00000100:00100000:2.0:1788639018.171736:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772938752 00000100:00100000:2.0:1788639018.171804:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772938624 00000100:00100000:2.0:1788639018.171809:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772938624 00000100:00100000:2.0:1788639018.171830:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788639018.171842:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36e14a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772938752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788639018.171886:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788639018.171963:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36e14a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772938752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639018.171971:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788639018.172003:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788639018.172011:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772938624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788639018.172022:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788639018.172058:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772938624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639018.172064:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1788639018.172105:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae36e14b800 x1875523772938624/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639034 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639018.172131:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772938624:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1788639018.172892:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2432c5180 x1875523772938752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639034 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639018.172916:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772938752:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788639018.173018:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788639018.421481:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639019.446542:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639020.469011:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639020.512194:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639020.512326:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754006016 00000100:00100000:0.0:1788639020.512338:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754006016 00000100:00100000:0.0:1788639020.512413:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 242 00000100:00100000:0.0:1788639020.512429:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+8:6177:x1875523754006016:12345-192.168.206.18@tcp:101: 00010000:00010000:0.0:1788639020.512448:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639020.512475:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae375f54600/0x25c454990262c1f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e853ac expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639020.512510:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae375f54600/0x25c454990262c1f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e853ac expref: 9 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639020.512523:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae375f54600/0x25c454990262c1f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e853ac expref: 9 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639020.512538:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375f54600, rc 0) 00000100:00100000:0.0:1788639020.513275:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+9:6177:x1875523754006016:12345-192.168.206.18@tcp:101: Request processed in 848us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639020.513294:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 242 00000100:00100000:2.0:1788639020.518402:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639020.518754:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754006144 00000100:00100000:1.0:1788639020.518767:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754006144 00000100:00100000:1.0:1788639020.518835:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 243 00000100:00100000:1.0:1788639020.518848:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+9:6177:x1875523754006144:12345-192.168.206.18@tcp:501: 00000100:00100000:1.0:1788639020.519140:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+9:6177:x1875523754006144:12345-192.168.206.18@tcp:501: Request processed in 294us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639020.519149:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 243 00000100:00100000:1.0:1788639020.523055:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639020.523364:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754006272 00000100:00100000:3.0:1788639020.523378:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754006272 00000100:00100000:3.0:1788639020.523721:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 244 00000100:00100000:3.0:1788639020.523735:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+9:6177:x1875523754006272:12345-192.168.206.18@tcp:503: 00000100:00100000:3.0:1788639020.524737:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+9:6177:x1875523754006272:12345-192.168.206.18@tcp:503: Request processed in 997us (1688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639020.524750:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 244 00000100:00100000:2.0:1788639020.539374:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639020.539867:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754006400 00000100:00100000:0.0:1788639020.539881:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754006400 00000100:00100000:0.0:1788639020.539961:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 245 00000100:00100000:0.0:1788639020.540071:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+9:6675:x1875523754006400:12345-192.168.206.18@tcp:502: 00000100:00100000:0.0:1788639020.540674:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+9:6675:x1875523754006400:12345-192.168.206.18@tcp:502: Request processed in 688us (1310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639020.540685:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 245 00000100:00100000:2.0:1788639020.548757:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639020.548869:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754006528 00000100:00100000:3.0:1788639020.548884:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754006528 00000100:00100000:3.0:1788639020.548958:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 246 00000100:00100000:3.0:1788639020.549043:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+9:6675:x1875523754006528:12345-192.168.206.18@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788639020.550470:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+9:6675:x1875523754006528:12345-192.168.206.18@tcp:502:llog_process_th.0 Request processed in 1420us (1715us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639020.550485:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 246 00000100:00100000:2.0:1788639020.555109:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639020.555258:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754006656 00000100:00100000:1.0:1788639020.555279:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754006656 00000100:00100000:1.0:1788639020.555361:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 247 00000100:00100000:1.0:1788639020.555374:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+9:6177:x1875523754006656:12345-192.168.206.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788639020.555398:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639020.555424:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae3750fa800/0x25c454990262c1f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e853b3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639020.555458:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae3750fa800/0x25c454990262c1f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e853b3 expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639020.555497:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae3750fa800/0x25c454990262c1f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e853b3 expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639020.555509:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fa800, rc 0) 00000100:00100000:1.0:1788639020.555602:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+10:6177:x1875523754006656:12345-192.168.206.18@tcp:101:ll_cfg_requeue.0 Request processed in 230us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639020.555609:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 247 00000100:00100000:2.0:1788639020.560157:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639020.560342:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754006784 00000100:00100000:0.0:1788639020.560356:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754006784 00000100:00100000:0.0:1788639020.560447:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 248 00000100:00100000:0.0:1788639020.560459:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+10:6177:x1875523754006784:12345-192.168.206.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788639020.561000:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+10:6177:x1875523754006784:12345-192.168.206.18@tcp:501:ll_cfg_requeue.0 Request processed in 541us (855us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788639020.561011:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 248 00000100:00100000:0.0:1788639020.725092:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788639020.725124:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e149c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772938880:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788639020.725222:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639020.726376:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e148380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875523772939136:0@lo:400:kworker.0 00000100:00100000:1.0:1788639020.726432:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639020.726460:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e14aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875523772939648:0@lo:400:kworker.0 00000100:00100000:1.0:1788639020.726483:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639020.726509:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375fb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875523772940160:0@lo:400:kworker.0 00000100:00100000:1.0:1788639020.726544:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639020.726569:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788639020.726575:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e14b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01f1eef9-e690-4065-bf99-bf821af7b626:3644:1875523772939008:0@lo:400:kworker.0 00000100:00100000:1.0:1788639020.726604:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639020.726651:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772939520:0@lo:400:kworker.0 00000100:00100000:1.0:1788639020.726677:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639020.726696:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e14ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772940032:0@lo:400:kworker.0 00000100:00100000:1.0:1788639020.726721:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639020.726749:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523772939392:0@lo:400:kworker.0 00000100:00100000:1.0:1788639020.726774:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639020.726790:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e14bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772939904:0@lo:400:kworker.0 00000100:00100000:1.0:1788639020.726825:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639020.726842:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375fb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772940416:0@lo:400:kworker.0 00000100:00100000:1.0:1788639020.726868:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639020.726888:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788639020.726894:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772939264:0@lo:400:kworker.0 00000100:00100000:1.0:1788639020.726915:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639020.726930:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e149180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875523772939776:0@lo:400:kworker.0 00000100:00100000:1.0:1788639020.726951:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639020.726961:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375fb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875523772940288:0@lo:400:kworker.0 00000100:00100000:1.0:1788639020.726995:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639020.727018:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772939136 00000100:00100000:1.0:1788639020.727027:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772939136 00000100:00100000:1.0:1788639020.727068:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772939648 00000100:00100000:1.0:1788639020.727071:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772939648 00000100:00100000:1.0:1788639020.727090:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772940160 00000100:00100000:1.0:1788639020.727093:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772940160 00000100:00100000:1.0:1788639020.727104:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772939392 00000100:00100000:1.0:1788639020.727106:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772939392 00000100:00100000:1.0:1788639020.727116:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772939776 00000100:00100000:1.0:1788639020.727118:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772939776 00000100:00100000:1.0:1788639020.727129:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772940288 00000100:00100000:1.0:1788639020.727131:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772940288 00000100:00100000:1.0:1788639020.727145:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788639020.727154:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875523772939136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639020.727213:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875523772939136:12345-0@lo:400:kworker.0 Request processed in 60us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639020.727221:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788639020.727238:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788639020.727250:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875523772939648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639020.727278:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875523772939648:12345-0@lo:400:kworker.0 Request processed in 29us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639020.727284:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788639020.727297:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788639020.727303:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875523772940160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639020.727328:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875523772940160:12345-0@lo:400:kworker.0 Request processed in 26us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639020.727334:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788639020.727345:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788639020.727350:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523772939392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639020.727396:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523772939392:12345-0@lo:400:kworker.0 Request processed in 45us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639020.727402:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788639020.727414:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788639020.727420:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875523772939776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639020.727445:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875523772939776:12345-0@lo:400:kworker.0 Request processed in 26us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639020.727451:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788639020.727461:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788639020.727466:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875523772940288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639020.727490:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875523772940288:12345-0@lo:400:kworker.0 Request processed in 24us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639020.727496:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788639020.727522:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772940032 00000100:00100000:1.0:1788639020.727532:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772940032 00000100:00100000:1.0:1788639020.727563:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772939904 00000100:00100000:1.0:1788639020.727566:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772939904 00000100:00100000:1.0:1788639020.727577:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772940416 00000100:00100000:1.0:1788639020.727580:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772940416 00000100:00100000:1.0:1788639020.727593:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788639020.727598:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772940032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639020.727666:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772940032:12345-0@lo:400:kworker.0 Request processed in 68us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639020.727672:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788639020.727685:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788639020.727691:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772939904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639020.727717:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772939904:12345-0@lo:400:kworker.0 Request processed in 27us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639020.727723:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788639020.727733:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788639020.727738:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772940416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639020.727764:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772940416:12345-0@lo:400:kworker.0 Request processed in 26us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639020.727769:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1788639020.727822:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae36e149180 x1875523772939776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639020.727825:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772938880 00000100:00100000:2.0:1788639020.727830:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772938880 00000100:00100000:1.0:1788639020.727840:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e149180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875523772939776:0@lo:400:kworker.0 00010000:00080000:1.0:1788639020.727852:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375fb1880 x1875523772940288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639020.727861:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375fb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875523772940288:0@lo:400:kworker.0 00000100:00100000:2.0:1788639020.727867:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788639020.727874:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772938880:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788639020.727881:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523772939392:0@lo:400:kworker.0 00010000:00080000:1.0:1788639020.727891:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae36e14bb80 x1875523772939904/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639020.727898:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e14bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772939904:0@lo:400:kworker.0 00002000:00000024:2.0:1788639020.727901:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:1.0:1788639020.727907:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375fb0000 x1875523772940416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639020.727914:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375fb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772940416:0@lo:400:kworker.0 00000100:00100000:2.0:1788639020.727944:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772938880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (2722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639020.727951:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1788639020.727956:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae36e14ad80 x1875523772940032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639020.727977:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e14ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772940032:0@lo:400:kworker.0 00000100:00100000:1.0:1788639020.727990:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e148380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875523772939136:0@lo:400:kworker.0 00000100:00100000:2.0:1788639020.727998:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772939520 00000100:00100000:1.0:1788639020.728000:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e14aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875523772939648:0@lo:400:kworker.0 00000100:00100000:2.0:1788639020.728001:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772939520 00000100:00100000:1.0:1788639020.728010:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375fb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875523772940160:0@lo:400:kworker.0 00000100:00100000:2.0:1788639020.728018:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772939264 00000100:00100000:2.0:1788639020.728021:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772939264 00000100:00100000:2.0:1788639020.728035:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788639020.728040:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772939520:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1788639020.728076:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae36e149c00 x1875523772938880/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639036 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639020.728080:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772939520:12345-0@lo:400:kworker.0 Request processed in 40us (1402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639020.728086:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788639020.728094:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e149c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772938880:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788639020.728097:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788639020.728102:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772939264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639020.728124:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772939520:0@lo:400:kworker.0 00000100:00100000:2.0:1788639020.728130:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772939264:12345-0@lo:400:kworker.0 Request processed in 29us (1215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639020.728136:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788639020.728148:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772939264:0@lo:400:kworker.0 00000100:00100000:3.0:1788639020.731245:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772939008 00000100:00100000:3.0:1788639020.731269:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772939008 00000100:00100000:3.0:1788639020.731362:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788639020.731376:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370fff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+24:3644:x1875523772939008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639020.731521:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370fff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+24:3644:x1875523772939008:12345-0@lo:400:kworker.0 Request processed in 149us (4915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639020.731530:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00080000:0.0:1788639020.731710:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788639020.731718:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788639020.731721:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e14b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01f1eef9-e690-4065-bf99-bf821af7b626:3644:1875523772939008:0@lo:400:kworker.0 00000100:00080000:0.0:1788639020.731722:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788639020.731725:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788639021.237919:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772940544:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788639021.238036:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639021.238119:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788639021.238126:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772940672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788639021.238156:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639021.238407:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772940544 00000100:00100000:3.0:1788639021.238418:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772940544 00000100:00100000:2.0:1788639021.239977:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772940672 00000100:00100000:2.0:1788639021.239989:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772940672 00000100:00100000:2.0:1788639021.240061:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788639021.240073:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772940672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788639021.240106:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788639021.240201:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772940672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (2043us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639021.240209:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1788639021.240270:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2432ca300 x1875523772940672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639037 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639021.240295:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772940672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788639021.243653:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788639021.243704:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772940544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788639021.243762:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788639021.243874:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772940544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 182us (5837us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639021.243882:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788639021.244053:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772940544:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788639021.496002:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639021.754346:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788639021.754376:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375fb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772940800:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788639021.754481:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639021.754571:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772940800 00000100:00100000:1.0:1788639021.754580:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772940800 00000100:00100000:1.0:1788639021.754659:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788639021.754670:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772940800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788639021.754713:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788639021.754766:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772940800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639021.754773:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788639021.754841:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375fb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772940800:0@lo:41:osp-pre-1-0.0 00000020:00000080:1.0:1788639022.010876:0:10391:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff02b20000 20000000:00000080:1.0:1788639022.010898:0:10391:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ae375fb4400 uarg=0000000000000000 20000000:01000000:1.0:1788639022.010952:0:10391:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788639022.010970:0:10391:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788639022.010976:0:10391:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788639022.012004:0:10392:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1788639022.012210:0:10391:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1788639022.029152:0:10391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1788639022.029204:0:10391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1788639022.029224:0:10391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1788639022.029251:0:10391:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788639022.029278:0:10391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ae375f55800/0x25c454990262c1ff lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639022.029302:0:10391:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae3750fa600/0x25c454990262be9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262be94 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639022.029334:0:10391:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae38217a400/0x25c454990262bea9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262bea2 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639022.029342:0:10391:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae38217ba00/0x25c454990262befd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262bef6 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639022.029350:0:10391:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae38217aa00/0x25c454990262c023 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c01c expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639022.029362:0:10391:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae242f22e00/0x25c454990262c13b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85374 expref: 9 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639022.029370:0:10391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ae375f55800/0x25c454990262c1ff lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639022.030015:0:10391:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae242f22e00/0x25c454990262c13b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85374 expref: 9 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639022.030038:0:10391:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae242f22e00/0x25c454990262c13b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85374 expref: 9 pid: 6508 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639022.030058:0:10391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10391:1875523772940928:192.168.206.18@tcp:104: 00010000:00010000:0.0:1788639022.030264:0:10391:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae38217aa00/0x25c454990262c023 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262c01c expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639022.030274:0:10391:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ae38217aa00/0x25c454990262c023 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262c01c expref: 23 pid: 6508 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639022.030285:0:10391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10391:1875523772941056:0@lo:104: 00000100:00100000:0.0:1788639022.030349:0:10391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788639022.030452:0:10391:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae38217ba00/0x25c454990262befd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262bef6 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639022.030462:0:10391:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ae38217ba00/0x25c454990262befd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262bef6 expref: 23 pid: 6508 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639022.030472:0:10391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10391:1875523772941184:0@lo:104: 00000100:00100000:0.0:1788639022.030500:0:10391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788639022.030525:0:10391:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae38217a400/0x25c454990262bea9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262bea2 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639022.030534:0:10391:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ae38217a400/0x25c454990262bea9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262bea2 expref: 23 pid: 6510 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639022.030542:0:10391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10391:1875523772941312:0@lo:104: 00010000:00010000:0.0:1788639022.030563:0:10391:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae3750fa600/0x25c454990262be9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262be94 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639022.030571:0:10391:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ae3750fa600/0x25c454990262be9b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262be94 expref: 23 pid: 6508 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639022.030578:0:10391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10391:1875523772941440:0@lo:104: 00000100:00100000:0.0:1788639022.030597:0:10391:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2420b3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788639022.031227:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772941056 00000100:00100000:3.0:1788639022.031232:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788639022.031248:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772941056 00000100:00100000:3.0:1788639022.031271:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639022.031297:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639022.031314:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772941184 00000100:00100000:1.0:1788639022.031320:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772941184 00000100:00100000:3.0:1788639022.031327:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772941312 00000100:00100000:1.0:1788639022.031336:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772941440 00000100:00100000:3.0:1788639022.031337:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772941312 00000100:00100000:1.0:1788639022.031348:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772941440 00000100:00100000:1.0:1788639022.031395:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788639022.031410:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+6:10391:x1875523772941056:12345-0@lo:104: 00010000:00010000:1.0:1788639022.031431:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa200/0x25c454990262c01c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262c023 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639022.031534:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788639022.031553:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+6:10391:x1875523772941056:12345-0@lo:104: Request processed in 147us (1204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639022.031560:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788639022.031579:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788639022.031588:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2430f1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+5:10391:x1875523772941184:12345-0@lo:104: 00010000:00010000:1.0:1788639022.031597:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae3750fae00/0x25c454990262bef6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262befd expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639022.031604:0:9519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788639022.031655:0:9519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa200/0x25c454990262c01c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262c023 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639022.031666:0:9519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fa200 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:3.0:1788639022.031672:0:9519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa200/0x25c454990262c01c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262c023 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639022.031683:0:9519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa200/0x25c454990262c01c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262c023 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639022.031684:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788639022.031698:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2430f1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+5:10391:x1875523772941184:12345-0@lo:104: Request processed in 110us (1195us total) trans 0 rc 0/0 10000000:00010000:3.0:1788639022.031703:0:9519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa200/0x25c454990262c01c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262c023 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639022.031712:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 10000000:01000000:3.0:1788639022.031723:0:9519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1788639022.031757:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788639022.031767:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+4:10391:x1875523772941440:12345-0@lo:104: 00010000:00010000:1.0:1788639022.031777:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae340031800/0x25c454990262be94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262be9b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639022.031779:0:9519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa200/0x25c454990262c01c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c023 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639022.031810:0:9519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788639022.031841:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1788639022.031847:0:9519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa200/0x25c454990262c01c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c023 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639022.031850:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+4:10391:x1875523772941440:12345-0@lo:104: Request processed in 85us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639022.031856:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788639022.031874:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00010000:00010000:3.0:1788639022.031888:0:9519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa200/0x25c454990262c01c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c023 expref: -99 pid: 9508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639022.031890:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+3:10391:x1875523772941312:12345-0@lo:104: 00010000:00010000:1.0:1788639022.031916:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae38217a600/0x25c454990262bea2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262bea9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639022.031924:0:9519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788639022.031930:0:9519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae3750fae00/0x25c454990262bef6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262befd expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639022.031937:0:9519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fae00 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:3.0:1788639022.031941:0:9519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae3750fae00/0x25c454990262bef6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262befd expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639022.031951:0:9519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae3750fae00/0x25c454990262bef6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262befd expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788639022.031968:0:9519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae3750fae00/0x25c454990262bef6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262befd expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639022.031974:0:9519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788639022.031975:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788639022.031991:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+3:10391:x1875523772941312:12345-0@lo:104: Request processed in 104us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639022.031998:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:3.0:1788639022.032000:0:9519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae3750fae00/0x25c454990262bef6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262befd expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639022.032010:0:9519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788639022.032035:0:9519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae3750fae00/0x25c454990262bef6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262befd expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639022.032039:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788639022.032043:0:9519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae3750fae00/0x25c454990262bef6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262befd expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639022.032049:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae340031800/0x25c454990262be94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262be9b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639022.032058:0:9519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788639022.032059:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae340031800 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:1.0:1788639022.032064:0:8446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae340031800/0x25c454990262be94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262be9b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639022.032073:0:9519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae38217a600/0x25c454990262bea2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262bea9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639022.032077:0:8446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae340031800/0x25c454990262be94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262be9b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639022.032087:0:9519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae38217a600 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:1.0:1788639022.032093:0:8446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae340031800/0x25c454990262be94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262be9b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788639022.032095:0:9519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae38217a600/0x25c454990262bea2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262bea9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788639022.032134:0:8446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788639022.032136:0:9519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae38217a600/0x25c454990262bea2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262bea9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788639022.032153:0:9519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae38217a600/0x25c454990262bea2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262bea9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639022.032159:0:9519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788639022.032172:0:8446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae340031800/0x25c454990262be94 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262be9b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639022.032182:0:8446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788639022.032184:0:9519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae38217a600/0x25c454990262bea2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bea9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639022.032195:0:9519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788639022.032198:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae340031800/0x25c454990262be94 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262be9b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639022.032206:0:9519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae38217a600/0x25c454990262bea2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bea9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639022.032210:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae340031800/0x25c454990262be94 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262be9b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639022.032229:0:9519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae38217a600/0x25c454990262bea2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262bea9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639022.032240:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639022.032246:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639022.032249:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639022.032255:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639022.032260:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639022.032264:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639022.032280:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01f1eef9-e690-4065-bf99-bf821af7b626:3642:1875523772941568:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788639022.032297:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772941952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788639022.032330:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639022.033369:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523772941696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788639022.033701:0:10391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10391:1875523772941056:0@lo:104: 00000100:00100000:0.0:1788639022.033742:0:10391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10391:1875523772941184:0@lo:104: 00000100:00100000:0.0:1788639022.033752:0:10391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10391:1875523772941312:0@lo:104: 00000100:00100000:0.0:1788639022.033761:0:10391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10391:1875523772941440:0@lo:104: 00010000:00010000:0.0:1788639022.038735:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639022.038749:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639022.040695:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772941568 00000100:00100000:0.0:1788639022.040717:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772941568 00010000:00010000:0.0:1788639022.040781:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae38217aa00/0x25c454990262c023 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262c01c expref: 24 pid: 6508 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639022.040831:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788639022.040842:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01f1eef9-e690-4065-bf99-bf821af7b626+24:3642:x1875523772941568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788639022.040874:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788639022.040881:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae38217aa00/0x25c454990262c023 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262c01c expref: 24 pid: 6508 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639022.040894:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae38217aa00/0x25c454990262c023 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262c01c expref: 24 pid: 6508 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639022.040917:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae38217aa00/0x25c454990262c023 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262c01c expref: 24 pid: 6508 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639022.040948:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788639022.041044:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01f1eef9-e690-4065-bf99-bf821af7b626+23:3642:x1875523772941568:12345-0@lo:103:ldlm_bl.0 Request processed in 203us (8716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639022.041052:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788639022.041187:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375fb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01f1eef9-e690-4065-bf99-bf821af7b626:3644:1875523772941824:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788639022.041238:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639022.041548:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772941824 00000100:00100000:0.0:1788639022.041553:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772941824 00010000:00010000:0.0:1788639022.041573:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae3750fa600/0x25c454990262be9b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262be94 expref: 23 pid: 6508 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639022.041601:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788639022.041608:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01f1eef9-e690-4065-bf99-bf821af7b626+23:3644:x1875523772941824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788639022.041663:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788639022.041670:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae3750fa600/0x25c454990262be9b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262be94 expref: 23 pid: 6508 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639022.041680:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae3750fa600/0x25c454990262be9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262be94 expref: 23 pid: 6508 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639022.041695:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae3750fa600/0x25c454990262be9b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262be94 expref: 23 pid: 6508 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639022.041707:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788639022.041738:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01f1eef9-e690-4065-bf99-bf821af7b626+22:3644:x1875523772941824:12345-0@lo:103:ldlm_bl.0 Request processed in 131us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639022.041745:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788639022.044241:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375fb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01f1eef9-e690-4065-bf99-bf821af7b626:3644:1875523772941824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788639022.046338:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639022.046553:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772941696 00000100:00100000:0.0:1788639022.046564:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772941696 00010000:00010000:0.0:1788639022.046612:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae38217ba00/0x25c454990262befd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262bef6 expref: 22 pid: 6508 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639022.046685:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788639022.046696:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01f1eef9-e690-4065-bf99-bf821af7b626+22:3643:x1875523772941696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788639022.046716:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788639022.046722:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae38217ba00/0x25c454990262befd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262bef6 expref: 22 pid: 6508 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639022.046736:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae38217ba00/0x25c454990262befd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262bef6 expref: 22 pid: 6508 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639022.046758:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae38217ba00/0x25c454990262befd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262bef6 expref: 22 pid: 6508 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639022.046790:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788639022.046835:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01f1eef9-e690-4065-bf99-bf821af7b626+21:3643:x1875523772941696:12345-0@lo:103:ldlm_bl.0 Request processed in 140us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639022.046842:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788639022.047940:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639022.048032:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01f1eef9-e690-4065-bf99-bf821af7b626:3642:1875523772941568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788639022.048090:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754006912 00000100:00100000:1.0:1788639022.048098:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754006912 00010000:00010000:1.0:1788639022.048138:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae242f22e00/0x25c454990262c13b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85374 expref: 10 pid: 6508 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639022.048165:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 38 00000100:00100000:1.0:1788639022.048177:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1343f14-ed5c-4943-b596-61180b04fa87+10:2407:x1875523754006912:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788639022.048193:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788639022.048201:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae242f22e00/0x25c454990262c13b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85374 expref: 10 pid: 6508 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639022.048220:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae242f22e00/0x25c454990262c13b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85374 expref: 10 pid: 6508 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639022.048227:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523772941696:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788639022.048246:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788639022.048317:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1343f14-ed5c-4943-b596-61180b04fa87+10:2407:x1875523754006912:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 142us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639022.048324:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 38 00000100:00100000:1.0:1788639022.048368:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788639022.048425:0:10391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae242f22e00/0x25c454990262c13b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85374 expref: 9 pid: 6508 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639022.048442:0:10391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10391:1875523772940928:192.168.206.18@tcp:104: 00010000:00010000:0.0:1788639022.048482:0:10391:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ae375f55800/0x25c454990262c1ff lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639022.053162:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639022.053572:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639022.053699:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754007040 00000100:00100000:1.0:1788639022.053715:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754007040 00000100:00100000:2.0:1788639022.053722:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639022.053758:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639022.053843:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754007168 00000100:00100000:1.0:1788639022.053849:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754007168 00000100:00100000:1.0:1788639022.053883:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 67 00000100:00100000:1.0:1788639022.053893:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2408:x1875523754007040:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:1.0:1788639022.054000:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2408:x1875523754007040:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 108us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639022.054008:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 67 00000100:00100000:1.0:1788639022.054026:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 68 00000100:00100000:1.0:1788639022.054039:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2408:x1875523754007168:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:1.0:1788639022.054068:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2408:x1875523754007168:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 35us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639022.054075:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 68 00000100:00080000:1.0:1788639022.054106:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788639022.054112:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788639022.054161:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772941952 00000100:00100000:3.0:1788639022.054171:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772941952 00010000:00010000:3.0:1788639022.054208:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae38217a400/0x25c454990262bea9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262bea2 expref: 21 pid: 6510 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639022.054247:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788639022.054256:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ff8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01f1eef9-e690-4065-bf99-bf821af7b626+21:3641:x1875523772941952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788639022.054271:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639022.054277:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae38217a400/0x25c454990262bea9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262bea2 expref: 21 pid: 6510 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639022.054290:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae38217a400/0x25c454990262bea9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262bea2 expref: 21 pid: 6510 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639022.054311:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae38217a400/0x25c454990262bea9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262bea2 expref: 21 pid: 6510 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639022.054330:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ae375f55800/0x25c454990262c1ff lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639022.054340:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae375f55800/0x25c454990262c1ff lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639022.054359:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae375f55800/0x25c454990262c1ff lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639022.054367:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae375f55800/0x25c454990262c1ff lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639022.054375:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ae375f55800/0x25c454990262c1ff lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639022.054401:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ae375f55800/0x25c454990262c1ff lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639022.054409:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375f55800 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:3.0:1788639022.054414:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ae375f55800/0x25c454990262c1ff lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639022.054680:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ae375f55800/0x25c454990262c1ff lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639022.054744:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ae375f55800/0x25c454990262c1ff lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639022.054757:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788639022.054781:0:10391:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ae375f55800/0x25c454990262c1ff lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639022.054827:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ff8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01f1eef9-e690-4065-bf99-bf821af7b626+20:3641:x1875523772941952:12345-0@lo:103:ldlm_bl.0 Request processed in 571us (6459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639022.054836:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:1.0:1788639022.054889:0:10391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ae375f55800/0x25c454990262c1ff lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639022.054899:0:10391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae375f55800/0x25c454990262c1ff lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639022.055047:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772941952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788639022.058721:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754007296 00000100:00100000:0.0:1788639022.058741:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754007296 00000100:00080000:2.0:1788639022.058913:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788639022.059037:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754007424 00000100:00100000:0.0:1788639022.059042:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754007424 00000100:00100000:0.0:1788639022.059085:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 24 00000100:00100000:0.0:1788639022.059097:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2408:x1875523754007296:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639022.059199:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2408:x1875523754007296:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 103us (5626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639022.059208:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 24 00000100:00100000:0.0:1788639022.059240:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 25 00000100:00100000:0.0:1788639022.059253:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2408:x1875523754007424:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639022.059284:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2408:x1875523754007424:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 34us (5523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639022.059292:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 25 00000100:00080000:1.0:1788639022.060921:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788639022.202886:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639022.202979:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754007552 00000100:00100000:0.0:1788639022.202993:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754007552 00000100:00100000:0.0:1788639022.203054:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 250 00000100:00100000:0.0:1788639022.203065:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+9:6177:x1875523754007552:12345-192.168.206.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788639022.203087:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639022.203113:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae340030e00/0x25c454990262c206 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e853ba expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639022.203149:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae340030e00/0x25c454990262c206 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e853ba expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639022.203163:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae340030e00/0x25c454990262c206 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e853ba expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639022.203174:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae340030e00, rc 0) 00000100:00100000:0.0:1788639022.203242:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+10:6177:x1875523754007552:12345-192.168.206.18@tcp:101:ll_cfg_requeue.0 Request processed in 180us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639022.203250:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 250 00000100:00100000:0.0:1788639022.206127:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639022.206195:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754007680 00000100:00100000:2.0:1788639022.206212:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754007680 00000100:00100000:2.0:1788639022.206277:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 251 00000100:00100000:2.0:1788639022.206289:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+10:6177:x1875523754007680:12345-192.168.206.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788639022.206826:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+10:6177:x1875523754007680:12345-192.168.206.18@tcp:501:ll_cfg_requeue.0 Request processed in 536us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639022.206836:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 251 00000100:00100000:3.0:1788639022.211948:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639022.212849:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754007808 00000100:00100000:2.0:1788639022.212866:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754007808 00000100:00100000:2.0:1788639022.212944:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 252 00000100:00100000:2.0:1788639022.212968:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+10:6177:x1875523754007808:12345-192.168.206.18@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788639022.213185:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+10:6177:x1875523754007808:12345-192.168.206.18@tcp:503:ll_cfg_requeue.0 Request processed in 230us (1248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639022.213207:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 252 00000100:00100000:0.0:1788639022.217997:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639022.218454:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754007936 00000100:00100000:2.0:1788639022.218467:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754007936 00000100:00100000:2.0:1788639022.218546:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 253 00000100:00100000:2.0:1788639022.218560:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370fff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+10:6711:x1875523754007936:12345-192.168.206.18@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788639022.218801:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370fff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+10:6711:x1875523754007936:12345-192.168.206.18@tcp:502:llog_process_th.0 Request processed in 244us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639022.218809:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 253 00000100:00100000:1.0:1788639022.225231:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639022.225488:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754008064 00000100:00100000:2.0:1788639022.225501:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754008064 00000100:00100000:2.0:1788639022.225577:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 254 00000100:00100000:2.0:1788639022.225590:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+10:6711:x1875523754008064:12345-192.168.206.18@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788639022.225817:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+10:6711:x1875523754008064:12345-192.168.206.18@tcp:502:llog_process_th.0 Request processed in 229us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639022.225826:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 254 00010000:00010000:0.0:1788639022.516811:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639023.285902:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772942080:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788639023.286524:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788639023.286544:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375fb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772942208:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788639023.286587:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639023.287851:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639023.288395:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772942208 00000100:00100000:1.0:1788639023.288407:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772942208 00000100:00100000:1.0:1788639023.288472:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772942080 00000100:00100000:1.0:1788639023.288475:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772942080 00000100:00100000:1.0:1788639023.288494:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788639023.288505:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772942208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788639023.288544:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788639023.288658:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772942208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 153us (2070us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639023.288666:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1788639023.288670:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788639023.288688:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788639023.288695:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772942080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788639023.288706:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:3.0:1788639023.288767:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2432c6680 x1875523772942080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639039 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639023.288795:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772942080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639023.288799:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772942080:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788639023.288866:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1788639023.290160:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375fb3800 x1875523772942208/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639039 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639023.290186:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375fb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772942208:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788639023.543463:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788639023.988883:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788639023.988902:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae375f89000 from 4 10000000:01000000:3.0:1788639023.988909:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788639023.988981:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4800/0x25c454990262c20d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639023.989073:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4800/0x25c454990262c20d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639023.989088:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4800/0x25c454990262c20d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639023.989192:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772942336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788639023.989302:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639023.989380:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2431a4480 going to sleep for 11 seconds 00000100:00100000:2.0:1788639023.989484:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772942336 00000100:00100000:2.0:1788639023.989495:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772942336 00000100:00100000:2.0:1788639023.989559:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788639023.989570:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+20:6513:x1875523772942336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788639023.989588:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639023.989605:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae242f23c00/0x25c454990262c214 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262c20d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639023.989767:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae242f23c00/0x25c454990262c214 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262c20d expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639023.989793:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae242f23c00/0x25c454990262c214 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c20d expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639023.989931:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f23c00, rc 0) 00000100:00100000:2.0:1788639023.990006:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+21:6513:x1875523772942336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 437us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639023.990014:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788639023.990253:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772942336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788639023.990272:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4800/0x25c454990262c20d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c214 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639023.990282:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4800/0x25c454990262c20d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262c214 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639023.990359:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772942464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788639023.990466:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639023.990505:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2431a4480 going to sleep for 11 seconds 00000100:00100000:2.0:1788639023.990553:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772942464 00000100:00100000:2.0:1788639023.990559:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772942464 00000100:00100000:2.0:1788639023.990596:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788639023.990605:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae369901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+21:6513:x1875523772942464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788639023.990764:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae369901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+21:6513:x1875523772942464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 159us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639023.990772:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788639023.990989:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772942464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788639023.991105:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772942592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788639023.991150:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639023.991184:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2431a4480 going to sleep for 11 seconds 00000100:00100000:0.0:1788639023.991198:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772942592 00000100:00100000:0.0:1788639023.991206:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772942592 00000100:00100000:0.0:1788639023.991342:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788639023.991352:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae369903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+21:6513:x1875523772942592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788639023.991462:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae369903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+21:6513:x1875523772942592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 112us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639023.991469:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788639023.991694:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772942592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788639023.992218:0:10485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10485:1875523772942720:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788639023.992270:0:10485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639023.992300:0:10485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3471f0840 going to sleep for 11 seconds 00000100:00100000:2.0:1788639023.993702:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772942720 00000100:00100000:2.0:1788639023.993717:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772942720 00000100:00100000:2.0:1788639023.993766:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788639023.993778:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae369902c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+21:10485:x1875523772942720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788639023.994245:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae369902c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+21:10485:x1875523772942720:12345-0@lo:502:llog_process_th.0 Request processed in 467us (1971us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639023.994254:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788639023.994555:0:10485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10485:1875523772942720:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788639023.994599:0:10485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788639023.994610:0:10485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788639023.994645:0:10485:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788639023.994655:0:10485:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ae375f89000 00000020:00000080:1.0:1788639023.994658:0:10485:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788639023.995567:0:10485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375fb3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10485:1875523772942848:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788639023.995666:0:10485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639023.995709:0:10485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788639023.995842:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772942848 00000100:00100000:0.0:1788639023.995851:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772942848 00000100:00100000:0.0:1788639023.995907:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788639023.995918:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae369902850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+21:10485:x1875523772942848:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788639023.996079:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae369902850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+21:10485:x1875523772942848:12345-0@lo:502:llog_process_th.0 Request processed in 163us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639023.996088:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788639023.998194:0:10485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375fb3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10485:1875523772942848:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788639023.998252:0:10485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788639023.998263:0:10485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788639023.998266:0:10485:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788639023.998277:0:10485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788639023.999099:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788639023.999177:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788639023.999192:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4800/0x25c454990262c20d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c214 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639023.999206:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4800/0x25c454990262c20d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c214 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788639023.999217:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788639023.999221:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae375ea2800 from 4 10000000:01000000:2.0:1788639023.999224:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788639023.999286:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f22400/0x25c454990262c21b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639023.999731:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae242f22400/0x25c454990262c21b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639023.999745:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae242f22400/0x25c454990262c21b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639023.999787:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772942976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788639024.000992:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639024.001139:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772942976 00000100:00100000:1.0:1788639024.001150:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772942976 00000100:00100000:1.0:1788639024.001231:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788639024.001243:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae369903c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+21:6513:x1875523772942976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788639024.001265:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639024.001289:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae3750faa00/0x25c454990262c222 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262c21b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639024.001551:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3471f09c0 going to sleep for 10 seconds 00010000:00010000:1.0:1788639024.002216:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae3750faa00/0x25c454990262c222 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262c21b expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639024.002233:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae3750faa00/0x25c454990262c222 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c21b expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639024.002244:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750faa00, rc 0) 00000100:00100000:1.0:1788639024.004161:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae369903c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+22:6513:x1875523772942976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2906us (3161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639024.004174:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788639024.007846:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772942976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788639024.007887:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae242f22400/0x25c454990262c21b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c222 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639024.007904:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae242f22400/0x25c454990262c21b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262c222 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639024.008028:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772943104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788639024.008109:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639024.008174:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2431a4900 going to sleep for 11 seconds 00000100:00100000:1.0:1788639024.008345:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772943104 00000100:00100000:1.0:1788639024.008355:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772943104 00000100:00100000:1.0:1788639024.008413:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788639024.008424:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae369900050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+22:6513:x1875523772943104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788639024.008581:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae369900050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+22:6513:x1875523772943104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 158us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639024.008589:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788639024.011738:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772943104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788639024.011820:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772943232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788639024.011912:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639024.011972:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772943232 00000100:00100000:3.0:1788639024.011980:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772943232 00000100:00100000:3.0:1788639024.012037:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788639024.012047:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae369900850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+22:6513:x1875523772943232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788639024.012177:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae369900850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+22:6513:x1875523772943232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639024.012185:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788639024.012250:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2431a4900 going to sleep for 11 seconds 00000100:00100000:3.0:1788639024.012263:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772943232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788639024.015144:0:10491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10491:1875523772943360:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788639024.015243:0:10491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639024.015297:0:10491:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2431a4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788639024.015332:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772943360 00000100:00100000:1.0:1788639024.015343:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772943360 00000100:00100000:1.0:1788639024.015401:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788639024.015421:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+22:10491:x1875523772943360:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788639024.015610:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+22:10491:x1875523772943360:12345-0@lo:502:llog_process_th.0 Request processed in 191us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639024.015641:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788639024.017170:0:10491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10491:1875523772943360:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788639024.017225:0:10491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788639024.017239:0:10491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788639024.017242:0:10491:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788639024.017252:0:10491:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ae375ea2800 00000020:00000080:3.0:1788639024.017255:0:10491:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788639024.017381:0:10491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10491:1875523772943488:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788639024.017459:0:10491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639024.017508:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772943488 00000100:00100000:3.0:1788639024.017516:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772943488 00000100:00100000:2.0:1788639024.019772:0:10491:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2431a4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788639024.022925:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788639024.022959:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+22:10491:x1875523772943488:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788639024.023179:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+22:10491:x1875523772943488:12345-0@lo:502:llog_process_th.0 Request processed in 239us (5718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639024.023188:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788639024.023481:0:10491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10491:1875523772943488:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788639024.023547:0:10491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788639024.023557:0:10491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788639024.023561:0:10491:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788639024.023568:0:10491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788639024.023730:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788639024.023755:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788639024.023768:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f22400/0x25c454990262c21b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c222 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639024.023780:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae242f22400/0x25c454990262c21b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c222 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788639024.023793:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788639024.023796:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae3506e9000 from 4 10000000:01000000:2.0:1788639024.023799:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788639024.023839:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f23e00/0x25c454990262c229 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639024.023848:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae242f23e00/0x25c454990262c229 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639024.023858:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae242f23e00/0x25c454990262c229 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639024.023884:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772943616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788639024.023934:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639024.023985:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d2626c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788639024.024280:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772943616 00000100:00100000:3.0:1788639024.024290:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772943616 00000100:00100000:3.0:1788639024.024344:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788639024.024356:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+22:6513:x1875523772943616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788639024.024370:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639024.024388:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae3429e5800/0x25c454990262c230 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262c229 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639024.024417:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae3429e5800/0x25c454990262c230 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262c229 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639024.024430:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae3429e5800/0x25c454990262c230 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c229 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639024.024454:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3429e5800, rc 0) 00000100:00100000:3.0:1788639024.026008:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+23:6513:x1875523772943616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1643us (2062us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639024.026023:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788639024.026145:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772943616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788639024.026186:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae242f23e00/0x25c454990262c229 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c230 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639024.026201:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae242f23e00/0x25c454990262c229 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262c230 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639024.026315:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772943744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788639024.026379:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639024.026420:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d2626c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788639024.026441:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772943744 00000100:00100000:2.0:1788639024.026447:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772943744 00000100:00100000:2.0:1788639024.026498:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788639024.027145:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+23:6513:x1875523772943744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788639024.027337:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+23:6513:x1875523772943744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 829us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639024.027346:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788639024.027404:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772943744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788639024.027452:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772943872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788639024.027877:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639024.027972:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d2626c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788639024.027990:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772943872 00000100:00100000:2.0:1788639024.027997:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772943872 00000100:00100000:3.0:1788639024.028049:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788639024.028062:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+23:6513:x1875523772943872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788639024.028172:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+23:6513:x1875523772943872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 113us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639024.028181:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788639024.028234:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772943872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788639024.028548:0:10494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10494:1875523772944000:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788639024.028594:0:10494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639024.028646:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772944000 00000100:00100000:3.0:1788639024.028651:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772944000 00000100:00100000:3.0:1788639024.028676:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788639024.028683:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+23:10494:x1875523772944000:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788639024.028778:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+23:10494:x1875523772944000:12345-0@lo:502:llog_process_th.0 Request processed in 94us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639024.028786:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788639024.028820:0:10494:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2431a46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788639024.028833:0:10494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10494:1875523772944000:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788639024.028856:0:10494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788639024.028869:0:10494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788639024.028878:0:10494:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788639024.028888:0:10494:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ae3506e9000 00000020:00000080:3.0:1788639024.028891:0:10494:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788639024.029005:0:10494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10494:1875523772944128:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788639024.029040:0:10494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639024.029061:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772944128 00000100:00100000:3.0:1788639024.029065:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772944128 00000100:00100000:3.0:1788639024.029088:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788639024.029094:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+23:10494:x1875523772944128:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788639024.029163:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+23:10494:x1875523772944128:12345-0@lo:502:llog_process_th.0 Request processed in 68us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639024.029170:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788639024.029204:0:10494:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2431a46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788639024.029217:0:10494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10494:1875523772944128:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788639024.029235:0:10494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788639024.029240:0:10494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788639024.029242:0:10494:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788639024.029247:0:10494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788639024.029307:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788639024.029330:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788639024.029342:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f23e00/0x25c454990262c229 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c230 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639024.029355:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae242f23e00/0x25c454990262c229 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c230 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639024.029368:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788639024.029371:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae3461e3800 from 4 10000000:01000000:3.0:1788639024.029375:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788639024.029412:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4600/0x25c454990262c237 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639024.029421:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4600/0x25c454990262c237 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639024.029432:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4600/0x25c454990262c237 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639024.029447:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772944256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788639024.029476:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639024.029490:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2431a46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788639024.029502:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772944256 00000100:00100000:3.0:1788639024.029505:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772944256 00000100:00100000:3.0:1788639024.029527:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788639024.029535:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+23:6513:x1875523772944256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788639024.029544:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639024.029561:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae38217a400/0x25c454990262c23e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262c237 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639024.029588:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae38217a400/0x25c454990262c23e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262c237 expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639024.029599:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae38217a400/0x25c454990262c23e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c237 expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639024.029608:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae38217a400, rc 0) 00000100:00100000:3.0:1788639024.029662:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+24:6513:x1875523772944256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639024.029668:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788639024.029711:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772944256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788639024.029726:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4600/0x25c454990262c237 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c23e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639024.029736:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4600/0x25c454990262c237 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262c23e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639024.029789:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772944384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788639024.029817:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639024.029832:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2431a46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788639024.029844:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772944384 00000100:00100000:3.0:1788639024.029847:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772944384 00000100:00100000:3.0:1788639024.029866:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788639024.029872:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+24:6513:x1875523772944384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788639024.029995:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+24:6513:x1875523772944384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 123us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639024.030003:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788639024.030034:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772944384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788639024.030059:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772944512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788639024.030100:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639024.030112:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2431a46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788639024.030123:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772944512 00000100:00100000:3.0:1788639024.030127:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772944512 00000100:00100000:3.0:1788639024.030149:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788639024.030155:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+24:6513:x1875523772944512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788639024.030231:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+24:6513:x1875523772944512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639024.030244:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788639024.030287:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772944512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788639024.033941:0:10495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10495:1875523772944640:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788639024.034064:0:10495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639024.034114:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772944640 00000100:00100000:3.0:1788639024.034123:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772944640 00000100:00100000:3.0:1788639024.034182:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788639024.034193:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+24:10495:x1875523772944640:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788639024.034337:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+24:10495:x1875523772944640:12345-0@lo:502:llog_process_th.0 Request processed in 145us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639024.034346:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788639024.034409:0:10495:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2431a4000 going to sleep for 11 seconds 00000100:00100000:3.0:1788639024.034437:0:10495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10495:1875523772944640:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788639024.034472:0:10495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788639024.034484:0:10495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788639024.034487:0:10495:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788639024.034496:0:10495:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ae3461e3800 00000020:00000080:3.0:1788639024.034498:0:10495:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788639024.037667:0:10495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10495:1875523772944768:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788639024.037774:0:10495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639024.037815:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772944768 00000100:00100000:3.0:1788639024.037825:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772944768 00000100:00100000:2.0:1788639024.037831:0:10495:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d262780 going to sleep for 11 seconds 00000100:00100000:3.0:1788639024.037905:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788639024.037918:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+24:10495:x1875523772944768:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788639024.038080:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+24:10495:x1875523772944768:12345-0@lo:502:llog_process_th.0 Request processed in 164us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639024.038089:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788639024.038250:0:10495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:10495:1875523772944768:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788639024.038287:0:10495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788639024.038296:0:10495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639024.038299:0:10495:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788639024.038305:0:10495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788639024.038492:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788639024.038516:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788639024.038529:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4600/0x25c454990262c237 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c23e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639024.038542:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4600/0x25c454990262c237 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c23e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639024.565167:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639025.592212:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639025.845454:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875523772945280:0@lo:400:kworker.0 00000100:00100000:0.0:1788639025.845563:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639025.845665:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772945792:0@lo:400:kworker.0 00000100:00100000:0.0:1788639025.845696:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639025.845717:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772946304:0@lo:400:kworker.0 00000100:00100000:0.0:1788639025.845740:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639025.845768:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1788639025.845775:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523772944896:0@lo:400:kworker.0 00000100:00100000:0.0:1788639025.845835:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639025.845861:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772945408:0@lo:400:kworker.0 00000100:00100000:0.0:1788639025.845887:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639025.845904:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772945920:0@lo:400:kworker.0 00000100:00100000:0.0:1788639025.845925:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639025.845955:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772946432:0@lo:400:kworker.0 00000100:00100000:0.0:1788639025.845978:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639025.846018:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875523772945024:0@lo:400:kworker.0 00000100:00100000:0.0:1788639025.846061:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639025.846081:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875523772945536:0@lo:400:kworker.0 00000100:00100000:0.0:1788639025.846106:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639025.846122:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875523772946048:0@lo:400:kworker.0 00000100:00100000:0.0:1788639025.846142:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639025.846160:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788639025.846166:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772945152:0@lo:400:kworker.0 00000100:00100000:0.0:1788639025.846189:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639025.846205:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875523772945664:0@lo:400:kworker.0 00000100:00100000:0.0:1788639025.846227:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639025.846238:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875523772946176:0@lo:400:kworker.0 00000100:00100000:0.0:1788639025.846278:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639025.846303:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772945280 00000100:00100000:0.0:1788639025.846313:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772945280 00000100:00100000:0.0:1788639025.846356:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772945024 00000100:00100000:0.0:1788639025.846359:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772945024 00000100:00100000:0.0:1788639025.846370:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772945536 00000100:00100000:0.0:1788639025.846381:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772945536 00000100:00100000:0.0:1788639025.846408:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772946048 00000100:00100000:0.0:1788639025.846411:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772946048 00000100:00100000:0.0:1788639025.846425:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772945664 00000100:00100000:0.0:1788639025.846428:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772945664 00000100:00100000:0.0:1788639025.846441:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772946176 00000100:00100000:0.0:1788639025.846443:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772946176 00000100:00100000:0.0:1788639025.846460:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788639025.846468:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875523772945280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639025.846532:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875523772945280:12345-0@lo:400:kworker.0 Request processed in 64us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639025.846540:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788639025.846562:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788639025.846568:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243150e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875523772945024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639025.846601:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243150e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875523772945024:12345-0@lo:400:kworker.0 Request processed in 33us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639025.846607:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788639025.846657:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788639025.846663:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243151f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875523772945536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639025.846693:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243151f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875523772945536:12345-0@lo:400:kworker.0 Request processed in 30us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639025.846699:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788639025.846710:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788639025.846715:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875523772946048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639025.846741:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875523772946048:12345-0@lo:400:kworker.0 Request processed in 26us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639025.846746:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788639025.846767:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788639025.846773:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243152680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875523772945664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639025.846802:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243152680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875523772945664:12345-0@lo:400:kworker.0 Request processed in 30us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639025.846809:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788639025.846819:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788639025.846825:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243151c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875523772946176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639025.846867:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243151c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875523772946176:12345-0@lo:400:kworker.0 Request processed in 42us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639025.846874:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788639025.846900:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772945792 00000100:00100000:0.0:1788639025.846905:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772945792 00000100:00100000:0.0:1788639025.846926:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772946304 00000100:00100000:0.0:1788639025.846929:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772946304 00000100:00100000:0.0:1788639025.846954:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772945920 00000100:00100000:0.0:1788639025.846957:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772945920 00000100:00100000:0.0:1788639025.846969:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772946432 00000100:00100000:0.0:1788639025.846972:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772946432 00000100:00100000:0.0:1788639025.846985:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788639025.846991:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae360686680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772945792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639025.847023:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae360686680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772945792:12345-0@lo:400:kworker.0 Request processed in 32us (1326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639025.847029:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788639025.847041:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788639025.847047:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae360684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772946304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639025.847073:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae360684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772946304:12345-0@lo:400:kworker.0 Request processed in 28us (1333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639025.847090:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788639025.847103:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788639025.847108:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae360685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772945920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639025.847135:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae360685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772945920:12345-0@lo:400:kworker.0 Request processed in 27us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639025.847140:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788639025.847149:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788639025.847154:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae360686d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772946432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639025.847174:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae360686d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772946432:12345-0@lo:400:kworker.0 Request processed in 21us (1196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639025.847179:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788639025.847201:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772944896 00000100:00100000:0.0:1788639025.847205:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772944896 00000100:00100000:0.0:1788639025.847229:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788639025.847235:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+24:3643:x1875523772944896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639025.847265:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+24:3643:x1875523772944896:12345-0@lo:400:kworker.0 Request processed in 30us (1430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639025.847272:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00010000:00080000:0.0:1788639025.847328:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2432cb480 x1875523772945664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639025.847344:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875523772945664:0@lo:400:kworker.0 00010000:00080000:0.0:1788639025.847359:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2432c8700 x1875523772946176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639025.847368:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875523772946176:0@lo:400:kworker.0 00000100:00100000:0.0:1788639025.847390:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875523772945024:0@lo:400:kworker.0 00000100:00100000:0.0:1788639025.847400:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875523772945536:0@lo:400:kworker.0 00000100:00100000:0.0:1788639025.847410:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875523772946048:0@lo:400:kworker.0 00000100:00100000:0.0:1788639025.847449:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523772944896:0@lo:400:kworker.0 00010000:00080000:0.0:1788639025.847461:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2432c9880 x1875523772945920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639025.847472:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772945920:0@lo:400:kworker.0 00010000:00080000:0.0:1788639025.847482:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae24233df80 x1875523772946432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639025.847491:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772946432:0@lo:400:kworker.0 00000100:00100000:0.0:1788639025.847502:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875523772945280:0@lo:400:kworker.0 00010000:00080000:0.0:1788639025.847512:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2432c8380 x1875523772945792/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639025.847519:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772945792:0@lo:400:kworker.0 00010000:00080000:0.0:1788639025.847529:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2432ca300 x1875523772946304/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639025.847536:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772946304:0@lo:400:kworker.0 00000100:00100000:1.0:1788639025.847979:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772945408 00000100:00100000:1.0:1788639025.847986:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772945408 00000100:00100000:1.0:1788639025.848014:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772945152 00000100:00100000:1.0:1788639025.848017:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772945152 00000100:00100000:1.0:1788639025.848033:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788639025.848042:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae360687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772945408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639025.848110:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae360687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772945408:12345-0@lo:400:kworker.0 Request processed in 69us (2221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639025.848117:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788639025.848133:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788639025.848140:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243153800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772945152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639025.848182:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243153800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772945152:12345-0@lo:400:kworker.0 Request processed in 42us (1992us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639025.848188:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788639025.848237:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772945152:0@lo:400:kworker.0 00000100:00100000:0.0:1788639025.848966:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772945408:0@lo:400:kworker.0 00000100:00100000:3.0:1788639025.852209:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788639025.852232:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772946560:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788639025.852303:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788639025.852370:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788639025.852375:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788639025.852379:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788639025.852381:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788639025.852484:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772946560 00000100:00100000:0.0:1788639025.852500:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772946560 00000100:00100000:0.0:1788639025.852810:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788639025.852823:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772946560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788639025.852866:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788639025.853105:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772946560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 284us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639025.853113:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1788639025.855760:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2432cea00 x1875523772946560/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639041 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639025.855793:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772946560:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788639026.364280:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375fb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772946688:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788639026.364348:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639026.364423:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772946688 00000100:00100000:1.0:1788639026.364431:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772946688 00000100:00100000:1.0:1788639026.364471:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788639026.364480:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772946688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788639026.364512:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788639026.364566:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772946688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639026.364573:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788639026.364639:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375fb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772946688:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788639026.365313:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788639026.365325:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772946816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788639026.365365:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639026.365400:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772946816 00000100:00100000:2.0:1788639026.365405:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772946816 00000100:00100000:2.0:1788639026.365440:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788639026.365449:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772946816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788639026.365466:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788639026.365502:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772946816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639026.365508:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1788639026.365542:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2432c6a00 x1875523772946816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639042 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639026.365557:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772946816:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788639026.612882:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639026.875819:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788639026.876093:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772946944:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788639026.876160:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639026.876264:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772946944 00000100:00100000:3.0:1788639026.876272:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772946944 00000100:00100000:3.0:1788639026.876320:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788639026.876330:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772946944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788639026.876361:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788639026.876409:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772946944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639026.876415:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788639026.876468:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772946944:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788639027.168950:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639027.168984:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639027.169010:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639027.169078:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639027.169106:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639027.169132:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754008448 00000100:00100000:3.0:1788639027.169141:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754008448 00000100:00100000:3.0:1788639027.169205:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754008320 00000100:00100000:3.0:1788639027.169209:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754008320 00000100:00100000:3.0:1788639027.169233:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 75 00000100:00100000:3.0:1788639027.169243:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2406:x1875523754008448:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639027.169315:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2406:x1875523754008448:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 73us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639027.169323:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 75 00000100:00100000:3.0:1788639027.169340:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 76 00000100:00100000:3.0:1788639027.169347:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2406:x1875523754008320:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639027.169370:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2406:x1875523754008320:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 25us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639027.169375:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 76 00000100:00100000:3.0:1788639027.169393:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754008704 00000100:00100000:3.0:1788639027.169396:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754008704 00000100:00100000:3.0:1788639027.169439:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754008576 00000100:00100000:3.0:1788639027.169442:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754008576 00000100:00100000:3.0:1788639027.169462:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 30 00000100:00100000:3.0:1788639027.169469:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2406:x1875523754008704:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639027.169496:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2406:x1875523754008704:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 27us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639027.169503:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 30 00000100:00100000:3.0:1788639027.169515:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 31 00000100:00100000:3.0:1788639027.169521:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2406:x1875523754008576:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639027.169543:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2406:x1875523754008576:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 23us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639027.169560:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 31 00000100:00080000:3.0:1788639027.169584:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788639027.169587:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788639027.169590:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788639027.169592:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788639027.169801:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754008192 00000100:00100000:2.0:1788639027.169805:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754008192 00000100:00100000:2.0:1788639027.169837:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 276 00000100:00100000:2.0:1788639027.169844:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+10:2406:x1875523754008192:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639027.169879:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+10:2406:x1875523754008192:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 36us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639027.169885:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 276 00010000:00010000:0.0:1788639027.638371:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788639028.214171:0:10690:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg618-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:0.0:1788639028.405038:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243153480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772947072:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788639028.405105:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639028.405230:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772947072 00000100:00100000:0.0:1788639028.405237:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772947072 00000100:00100000:0.0:1788639028.405285:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788639028.405295:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772947072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788639028.405333:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788639028.405377:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772947072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639028.405384:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1788639028.405437:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae243153480 x1875523772947072/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639044 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639028.405455:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243153480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772947072:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788639028.405699:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788639028.405708:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772947200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788639028.405748:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788639028.406527:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788639028.406583:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772947200 00000100:00100000:2.0:1788639028.406590:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772947200 00000100:00100000:2.0:1788639028.406760:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788639028.406769:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772947200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788639028.406784:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788639028.406832:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772947200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (1093us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639028.406839:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1788639028.406869:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788639028.406949:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2432c6a00 x1875523772947200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639044 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639028.406965:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772947200:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788639028.660800:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639029.685288:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639030.709110:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639030.965175:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523772947328:0@lo:400:kworker.0 00000100:00100000:2.0:1788639030.965275:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639030.965341:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772947840:0@lo:400:kworker.0 00000100:00100000:2.0:1788639030.965373:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639030.965585:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772948352:0@lo:400:kworker.0 00000100:00100000:2.0:1788639030.965646:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639030.965668:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772948864:0@lo:400:kworker.0 00000100:00100000:2.0:1788639030.965692:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639030.965720:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788639030.965726:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523772947456:0@lo:400:kworker.0 00000100:00100000:2.0:1788639030.965752:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639030.965772:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875523772947968:0@lo:400:kworker.0 00000100:00100000:2.0:1788639030.965792:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639030.965832:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875523772948480:0@lo:400:kworker.0 00000100:00100000:2.0:1788639030.965854:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639030.965888:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772947584:0@lo:400:kworker.0 00000100:00100000:2.0:1788639030.965924:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639030.965946:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875523772948096:0@lo:400:kworker.0 00000100:00100000:2.0:1788639030.965968:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639030.965985:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875523772948608:0@lo:400:kworker.0 00000100:00100000:2.0:1788639030.966017:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639030.966032:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788639030.966038:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875523772947712:0@lo:400:kworker.0 00000100:00100000:2.0:1788639030.966059:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639030.966069:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772948224:0@lo:400:kworker.0 00000100:00100000:2.0:1788639030.966095:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639030.966111:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772948736:0@lo:400:kworker.0 00000100:00100000:2.0:1788639030.966132:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639030.966168:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772947840 00000100:00100000:2.0:1788639030.966176:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772947840 00000100:00100000:2.0:1788639030.966219:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772947584 00000100:00100000:2.0:1788639030.966222:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772947584 00000100:00100000:2.0:1788639030.966238:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788639030.966246:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772947840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639030.966487:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772947840:12345-0@lo:400:kworker.0 Request processed in 238us (1110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639030.966495:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788639030.966517:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788639030.966524:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24319b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772947584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639030.966566:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24319b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772947584:12345-0@lo:400:kworker.0 Request processed in 44us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639030.966573:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788639030.966612:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772948352 00000100:00100000:2.0:1788639030.966639:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772948352 00000100:00100000:2.0:1788639030.966671:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772948864 00000100:00100000:2.0:1788639030.966674:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772948864 00000100:00100000:2.0:1788639030.966687:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772948224 00000100:00100000:2.0:1788639030.966690:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772948224 00000100:00100000:2.0:1788639030.966700:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772948736 00000100:00100000:2.0:1788639030.966703:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772948736 00000100:00100000:2.0:1788639030.966714:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788639030.966720:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772948352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639030.966754:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772948352:12345-0@lo:400:kworker.0 Request processed in 34us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639030.966761:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788639030.966773:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788639030.966779:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243198700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772948864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639030.966805:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243198700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772948864:12345-0@lo:400:kworker.0 Request processed in 27us (1112us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639030.966810:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788639030.966820:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788639030.966826:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36e297850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772948224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639030.966851:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36e297850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772948224:12345-0@lo:400:kworker.0 Request processed in 25us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639030.966856:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788639030.970039:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788639030.970073:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243198e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772948736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639030.970179:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243198e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772948736:12345-0@lo:400:kworker.0 Request processed in 116us (4045us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639030.970187:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788639030.970230:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772947456 00000100:00100000:2.0:1788639030.970240:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772947456 00000100:00100000:2.0:1788639030.970276:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772947968 00000100:00100000:2.0:1788639030.970279:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772947968 00000100:00100000:2.0:1788639030.970312:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772948480 00000100:00100000:2.0:1788639030.970316:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772948480 00000100:00100000:2.0:1788639030.970328:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772948096 00000100:00100000:2.0:1788639030.970331:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772948096 00000100:00100000:2.0:1788639030.970343:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772948608 00000100:00100000:2.0:1788639030.970346:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772948608 00000100:00100000:2.0:1788639030.970358:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772947712 00000100:00100000:2.0:1788639030.970361:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772947712 00000100:00100000:2.0:1788639030.970373:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788639030.970379:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243198a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523772947456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639030.970643:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243198a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523772947456:12345-0@lo:400:kworker.0 Request processed in 232us (4858us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639030.970651:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788639030.970666:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788639030.970673:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24319ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875523772947968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639030.970704:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24319ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875523772947968:12345-0@lo:400:kworker.0 Request processed in 31us (4911us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639030.970710:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788639030.970721:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788639030.970727:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24319bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875523772948480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639030.970768:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24319bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875523772948480:12345-0@lo:400:kworker.0 Request processed in 42us (4913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639030.970774:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788639030.970785:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788639030.970791:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243199180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875523772948096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639030.970820:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243199180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875523772948096:12345-0@lo:400:kworker.0 Request processed in 30us (4852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639030.970826:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788639030.970837:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788639030.970843:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24319aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875523772948608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639030.970870:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24319aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875523772948608:12345-0@lo:400:kworker.0 Request processed in 27us (4852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639030.970875:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788639030.970886:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788639030.970892:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24319a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875523772947712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639030.970930:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24319a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875523772947712:12345-0@lo:400:kworker.0 Request processed in 39us (4870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639030.970936:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788639030.971252:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772947328 00000100:00100000:3.0:1788639030.971259:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772947328 00000100:00100000:1.0:1788639030.971456:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375fb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772948992:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788639030.971507:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639030.971556:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772948992 00000100:00100000:1.0:1788639030.971560:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772948992 00000100:00100000:1.0:1788639030.971591:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788639030.971599:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772948992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788639030.971653:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788639030.971694:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772948992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639030.971701:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1788639030.971741:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375fb1c00 x1875523772948992/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639046 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639030.971761:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375fb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772948992:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788639030.972046:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788639030.972056:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+24:3643:x1875523772947328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639030.972094:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+24:3643:x1875523772947328:12345-0@lo:400:kworker.0 Request processed in 42us (6820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639030.972100:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00080000:1.0:1788639030.972538:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788639030.972544:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788639030.972547:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788639030.972550:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788639030.972584:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875523772947712:0@lo:400:kworker.0 00010000:00080000:1.0:1788639030.972636:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f35c00 x1875523772948224/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639030.972647:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772948224:0@lo:400:kworker.0 00010000:00080000:1.0:1788639030.972660:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f37100 x1875523772948736/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639030.972668:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772948736:0@lo:400:kworker.0 00000100:00100000:1.0:1788639030.972681:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772947584:0@lo:400:kworker.0 00010000:00080000:1.0:1788639030.972694:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2416e7800 x1875523772948096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639030.972703:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875523772948096:0@lo:400:kworker.0 00010000:00080000:1.0:1788639030.972715:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f34700 x1875523772948608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639030.972722:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875523772948608:0@lo:400:kworker.0 00000100:00100000:2.0:1788639030.972940:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523772947456:0@lo:400:kworker.0 00000100:00100000:2.0:1788639030.972954:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875523772947968:0@lo:400:kworker.0 00000100:00100000:2.0:1788639030.972967:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875523772948480:0@lo:400:kworker.0 00000100:00100000:2.0:1788639030.972977:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523772947328:0@lo:400:kworker.0 00000100:00100000:2.0:1788639030.973000:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772947840:0@lo:400:kworker.0 00010000:00080000:2.0:1788639030.973023:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f34000 x1875523772948352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639030.973032:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772948352:0@lo:400:kworker.0 00010000:00080000:2.0:1788639030.973044:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f6bb80 x1875523772948864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639030.973052:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772948864:0@lo:400:kworker.0 00000100:00100000:2.0:1788639031.477222:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788639031.481893:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772949248:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788639031.481998:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639031.482066:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243153480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772949120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788639031.482096:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639031.482140:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772949248 00000100:00100000:2.0:1788639031.482150:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772949248 00000100:00100000:2.0:1788639031.482204:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788639031.482214:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772949248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788639031.482258:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788639031.482309:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772949248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639031.482317:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788639031.482343:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772949120 00000100:00100000:2.0:1788639031.482347:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772949120 00000100:00100000:2.0:1788639031.482373:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788639031.482380:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24319b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772949120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788639031.482396:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788639031.482429:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24319b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772949120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639031.482445:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788639031.482499:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772949248:0@lo:41:osp-pre-0-1.0 00010000:00080000:2.0:1788639031.482514:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae243153480 x1875523772949120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639047 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639031.482530:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243153480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772949120:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788639031.733093:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639031.990287:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788639031.990315:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772949376:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788639031.990399:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639031.990490:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772949376 00000100:00100000:3.0:1788639031.990500:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772949376 00000100:00100000:3.0:1788639031.990557:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788639031.990568:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772949376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788639031.990609:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788639031.990691:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772949376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639031.990699:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788639031.990755:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772949376:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788639032.294298:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639032.294338:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639032.294382:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639032.294456:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754009088 00000100:00100000:2.0:1788639032.294466:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754009088 00000100:00100000:2.0:1788639032.294538:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754008960 00000100:00100000:2.0:1788639032.294542:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754008960 00000100:00080000:0.0:1788639032.294559:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788639032.294565:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788639032.294577:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 83 00000100:00100000:2.0:1788639032.294588:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243151880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2408:x1875523754009088:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639032.294678:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243151880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2408:x1875523754009088:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 92us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639032.294687:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 83 00000100:00100000:2.0:1788639032.294707:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 84 00000100:00100000:2.0:1788639032.294715:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2408:x1875523754008960:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639032.294745:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2408:x1875523754008960:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 30us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639032.294751:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 84 00000100:00100000:1.0:1788639032.295326:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754008832 00000100:00100000:1.0:1788639032.295333:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754008832 00000100:00100000:1.0:1788639032.295366:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 278 00000100:00100000:1.0:1788639032.295374:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+10:2408:x1875523754008832:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:1.0:1788639032.295422:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+10:2408:x1875523754008832:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 49us (1134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639032.295430:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 278 00000100:00100000:1.0:1788639032.300982:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639032.301372:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754009216 00000100:00100000:2.0:1788639032.301382:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754009216 00000100:00100000:2.0:1788639032.301438:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 18 00000100:00100000:2.0:1788639032.301454:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2404:x1875523754009216:12345-192.168.206.18@tcp:9:kworker.0 00000020:00000080:2.0:1788639032.301612:0:8430:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262c150 00000100:00080000:2.0:1788639032.301650:0:8430:0:(import.c:65:import_set_state_nolock()) ffff9ae2416e8000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788639032.301756:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788639032.302074:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+2:2404:x1875523754009216:12345-192.168.206.18@tcp:9:kworker.0 Request processed in 620us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639032.302082:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 18 00000100:00080000:2.0:1788639032.302105:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788639032.302146:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639032.306943:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639032.308797:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754009344 00000100:00100000:2.0:1788639032.308808:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754009344 00000100:00100000:2.0:1788639032.309434:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 19 00000100:00100000:2.0:1788639032.309444:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243150700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2404:x1875523754009344:12345-192.168.206.18@tcp:9:kworker.0 00000020:00000080:2.0:1788639032.309477:0:8829:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262c157 00000100:00080000:2.0:1788639032.309495:0:8829:0:(import.c:65:import_set_state_nolock()) ffff9ae2416ea000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788639032.309532:0:8829:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788639032.309688:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243150700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+2:2404:x1875523754009344:12345-192.168.206.18@tcp:9:kworker.0 Request processed in 245us (2837us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639032.309695:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 19 00010000:00010000:2.0:1788639032.309714:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788639032.313503:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:0.0:1788639032.753366:0:10935:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg618-server.virtnet: executing yml_node 00010000:00010000:1.0:1788639032.759287:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639033.527712:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788639033.527732:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243150a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772949504:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788639033.527843:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639033.527911:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772949504 00000100:00100000:0.0:1788639033.527918:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772949504 00000100:00100000:0.0:1788639033.527965:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788639033.527974:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243152d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772949504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788639033.527999:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788639033.528041:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243152d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772949504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639033.528048:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1788639033.528068:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788639033.528105:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae243150a80 x1875523772949504/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639049 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639033.528123:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243150a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772949504:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788639033.528689:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243150a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772949632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788639033.528725:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639033.530497:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772949632 00000100:00100000:0.0:1788639033.530508:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772949632 00000100:00100000:0.0:1788639033.530559:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788639033.530569:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772949632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788639033.530589:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788639033.530668:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772949632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (1942us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639033.530675:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1788639033.530699:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788639033.530828:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae243150a80 x1875523772949632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639049 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639033.530846:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243150a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772949632:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788639033.781071:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639034.804879:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639035.829074:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639036.086488:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788639036.086519:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772949760:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788639036.086629:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639036.086693:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772950144:0@lo:400:kworker.0 00000100:00100000:3.0:1788639036.086716:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523772949888:0@lo:400:kworker.0 00000100:00100000:2.0:1788639036.086719:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639036.086744:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875523772950656:0@lo:400:kworker.0 00000100:00100000:3.0:1788639036.086751:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639036.086769:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639036.086775:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772950400:0@lo:400:kworker.0 00000100:00100000:2.0:1788639036.086787:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875523772951168:0@lo:400:kworker.0 00000100:00100000:3.0:1788639036.086794:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639036.086809:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772950912:0@lo:400:kworker.0 00000100:00100000:2.0:1788639036.086819:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639036.086831:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639036.086837:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788639036.086842:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875523772950272:0@lo:400:kworker.0 00000100:00100000:3.0:1788639036.086848:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788639036.086853:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523772950016:0@lo:400:kworker.0 00000100:00100000:2.0:1788639036.086863:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639036.087242:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639036.087272:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875523772950528:0@lo:400:kworker.0 00000100:00100000:0.0:1788639036.087303:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639036.087315:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875523772951040:0@lo:400:kworker.0 00000100:00100000:0.0:1788639036.087334:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639036.087393:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772950656 00000100:00100000:1.0:1788639036.087403:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772950656 00000100:00100000:1.0:1788639036.087465:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772951168 00000100:00100000:1.0:1788639036.087468:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772951168 00000100:00100000:1.0:1788639036.087483:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772950272 00000100:00100000:1.0:1788639036.087485:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772950272 00000100:00100000:1.0:1788639036.087495:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772950016 00000100:00100000:1.0:1788639036.087498:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772950016 00000100:00100000:1.0:1788639036.087508:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772950528 00000100:00100000:1.0:1788639036.087510:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772950528 00000100:00100000:1.0:1788639036.087521:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772951040 00000100:00100000:1.0:1788639036.087523:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772951040 00000100:00100000:1.0:1788639036.087538:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788639036.087547:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36914f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875523772950656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639036.087732:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36914f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875523772950656:12345-0@lo:400:kworker.0 Request processed in 185us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639036.087741:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788639036.087761:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788639036.087767:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae342e3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875523772951168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639036.087794:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae342e3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875523772951168:12345-0@lo:400:kworker.0 Request processed in 27us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639036.087799:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788639036.087809:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788639036.087814:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242efa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875523772950272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639036.087838:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242efa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875523772950272:12345-0@lo:400:kworker.0 Request processed in 24us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639036.087843:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788639036.087866:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788639036.087872:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243153b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523772950016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639036.087918:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243153b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523772950016:12345-0@lo:400:kworker.0 Request processed in 46us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639036.087924:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788639036.087936:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788639036.087943:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875523772950528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639036.087971:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875523772950528:12345-0@lo:400:kworker.0 Request processed in 29us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639036.087977:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788639036.087987:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788639036.087993:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243151180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875523772951040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639036.088018:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243151180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875523772951040:12345-0@lo:400:kworker.0 Request processed in 25us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639036.088023:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:0.0:1788639036.088098:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788639036.088103:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788639036.088143:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523772950016:0@lo:400:kworker.0 00000100:00100000:0.0:1788639036.088158:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875523772950528:0@lo:400:kworker.0 00000100:00100000:0.0:1788639036.088167:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875523772951040:0@lo:400:kworker.0 00000100:00100000:2.0:1788639036.088264:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875523772950272:0@lo:400:kworker.0 00000100:00100000:2.0:1788639036.088272:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772950784:0@lo:400:kworker.0 00000100:00100000:2.0:1788639036.088304:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639036.088372:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772951296:0@lo:400:kworker.0 00000100:00100000:2.0:1788639036.088395:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788639036.088475:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae36d1aad80 x1875523772951168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639036.088486:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875523772951168:0@lo:400:kworker.0 00000100:00100000:3.0:1788639036.088491:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772950144 00000100:00100000:3.0:1788639036.088497:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772950144 00010000:00080000:2.0:1788639036.088498:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2432ced80 x1875523772950656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639036.088506:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875523772950656:0@lo:400:kworker.0 00000100:00100000:3.0:1788639036.088525:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772950400 00000100:00100000:3.0:1788639036.088528:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772950400 00000100:00100000:2.0:1788639036.088534:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772949760 00000100:00100000:2.0:1788639036.088537:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772949760 00000100:00100000:3.0:1788639036.088542:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788639036.088549:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772950144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639036.088573:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788639036.088589:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243198000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772949760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788639036.088635:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788639036.088676:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243198000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772949760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (2062us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639036.088683:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1788639036.088719:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788639036.088750:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2432cd880 x1875523772949760/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639052 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639036.088755:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772950144:12345-0@lo:400:kworker.0 Request processed in 207us (2035us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639036.088762:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788639036.088767:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772949760:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788639036.088774:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788639036.088781:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36d1ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772950400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639036.088784:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772950144:0@lo:400:kworker.0 00000100:00100000:3.0:1788639036.088823:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36d1ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772950400:12345-0@lo:400:kworker.0 Request processed in 43us (2027us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639036.088829:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788639036.088848:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772949888 00000100:00100000:3.0:1788639036.088852:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772949888 00000100:00100000:3.0:1788639036.088895:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788639036.088902:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b678850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+24:3643:x1875523772949888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639036.088934:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b678850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+24:3643:x1875523772949888:12345-0@lo:400:kworker.0 Request processed in 33us (2181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639036.088940:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788639036.089093:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772950912 00000100:00100000:0.0:1788639036.089098:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772950912 00000100:00100000:0.0:1788639036.089135:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772950784 00000100:00100000:0.0:1788639036.089139:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772950784 00000100:00100000:0.0:1788639036.089153:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772951296 00000100:00100000:0.0:1788639036.089156:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772951296 00000100:00100000:0.0:1788639036.089171:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788639036.089177:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242080000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772950912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639036.089214:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242080000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772950912:12345-0@lo:400:kworker.0 Request processed in 37us (2382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639036.089220:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788639036.089233:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788639036.089239:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242efb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772950784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639036.089269:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242efb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772950784:12345-0@lo:400:kworker.0 Request processed in 30us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639036.089274:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788639036.089295:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788639036.089301:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772951296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639036.089330:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772951296:12345-0@lo:400:kworker.0 Request processed in 30us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639036.089336:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1788639036.089387:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788639036.089390:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788639036.089413:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2432cca80 x1875523772950784/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639036.089424:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772950784:0@lo:400:kworker.0 00010000:00080000:2.0:1788639036.089436:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae36d1abb80 x1875523772951296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639036.089444:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772951296:0@lo:400:kworker.0 00000100:00100000:3.0:1788639036.091103:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523772949888:0@lo:400:kworker.0 00000100:00100000:3.0:1788639036.091126:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772950400:0@lo:400:kworker.0 00010000:00080000:3.0:1788639036.091144:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae36d1a8700 x1875523772950912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639036.091156:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772950912:0@lo:400:kworker.0 00000001:02000400:3.0:1788639036.352653:0:11118:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.3 00000100:00100000:2.0:1788639036.598212:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772951424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788639036.598307:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639036.598413:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772951424 00000100:00100000:2.0:1788639036.598423:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772951424 00000100:00100000:2.0:1788639036.598479:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788639036.598489:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772951424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788639036.598517:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788639036.598569:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772951424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639036.598576:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1788639036.598645:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f38e00 x1875523772951424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639052 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639036.598689:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772951424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788639036.599715:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772951552:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788639036.599774:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639036.599944:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772951552 00000100:00100000:3.0:1788639036.599953:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772951552 00000100:00100000:3.0:1788639036.600016:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788639036.600025:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772951552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788639036.600064:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788639036.600113:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772951552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639036.600120:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788639036.600703:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772951552:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788639036.855069:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639037.118389:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788639037.118420:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375fb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772951680:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788639037.118506:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639037.118599:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772951680 00000100:00100000:1.0:1788639037.118609:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772951680 00000100:00100000:1.0:1788639037.118704:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788639037.118715:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772951680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788639037.118759:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788639037.118815:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772951680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639037.118823:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788639037.118903:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375fb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772951680:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788639037.409866:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639037.409931:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639037.409961:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639037.409996:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754009472 00000100:00100000:0.0:1788639037.410008:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754009472 00000100:00100000:0.0:1788639037.410066:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 280 00000100:00100000:0.0:1788639037.410078:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b678450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+10:2408:x1875523754009472:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639037.410170:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b678450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+10:2408:x1875523754009472:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 93us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639037.410179:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 280 00000100:00100000:2.0:1788639037.411547:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754009600 00000100:00100000:2.0:1788639037.411562:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754009600 00000100:00100000:2.0:1788639037.411638:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754009728 00000100:00100000:2.0:1788639037.411642:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754009728 00000100:00100000:2.0:1788639037.411752:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 91 00000100:00100000:2.0:1788639037.411763:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243152a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2408:x1875523754009600:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639037.411850:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243152a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2408:x1875523754009600:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 88us (2000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639037.411858:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 91 00000100:00100000:2.0:1788639037.411891:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 92 00000100:00100000:2.0:1788639037.411898:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243152300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2408:x1875523754009728:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639037.411924:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243152300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2408:x1875523754009728:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 27us (1963us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639037.411930:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 92 00000100:00080000:2.0:1788639037.411955:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788639037.411960:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788639037.878251:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788639038.147548:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5deb128c-4fe3-4f51-b21e-f30846e08445 00000020:00000080:3.0:1788639038.147562:0:8425:0:(genops.c:885:class_export_put()) final put ffff9ae2416e8800/5deb128c-4fe3-4f51-b21e-f30846e08445 00000020:00000080:1.0:1788639038.147652:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae2416e8800/5deb128c-4fe3-4f51-b21e-f30846e08445 for lustre-OST0000 00000020:00000080:1.0:1788639038.150646:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae2416e8000 for lustre-OST0000 00000001:00100000:3.0:1788639038.158725:0:9509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5deb128c-4fe3-4f51-b21e-f30846e08445 00000020:00000080:3.0:1788639038.158737:0:9509:0:(genops.c:885:class_export_put()) final put ffff9ae2416ef000/5deb128c-4fe3-4f51-b21e-f30846e08445 00000020:00000080:1.0:1788639038.160176:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae2416ef000/5deb128c-4fe3-4f51-b21e-f30846e08445 for lustre-OST0001 00000020:00000080:1.0:1788639038.160254:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae2416ea000 for lustre-OST0001 00000100:00100000:1.0:1788639038.644938:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243150a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772951808:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788639038.645033:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639038.645173:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772951808 00000100:00100000:2.0:1788639038.645184:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772951808 00000100:00100000:2.0:1788639038.645260:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788639038.645272:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772951808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788639038.645326:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788639038.646105:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243153480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772951936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788639038.646345:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639038.647280:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772951808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2003us (2239us total) trans 0 rc 0/0 00010000:00080000:1.0:1788639038.647284:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae243150a80 x1875523772951808/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639054 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639038.647296:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788639038.647320:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243150a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772951808:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788639038.647332:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772951936 00000100:00100000:2.0:1788639038.647340:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772951936 00000100:00100000:2.0:1788639038.647818:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788639038.647830:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36d1a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772951936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788639038.647857:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788639038.647936:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36d1a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772951936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (1591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639038.647943:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1788639038.647965:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788639038.648306:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae243153480 x1875523772951936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639054 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639038.648327:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243153480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772951936:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1788639038.840465:0:11216:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.3 00010000:00010000:3.0:1788639038.900977:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639039.927674:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639040.950959:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788639041.191841:0:11313:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.3 00000100:00100000:3.0:1788639041.204889:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772952064:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788639041.204991:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639041.205474:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772952064 00000100:00100000:1.0:1788639041.205486:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772952064 00000100:00100000:0.0:1788639041.205486:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772952192:0@lo:400:kworker.0 00000100:00100000:0.0:1788639041.205535:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639041.205563:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788639041.205575:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242081880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772952064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788639041.205612:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788639041.206105:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772952704:0@lo:400:kworker.0 00000100:00100000:0.0:1788639041.206375:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639041.206426:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772953216:0@lo:400:kworker.0 00000100:00100000:1.0:1788639041.206441:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242081880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772952064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 866us (1448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639041.206453:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788639041.206460:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639041.206495:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875523772952320:0@lo:400:kworker.0 00000100:00100000:0.0:1788639041.206516:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772952192 00000100:00100000:0.0:1788639041.206524:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772952192 00000100:00100000:1.0:1788639041.206534:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639041.206563:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875523772952832:0@lo:400:kworker.0 00000100:00100000:1.0:1788639041.206586:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639041.206605:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875523772953344:0@lo:400:kworker.0 00000100:00100000:1.0:1788639041.206665:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788639041.206696:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788639041.206715:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772952320 00000100:00100000:1.0:1788639041.206718:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772952320 00000100:00100000:1.0:1788639041.206747:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772952832 00000100:00100000:1.0:1788639041.206751:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772952832 00000100:00100000:1.0:1788639041.206768:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772953344 00000100:00100000:1.0:1788639041.206771:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772953344 00000100:00100000:1.0:1788639041.206786:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788639041.206793:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875523772952320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639041.206840:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875523772952320:12345-0@lo:400:kworker.0 Request processed in 47us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639041.206847:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788639041.206875:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788639041.206883:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875523772952832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639041.206909:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772953216 00000100:00100000:1.0:1788639041.206916:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875523772952832:12345-0@lo:400:kworker.0 Request processed in 33us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639041.206917:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772953216 00000100:00100000:1.0:1788639041.206926:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788639041.206941:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788639041.206949:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875523772953344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639041.206965:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788639041.206977:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772953216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639041.206981:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875523772953344:12345-0@lo:400:kworker.0 Request processed in 32us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639041.206990:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:1.0:1788639041.207019:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788639041.207024:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788639041.207036:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772953216:12345-0@lo:400:kworker.0 Request processed in 62us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639041.207044:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788639041.207062:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875523772952320:0@lo:400:kworker.0 00000100:00100000:1.0:1788639041.207075:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875523772952832:0@lo:400:kworker.0 00000100:00100000:1.0:1788639041.207096:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875523772953344:0@lo:400:kworker.0 00000100:00100000:3.0:1788639041.207143:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772952704 00000100:00100000:3.0:1788639041.207148:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772952704 00000100:00100000:3.0:1788639041.207191:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788639041.207201:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772952704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639041.207385:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788639041.207395:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b679850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+24:3641:x1875523772952192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639041.207435:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b679850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+24:3641:x1875523772952192:12345-0@lo:400:kworker.0 Request processed in 42us (1900us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639041.207441:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788639041.207484:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772952448:0@lo:400:kworker.0 00000100:00100000:0.0:1788639041.207532:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639041.207995:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875523772952576:0@lo:400:kworker.0 00000100:00100000:1.0:1788639041.208032:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639041.208061:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772953088:0@lo:400:kworker.0 00000100:00100000:1.0:1788639041.208087:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639041.208117:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772953600:0@lo:400:kworker.0 00000100:00100000:3.0:1788639041.208123:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772952704:12345-0@lo:400:kworker.0 Request processed in 922us (1746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639041.208132:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788639041.208207:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772952448 00000100:00100000:3.0:1788639041.208214:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772952448 00000100:00100000:3.0:1788639041.208252:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788639041.208260:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772952448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639041.209006:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788639041.209060:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae242083b80 x1875523772952064/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639057 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639041.209090:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772952064:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788639041.209571:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772953088 00000100:00100000:1.0:1788639041.209579:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772953088 00000100:00100000:1.0:1788639041.209667:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772953600 00000100:00100000:1.0:1788639041.209943:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772953600 00000100:00100000:1.0:1788639041.209979:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788639041.209989:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772953088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639041.210062:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772953088:12345-0@lo:400:kworker.0 Request processed in 74us (1973us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639041.210069:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788639041.210086:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788639041.210093:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36d1aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772953600:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788639041.210466:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788639041.210472:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788639041.210547:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36d1aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772953600:12345-0@lo:400:kworker.0 Request processed in 452us (1541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639041.210555:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772952448:0@lo:400:kworker.0 00000100:00100000:1.0:1788639041.210561:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788639041.210572:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875523772952960:0@lo:400:kworker.0 00000100:00100000:0.0:1788639041.210641:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639041.210668:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772952576 00000100:00100000:0.0:1788639041.210671:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875523772953472:0@lo:400:kworker.0 00000100:00100000:1.0:1788639041.210675:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772952576 00000100:00100000:0.0:1788639041.210704:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639041.210716:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772952960 00000100:00100000:1.0:1788639041.210721:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772952960 00000100:00100000:1.0:1788639041.210745:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772953472 00000100:00100000:1.0:1788639041.210748:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772953472 00000100:00100000:0.0:1788639041.210769:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788639041.210777:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788639041.210783:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875523772952576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639041.210789:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875523772952960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639041.210797:0:6516:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1788639041.210810:0:6516:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1788639041.210837:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875523772952576:12345-0@lo:400:kworker.0 Request processed in 59us (2803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639041.210847:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875523772952960:12345-0@lo:400:kworker.0 Request processed in 61us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639041.210847:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788639041.210873:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788639041.210880:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788639041.210890:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875523772953472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639041.210921:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875523772952576:0@lo:400:kworker.0 00000100:00100000:0.0:1788639041.210930:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875523772953472:12345-0@lo:400:kworker.0 Request processed in 41us (225us total) trans 0 rc 0/0 00000100:00080000:2.0:1788639041.210935:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788639041.210943:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2432cd880 x1875523772953088/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639041.210949:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788639041.210962:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772953088:0@lo:400:kworker.0 00010000:00080000:1.0:1788639041.210979:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2432cc000 x1875523772953600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639041.210989:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772953600:0@lo:400:kworker.0 00000100:00100000:0.0:1788639041.211065:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772952192:0@lo:400:kworker.0 00000100:00100000:0.0:1788639041.211087:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772952704:0@lo:400:kworker.0 00010000:00080000:0.0:1788639041.211105:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2432ced80 x1875523772953216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639041.211118:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772953216:0@lo:400:kworker.0 00000100:00100000:3.0:1788639041.211182:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772952448:12345-0@lo:400:kworker.0 Request processed in 2290us (3017us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639041.211193:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:0.0:1788639041.211237:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2432cd500 x1875523772952960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639041.211250:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875523772952960:0@lo:400:kworker.0 00010000:00080000:0.0:1788639041.211265:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2432cd180 x1875523772953472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639041.211274:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875523772953472:0@lo:400:kworker.0 00000100:00100000:0.0:1788639041.717001:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772953728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788639041.717093:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639041.717459:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242080a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772953856:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788639041.717498:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639041.717735:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772953856 00000100:00100000:3.0:1788639041.717745:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772953856 00000100:00100000:3.0:1788639041.717808:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788639041.717819:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36d1abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772953856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788639041.717876:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788639041.717942:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36d1abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772953856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639041.717966:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788639041.718152:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772953728 00000100:00100000:2.0:1788639041.718164:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772953728 00000100:00100000:2.0:1788639041.718205:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788639041.718212:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772953728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788639041.718228:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788639041.718277:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772953728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (1184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639041.718284:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1788639041.718402:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f38000 x1875523772953728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639057 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639041.718427:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772953728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788639041.718764:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242080a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772953856:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788639041.980490:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639042.228977:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788639042.229010:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772953984:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788639042.229101:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639042.229327:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772953984 00000100:00100000:3.0:1788639042.229337:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772953984 00000100:00100000:3.0:1788639042.229547:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788639042.229559:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772953984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788639042.229605:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788639042.229707:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772953984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 149us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639042.229715:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788639042.230159:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772953984:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788639042.533219:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639042.533278:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639042.533323:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754009984 00000100:00100000:2.0:1788639042.533335:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754009984 00000100:00100000:1.0:1788639042.533644:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754009856 00000100:00100000:1.0:1788639042.533650:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754009856 00000100:00100000:1.0:1788639042.533730:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 282 00000100:00100000:1.0:1788639042.533742:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+10:2405:x1875523754009856:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:1.0:1788639042.533843:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+10:2405:x1875523754009856:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 103us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639042.533864:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 282 00000100:00100000:2.0:1788639042.535244:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 99 00000100:00100000:2.0:1788639042.535266:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2405:x1875523754009984:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639042.535363:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2405:x1875523754009984:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 94us (2072us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639042.535372:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 99 00000100:00080000:0.0:1788639042.537597:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788639042.538425:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639042.538666:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754010112 00000100:00100000:1.0:1788639042.538678:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754010112 00000100:00100000:1.0:1788639042.538767:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 100 00000100:00100000:1.0:1788639042.538779:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2406:x1875523754010112:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:1.0:1788639042.538884:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2406:x1875523754010112:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 106us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639042.538893:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 100 00000100:00080000:0.0:1788639042.539340:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:0.0:1788639042.817838:0:11362:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Sep 5 16:10:42 EDT 2026 00010000:00010000:1.0:1788639042.996906:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639043.767978:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788639043.768010:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772954112:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788639043.768098:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639043.768273:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772954240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788639043.768561:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639043.768744:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772954112 00000100:00100000:1.0:1788639043.768754:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772954112 00000100:00100000:1.0:1788639043.768876:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772954240 00000100:00100000:1.0:1788639043.768880:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772954240 00000100:00080000:0.0:1788639043.768881:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788639043.768893:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788639043.768906:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788639043.768917:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772954112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788639043.768956:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788639043.769020:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772954112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639043.769029:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1788639043.769049:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f34000 x1875523772954112/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639059 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639043.769051:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788639043.769062:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772954240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788639043.769075:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788639043.769082:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772954112:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788639043.769161:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772954240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639043.769192:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1788639043.770157:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae36d1a9f80 x1875523772954240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639059 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639043.770892:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772954240:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788639044.025423:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639045.048670:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639046.070353:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639046.325441:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242080a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772954368:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788639046.325539:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639046.325822:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772954368 00000100:00100000:2.0:1788639046.325842:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772954368 00000100:00100000:2.0:1788639046.325937:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788639046.325950:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36d1a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772954368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788639046.325994:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788639046.326053:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36d1a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772954368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639046.326061:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1788639046.326758:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788639046.326893:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae242080a80 x1875523772954368/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639062 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639046.326918:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242080a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772954368:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788639046.327102:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772954752:0@lo:400:kworker.0 00000100:00100000:3.0:1788639046.327179:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639046.327356:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523772954496:0@lo:400:kworker.0 00000100:00100000:0.0:1788639046.327397:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639046.327425:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788639046.327431:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523772954624:0@lo:400:kworker.0 00000100:00100000:0.0:1788639046.327458:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639046.327496:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772954496 00000100:00100000:0.0:1788639046.327502:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772954496 00000100:00100000:0.0:1788639046.327545:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788639046.327554:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+24:3643:x1875523772954496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639046.327601:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+24:3643:x1875523772954496:12345-0@lo:400:kworker.0 Request processed in 47us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639046.327608:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788639046.327694:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523772954496:0@lo:400:kworker.0 00000100:00100000:0.0:1788639046.327735:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772954624 00000100:00100000:0.0:1788639046.327739:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772954624 00000100:00100000:0.0:1788639046.327772:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788639046.327779:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523772954624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639046.327815:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523772954624:12345-0@lo:400:kworker.0 Request processed in 37us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639046.327821:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788639046.327860:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523772954624:0@lo:400:kworker.0 00000100:00100000:1.0:1788639046.330082:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523772954880:0@lo:400:kworker.0 00000100:00100000:1.0:1788639046.330189:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639046.330664:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772954880 00000100:00100000:0.0:1788639046.330703:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772954880 00000100:00100000:0.0:1788639046.330767:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788639046.330778:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523772954880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639046.330859:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523772954880:12345-0@lo:400:kworker.0 Request processed in 82us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639046.330867:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788639046.331033:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523772954880:0@lo:400:kworker.0 00000100:00100000:3.0:1788639046.332311:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772954752 00000100:00100000:3.0:1788639046.332323:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772954752 00000100:00100000:3.0:1788639046.332466:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788639046.332478:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772954752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639046.332569:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772954752:12345-0@lo:400:kworker.0 Request processed in 94us (5390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639046.332577:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788639046.335974:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772954752:0@lo:400:kworker.0 00000100:00100000:1.0:1788639046.339160:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875523772955136:0@lo:400:kworker.0 00000100:00100000:1.0:1788639046.339256:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639046.339307:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875523772955648:0@lo:400:kworker.0 00000100:00100000:0.0:1788639046.339648:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772955136 00000100:00100000:0.0:1788639046.339659:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772955136 00000100:00100000:0.0:1788639046.339757:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788639046.339771:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875523772955136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639046.339848:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875523772955136:12345-0@lo:400:kworker.0 Request processed in 81us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639046.339855:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788639046.339918:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772955392:0@lo:400:kworker.0 00000100:00100000:0.0:1788639046.339951:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639046.339974:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772955904:0@lo:400:kworker.0 00000100:00100000:0.0:1788639046.340025:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639046.340051:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788639046.340057:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875523772955264:0@lo:400:kworker.0 00000100:00080000:0.0:1788639046.340091:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788639046.340109:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772955392 00000100:00100000:0.0:1788639046.340113:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772955392 00000100:00100000:0.0:1788639046.340157:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772955904 00000100:00100000:0.0:1788639046.340161:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772955904 00000100:00100000:0.0:1788639046.340186:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788639046.340192:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772955392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639046.340243:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772955392:12345-0@lo:400:kworker.0 Request processed in 45us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639046.340250:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788639046.340263:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788639046.340269:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f78d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772955904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639046.340296:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f78d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772955904:12345-0@lo:400:kworker.0 Request processed in 27us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639046.340302:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1788639046.340320:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788639046.340323:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788639046.340629:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639046.340754:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875523772955136:0@lo:400:kworker.0 00000100:00100000:1.0:1788639046.340773:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788639046.340780:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772955008:0@lo:400:kworker.0 00000100:00100000:1.0:1788639046.340813:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639046.340844:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772955520:0@lo:400:kworker.0 00000100:00100000:1.0:1788639046.340866:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639046.342074:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772955520 00000100:00100000:1.0:1788639046.342088:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772955520 00000100:00100000:0.0:1788639046.342362:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772955648 00000100:00100000:0.0:1788639046.342368:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772955648 00000100:00100000:0.0:1788639046.342433:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788639046.342444:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875523772955648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639046.342538:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875523772955648:12345-0@lo:400:kworker.0 Request processed in 96us (3204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639046.342545:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:0.0:1788639046.342609:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788639046.342635:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788639046.342649:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639046.342804:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875523772955776:0@lo:400:kworker.0 00000100:00100000:0.0:1788639046.342854:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788639046.342906:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2432c8a80 x1875523772955392/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639046.342920:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772955392:0@lo:400:kworker.0 00010000:00080000:0.0:1788639046.342937:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2432c8700 x1875523772955904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639046.342964:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772955904:0@lo:400:kworker.0 00000100:00100000:0.0:1788639046.342996:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772955264 00000100:00100000:0.0:1788639046.343001:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772955264 00000100:00100000:0.0:1788639046.343031:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772955776 00000100:00100000:0.0:1788639046.343035:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772955776 00000100:00100000:0.0:1788639046.343054:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788639046.343060:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f78ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875523772955264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639046.343101:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f78ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875523772955264:12345-0@lo:400:kworker.0 Request processed in 41us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639046.343107:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788639046.343119:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788639046.343126:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f78e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875523772955776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639046.343255:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788639046.343270:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772955520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639046.343308:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772955520:12345-0@lo:400:kworker.0 Request processed in 40us (2441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639046.343314:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1788639046.343422:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2432c8000 x1875523772955520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639046.343435:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772955520:0@lo:400:kworker.0 00000100:00100000:1.0:1788639046.343449:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875523772955648:0@lo:400:kworker.0 00000100:00080000:1.0:1788639046.343485:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788639046.343512:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2432c9880 x1875523772955264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639046.343522:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875523772955264:0@lo:400:kworker.0 00000100:00100000:3.0:1788639046.343712:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772955008 00000100:00100000:3.0:1788639046.343719:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772955008 00000100:00100000:3.0:1788639046.343752:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788639046.343766:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772955008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639046.343817:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772955008:12345-0@lo:400:kworker.0 Request processed in 52us (3003us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639046.343823:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788639046.343873:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772955008:0@lo:400:kworker.0 00000100:00100000:0.0:1788639046.344301:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f78e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875523772955776:12345-0@lo:400:kworker.0 Request processed in 1174us (1444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639046.344310:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00080000:2.0:1788639046.344538:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2432cbb80 x1875523772955776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639046.344550:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875523772955776:0@lo:400:kworker.0 00000100:00100000:3.0:1788639046.837271:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788639046.837315:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772956032:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788639046.837516:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639046.837583:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772956032 00000100:00100000:0.0:1788639046.837594:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772956032 00000100:00100000:0.0:1788639046.837683:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788639046.837695:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772956032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788639046.837739:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788639046.838019:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772956032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 325us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639046.838028:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788639046.838192:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772956032:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788639046.838374:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772956160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788639046.838807:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639046.838878:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772956160 00000100:00100000:3.0:1788639046.838884:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772956160 00000100:00100000:3.0:1788639046.838928:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788639046.838938:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242081180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772956160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788639046.838959:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788639046.839017:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242081180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772956160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639046.839025:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1788639046.839067:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f37800 x1875523772956160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639062 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639046.839085:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772956160:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788639047.095066:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639047.352647:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788639047.352684:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772956288:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788639047.352775:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639047.352991:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772956288 00000100:00100000:3.0:1788639047.353001:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772956288 00000100:00100000:3.0:1788639047.353067:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788639047.353088:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772956288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788639047.353132:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788639047.353189:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772956288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639047.353195:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788639047.353249:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772956288:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788639047.650934:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639047.650991:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639047.651038:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639047.651840:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754010240 00000100:00100000:1.0:1788639047.651856:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754010240 00000100:00100000:2.0:1788639047.651890:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754010496 00000100:00100000:2.0:1788639047.651895:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754010496 00000100:00080000:3.0:1788639047.651963:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788639047.652010:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 284 00000100:00100000:1.0:1788639047.652024:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b678c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+10:2408:x1875523754010240:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:1.0:1788639047.652118:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b678c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+10:2408:x1875523754010240:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 97us (1198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639047.652192:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 284 00000100:00100000:1.0:1788639047.652235:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754010368 00000100:00100000:1.0:1788639047.652239:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754010368 00000100:00100000:2.0:1788639047.653233:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 107 00000100:00100000:2.0:1788639047.653249:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2408:x1875523754010496:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639047.653311:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2408:x1875523754010496:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 69us (2319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639047.653318:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 107 00000100:00100000:1.0:1788639047.653402:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 108 00000100:00100000:1.0:1788639047.653459:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2408:x1875523754010368:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:1.0:1788639047.653493:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2408:x1875523754010368:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 83us (2454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639047.653500:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 108 00000100:00080000:0.0:1788639047.653694:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788639048.117746:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639048.884920:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f78ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772956416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788639048.884997:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639048.885085:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772956416 00000100:00100000:0.0:1788639048.885093:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772956416 00000100:00100000:0.0:1788639048.885174:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788639048.885183:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772956416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788639048.885210:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788639048.885257:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772956416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639048.885264:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1788639048.885300:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae37f78ce00 x1875523772956416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639064 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639048.885317:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f78ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772956416:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788639048.885435:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788639048.885714:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788639048.889304:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772956544:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788639048.889378:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639048.889594:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772956544 00000100:00100000:0.0:1788639048.889601:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772956544 00000100:00100000:0.0:1788639048.889688:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788639048.889698:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772956544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788639048.889720:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788639048.889764:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772956544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639048.889772:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1788639048.889811:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f35f80 x1875523772956544/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639064 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788639048.889823:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788639048.889844:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772956544:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788639049.141040:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639050.166072:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639051.189436:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639051.445867:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875523772956800:0@lo:400:kworker.0 00000100:00100000:2.0:1788639051.445940:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639051.445977:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875523772957312:0@lo:400:kworker.0 00000100:00100000:2.0:1788639051.446004:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639051.446023:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875523772957824:0@lo:400:kworker.0 00000100:00100000:2.0:1788639051.446038:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639051.446056:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788639051.446061:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772956928:0@lo:400:kworker.0 00000100:00100000:2.0:1788639051.446078:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639051.446093:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875523772957440:0@lo:400:kworker.0 00000100:00100000:2.0:1788639051.446107:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639051.446120:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875523772957952:0@lo:400:kworker.0 00000100:00100000:2.0:1788639051.446134:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639051.446156:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772956800 00000100:00100000:2.0:1788639051.446162:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772956800 00000100:00100000:2.0:1788639051.446190:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772957312 00000100:00100000:2.0:1788639051.446192:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772957312 00000100:00100000:2.0:1788639051.446209:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772957824 00000100:00100000:2.0:1788639051.446211:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772957824 00000100:00100000:2.0:1788639051.446220:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772957440 00000100:00100000:2.0:1788639051.446222:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772957440 00000100:00100000:2.0:1788639051.446230:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772957952 00000100:00100000:2.0:1788639051.446231:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772957952 00000100:00100000:2.0:1788639051.446244:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788639051.446250:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875523772956800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639051.446287:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875523772956800:12345-0@lo:400:kworker.0 Request processed in 37us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639051.446293:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788639051.446308:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788639051.446312:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875523772957312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639051.446345:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875523772957312:12345-0@lo:400:kworker.0 Request processed in 32us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639051.446350:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788639051.446361:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788639051.446366:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875523772957824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639051.446387:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875523772957824:12345-0@lo:400:kworker.0 Request processed in 21us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639051.446392:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788639051.446400:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788639051.446404:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875523772957440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639051.446422:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875523772957440:12345-0@lo:400:kworker.0 Request processed in 17us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639051.446427:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788639051.446434:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788639051.446439:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875523772957952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639051.446456:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875523772957952:12345-0@lo:400:kworker.0 Request processed in 17us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639051.446461:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788639051.446840:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772956928 00000100:00100000:2.0:1788639051.446846:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772956928 00000100:00100000:2.0:1788639051.446875:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788639051.446882:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772956928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639051.446919:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772956928:12345-0@lo:400:kworker.0 Request processed in 38us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639051.446926:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:2.0:1788639051.446958:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788639051.446962:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788639051.446990:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772956928:0@lo:400:kworker.0 00010000:00080000:2.0:1788639051.447002:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f35c00 x1875523772957440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639051.447013:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875523772957440:0@lo:400:kworker.0 00010000:00080000:2.0:1788639051.447022:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2416e5500 x1875523772957952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639051.447029:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875523772957952:0@lo:400:kworker.0 00000100:00100000:2.0:1788639051.447038:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875523772956800:0@lo:400:kworker.0 00000100:00100000:2.0:1788639051.447047:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875523772957312:0@lo:400:kworker.0 00000100:00100000:2.0:1788639051.447055:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875523772957824:0@lo:400:kworker.0 00000100:00100000:0.0:1788639051.447142:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01f1eef9-e690-4065-bf99-bf821af7b626:3644:1875523772956672:0@lo:400:kworker.0 00000100:00100000:0.0:1788639051.447177:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639051.447210:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772957184:0@lo:400:kworker.0 00000100:00100000:0.0:1788639051.447231:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639051.447256:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772957696:0@lo:400:kworker.0 00000100:00100000:0.0:1788639051.447278:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639051.447294:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772958208:0@lo:400:kworker.0 00000100:00100000:0.0:1788639051.447311:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639051.447329:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788639051.447335:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875523772957056:0@lo:400:kworker.0 00000100:00100000:0.0:1788639051.447356:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639051.447371:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772957568:0@lo:400:kworker.0 00000100:00100000:0.0:1788639051.447389:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639051.447404:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772958080:0@lo:400:kworker.0 00000100:00100000:0.0:1788639051.447435:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639051.447477:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772957056 00000100:00100000:0.0:1788639051.447482:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772957056 00000100:00100000:0.0:1788639051.447513:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788639051.447520:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f78f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875523772957056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639051.447554:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f78f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875523772957056:12345-0@lo:400:kworker.0 Request processed in 35us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639051.447560:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788639051.447579:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772957696 00000100:00100000:0.0:1788639051.447582:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772957696 00000100:00100000:0.0:1788639051.447605:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772958208 00000100:00100000:0.0:1788639051.447608:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772958208 00000100:00100000:0.0:1788639051.447640:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772957568 00000100:00100000:0.0:1788639051.447643:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772957568 00000100:00100000:0.0:1788639051.447652:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772958080 00000100:00100000:0.0:1788639051.447655:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772958080 00000100:00100000:0.0:1788639051.447666:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788639051.447672:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f78df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772957696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639051.447706:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f78df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772957696:12345-0@lo:400:kworker.0 Request processed in 33us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639051.447712:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788639051.447723:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788639051.447728:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f78d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772958208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639051.447751:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f78d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772958208:12345-0@lo:400:kworker.0 Request processed in 23us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639051.447757:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788639051.447767:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788639051.447772:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f78e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772957568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639051.447796:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f78e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772957568:12345-0@lo:400:kworker.0 Request processed in 25us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639051.447813:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788639051.447824:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788639051.447829:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f78dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772958080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639051.447853:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f78dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772958080:12345-0@lo:400:kworker.0 Request processed in 24us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639051.447859:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788639051.447892:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875523772957056:0@lo:400:kworker.0 00010000:00080000:0.0:1788639051.447903:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f34700 x1875523772957568/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639051.447910:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772957568:0@lo:400:kworker.0 00010000:00080000:0.0:1788639051.447918:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2416e7800 x1875523772958080/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639051.447938:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772958080:0@lo:400:kworker.0 00010000:00080000:0.0:1788639051.447949:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f34000 x1875523772957696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639051.447957:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772957696:0@lo:400:kworker.0 00010000:00080000:0.0:1788639051.447966:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2416e5180 x1875523772958208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639051.447973:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772958208:0@lo:400:kworker.0 00000100:00080000:0.0:1788639051.447998:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788639051.448002:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788639051.448009:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772957184 00000100:00100000:0.0:1788639051.448012:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772957184 00000100:00100000:0.0:1788639051.448035:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788639051.448041:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f78ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772957184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639051.448075:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f78ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772957184:12345-0@lo:400:kworker.0 Request processed in 34us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639051.448081:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788639051.448101:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772957184:0@lo:400:kworker.0 00000100:00100000:2.0:1788639051.449925:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772956672 00000100:00100000:2.0:1788639051.449939:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772956672 00000100:00100000:2.0:1788639051.449993:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788639051.450002:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b679c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+24:3644:x1875523772956672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639051.450095:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b679c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+24:3644:x1875523772956672:12345-0@lo:400:kworker.0 Request processed in 94us (2917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639051.450102:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788639051.450154:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01f1eef9-e690-4065-bf99-bf821af7b626:3644:1875523772956672:0@lo:400:kworker.0 00000100:00100000:0.0:1788639051.451639:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788639051.451655:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f78f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772958336:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788639051.451705:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639051.451741:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772958336 00000100:00100000:0.0:1788639051.451747:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772958336 00000100:00100000:0.0:1788639051.451783:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788639051.451790:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f78c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772958336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788639051.451832:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788639051.451872:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f78c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772958336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639051.451879:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1788639051.451914:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae37f78f480 x1875523772958336/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639067 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639051.451930:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f78f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772958336:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788639051.956987:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772958464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788639051.957052:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639051.957224:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788639051.957237:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772958592:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788639051.957267:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639051.957479:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772958464 00000100:00100000:0.0:1788639051.957487:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772958464 00000100:00100000:0.0:1788639051.957535:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788639051.957543:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f78f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772958464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788639051.957564:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788639051.957611:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f78f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772958464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639051.957640:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788639051.959175:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772958592 00000100:00100000:0.0:1788639051.959185:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772958592 00000100:00100000:0.0:1788639051.959223:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788639051.959231:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2416e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772958592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788639051.959264:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00010000:00080000:2.0:1788639051.959344:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2432c7800 x1875523772958464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639067 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639051.959365:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772958464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788639051.959390:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2416e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772958592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 159us (2120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639051.959399:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788639051.959454:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772958592:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788639052.214107:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639052.473508:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772958720:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788639052.473575:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639052.473734:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772958720 00000100:00100000:0.0:1788639052.473742:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772958720 00000100:00100000:0.0:1788639052.473789:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788639052.473811:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2416e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772958720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788639052.473841:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788639052.481474:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2416e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772958720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 7665us (7887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639052.481490:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788639052.481673:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772958720:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788639052.771302:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639052.771357:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754010624 00000100:00100000:3.0:1788639052.771366:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754010624 00000100:00100000:3.0:1788639052.771416:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 286 00000100:00100000:3.0:1788639052.771425:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+10:2406:x1875523754010624:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639052.771481:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+10:2406:x1875523754010624:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 58us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639052.771489:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 286 00000100:00100000:3.0:1788639052.780234:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639052.780278:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639052.780766:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754010752 00000100:00100000:2.0:1788639052.780776:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754010752 00000100:00100000:2.0:1788639052.780837:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754010880 00000100:00100000:2.0:1788639052.780840:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754010880 00000100:00100000:1.0:1788639052.780859:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 115 00000100:00100000:1.0:1788639052.780869:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2405:x1875523754010752:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:1.0:1788639052.780935:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2405:x1875523754010752:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 67us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639052.781018:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 116 00000100:00100000:2.0:1788639052.781029:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2405:x1875523754010880:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639052.781055:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2405:x1875523754010880:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 30us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639052.781062:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 116 00000100:00080000:2.0:1788639052.781082:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788639052.781085:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788639052.785864:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 115 00010000:00010000:3.0:1788639053.238856:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639054.004857:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788639054.004876:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772958848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788639054.004933:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639054.005213:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772958848 00000100:00100000:1.0:1788639054.005221:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772958848 00000100:00100000:1.0:1788639054.005280:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788639054.005290:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772958848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788639054.005318:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788639054.005361:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772958848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639054.005368:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1788639054.005406:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2432cd880 x1875523772958848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639070 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639054.005430:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772958848:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788639054.005492:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788639054.005604:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788639054.005633:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772958976:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788639054.005666:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639054.005797:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772958976 00000100:00100000:2.0:1788639054.005802:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772958976 00000100:00100000:2.0:1788639054.005834:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788639054.005840:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772958976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788639054.005851:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788639054.005879:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772958976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639054.005885:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1788639054.005936:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788639054.005964:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2416e6d80 x1875523772958976/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639070 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639054.005977:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772958976:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788639054.261001:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639055.285956:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639056.309830:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639056.565241:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772959360:0@lo:400:kworker.0 00000100:00100000:2.0:1788639056.565309:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639056.565350:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875523772959872:0@lo:400:kworker.0 00000100:00100000:2.0:1788639056.565376:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639056.565395:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875523772960384:0@lo:400:kworker.0 00000100:00100000:2.0:1788639056.565413:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639056.565426:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875523772959232:0@lo:400:kworker.0 00000100:00100000:2.0:1788639056.565433:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788639056.565438:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875523772959488:0@lo:400:kworker.0 00000100:00100000:0.0:1788639056.565452:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639056.565467:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772959872 00000100:00100000:0.0:1788639056.565471:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875523772959744:0@lo:400:kworker.0 00000100:00100000:2.0:1788639056.565473:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772959872 00000100:00100000:0.0:1788639056.565489:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639056.565502:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875523772960256:0@lo:400:kworker.0 00000100:00100000:0.0:1788639056.565519:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639056.565531:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772960384 00000100:00100000:0.0:1788639056.565531:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1788639056.565534:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772960384 00000100:00100000:0.0:1788639056.565548:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01f1eef9-e690-4065-bf99-bf821af7b626:3644:1875523772959104:0@lo:400:kworker.0 00000100:00100000:2.0:1788639056.565549:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772959232 00000100:00100000:2.0:1788639056.565552:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772959232 00000100:00100000:2.0:1788639056.565561:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772959744 00000100:00100000:2.0:1788639056.565563:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772959744 00000100:00100000:2.0:1788639056.565574:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772960256 00000100:00100000:2.0:1788639056.565576:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772960256 00000100:00100000:0.0:1788639056.565582:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639056.565589:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788639056.565598:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae360686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875523772959872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639056.565639:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772959616:0@lo:400:kworker.0 00000100:00100000:2.0:1788639056.565660:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae360686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875523772959872:12345-0@lo:400:kworker.0 Request processed in 63us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639056.565666:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788639056.565683:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788639056.565689:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae360686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875523772960384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639056.565692:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639056.565709:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772960128:0@lo:400:kworker.0 00000100:00100000:0.0:1788639056.565732:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639056.565740:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772959360 00000100:00100000:1.0:1788639056.565744:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772959360 00000100:00100000:0.0:1788639056.565746:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae360685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772960640:0@lo:400:kworker.0 00000100:00100000:1.0:1788639056.565763:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772959616 00000100:00100000:0.0:1788639056.565764:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639056.565765:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772959616 00000100:00100000:1.0:1788639056.565791:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788639056.565797:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5f2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772959360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639056.565804:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772960128 00000100:00100000:0.0:1788639056.565806:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772960128 00000100:00100000:1.0:1788639056.565832:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5f2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772959360:12345-0@lo:400:kworker.0 Request processed in 35us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639056.565838:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788639056.565839:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772960640 00000100:00100000:0.0:1788639056.565842:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772960640 00000100:00100000:0.0:1788639056.565857:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788639056.565862:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f78ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772960128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639056.565891:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f78ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772960128:12345-0@lo:400:kworker.0 Request processed in 29us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639056.565896:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788639056.565907:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788639056.565912:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f78fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772960640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639056.565933:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f78fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772960640:12345-0@lo:400:kworker.0 Request processed in 21us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639056.565938:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1788639056.565974:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f37100 x1875523772960128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639056.565986:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772960128:0@lo:400:kworker.0 00010000:00080000:0.0:1788639056.565994:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae360685180 x1875523772960640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639056.566002:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae360685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772960640:0@lo:400:kworker.0 00000100:00100000:0.0:1788639056.566037:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788639056.566044:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f78d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875523772959232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639056.566072:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f78d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875523772959232:12345-0@lo:400:kworker.0 Request processed in 30us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639056.566077:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788639056.566089:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788639056.566094:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f78c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875523772959744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639056.566097:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788639056.566102:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f78ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772959616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639056.566125:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f78ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772959616:12345-0@lo:400:kworker.0 Request processed in 22us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639056.566125:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f78c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875523772959744:12345-0@lo:400:kworker.0 Request processed in 31us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639056.566132:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788639056.566132:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788639056.566143:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788639056.566149:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f78c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875523772960256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639056.566176:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772959616:0@lo:400:kworker.0 00000100:00100000:1.0:1788639056.566186:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875523772959232:0@lo:400:kworker.0 00000100:00100000:0.0:1788639056.566188:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f78c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875523772960256:12345-0@lo:400:kworker.0 Request processed in 40us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639056.566194:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788639056.566195:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875523772959744:0@lo:400:kworker.0 00000100:00100000:1.0:1788639056.566204:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875523772960256:0@lo:400:kworker.0 00000100:00100000:2.0:1788639056.566347:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae360686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875523772960384:12345-0@lo:400:kworker.0 Request processed in 659us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639056.566353:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:2.0:1788639056.566376:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788639056.566380:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788639056.566382:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788639056.566384:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788639056.566395:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772959104 00000100:00100000:2.0:1788639056.566398:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772959104 00000100:00100000:2.0:1788639056.566434:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788639056.566440:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+24:3644:x1875523772959104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639056.566478:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+24:3644:x1875523772959104:12345-0@lo:400:kworker.0 Request processed in 38us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639056.566485:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788639056.566509:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639056.566607:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01f1eef9-e690-4065-bf99-bf821af7b626:3644:1875523772959104:0@lo:400:kworker.0 00000100:00100000:3.0:1788639056.566696:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788639056.566706:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242f0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772960768:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788639056.566738:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639056.566738:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772960000:0@lo:400:kworker.0 00000100:00100000:2.0:1788639056.566760:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639056.566772:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772960768 00000100:00100000:3.0:1788639056.566787:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772960768 00000100:00100000:2.0:1788639056.566787:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772960512:0@lo:400:kworker.0 00000100:00100000:2.0:1788639056.566807:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639056.566819:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788639056.566825:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772960768:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788639056.566828:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772959360:0@lo:400:kworker.0 00010000:00080000:2.0:1788639056.566838:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f34700 x1875523772959872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00002000:00000024:3.0:1788639056.566844:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788639056.566847:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875523772959872:0@lo:400:kworker.0 00010000:00080000:2.0:1788639056.566855:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f35c00 x1875523772960384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639056.566874:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772960768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639056.566876:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875523772960384:0@lo:400:kworker.0 00000100:00100000:3.0:1788639056.566881:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788639056.566898:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772960000 00000100:00100000:2.0:1788639056.566901:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772960000 00010000:00080000:3.0:1788639056.566905:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae242f0a680 x1875523772960768/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639072 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639056.566919:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242f0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772960768:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788639056.566923:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772960512 00000100:00100000:2.0:1788639056.566925:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772960512 00000100:00080000:3.0:1788639056.566938:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788639056.566940:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788639056.566940:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788639056.566946:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae360685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772960000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639056.566956:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788639056.566961:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae360686d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772960512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639056.566979:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae360685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772960000:12345-0@lo:400:kworker.0 Request processed in 33us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639056.566985:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788639056.566986:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae360686d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772960512:12345-0@lo:400:kworker.0 Request processed in 25us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639056.566991:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1788639056.567014:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f35f80 x1875523772960000/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639056.567023:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772960000:0@lo:400:kworker.0 00010000:00080000:3.0:1788639056.568300:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f37480 x1875523772960512/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639056.568314:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772960512:0@lo:400:kworker.0 00000100:00100000:1.0:1788639056.586889:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772959488 00000100:00100000:1.0:1788639056.586900:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772959488 00000100:00100000:1.0:1788639056.586957:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788639056.586976:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae360684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875523772959488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639056.587056:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae360684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875523772959488:12345-0@lo:400:kworker.0 Request processed in 82us (20546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639056.587063:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788639056.587111:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875523772959488:0@lo:400:kworker.0 00000100:00100000:0.0:1788639057.077989:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242f0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772961024:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788639057.078070:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639057.078131:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788639057.078139:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae360685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772960896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788639057.078165:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639057.078197:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772961024 00000100:00100000:0.0:1788639057.078204:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772961024 00000100:00100000:0.0:1788639057.078441:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788639057.078453:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f78f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772961024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788639057.078484:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788639057.078539:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f78f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772961024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639057.078546:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788639057.078568:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772960896 00000100:00100000:0.0:1788639057.078573:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772960896 00000100:00100000:0.0:1788639057.078598:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788639057.078604:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f78ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772960896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788639057.078639:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788639057.078676:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f78ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772960896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639057.078683:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1788639057.079472:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae360685180 x1875523772960896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639073 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639057.079494:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae360685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772960896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788639057.079508:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242f0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772961024:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1788639057.307883:0:11991:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 16:10:56 (1788639056) === 00010000:00010000:3.0:1788639057.333851:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639057.589038:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788639057.589060:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772961152:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788639057.589137:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639057.589247:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772961152 00000100:00100000:1.0:1788639057.589255:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772961152 00000100:00100000:1.0:1788639057.589303:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788639057.589312:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772961152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788639057.589342:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788639057.589391:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772961152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639057.589397:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788639057.589526:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772961152:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788639057.714554:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639057.714659:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754011008 00000100:00100000:2.0:1788639057.714669:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754011008 00000100:00100000:2.0:1788639057.714784:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 288 00000100:00100000:2.0:1788639057.714796:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b679450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+10:8746:x1875523754011008:12345-192.168.206.18@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788639057.714811:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639057.714838:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae242f23200/0x25c454990262c245 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e853c1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639057.714880:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae242f23200/0x25c454990262c245 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e853c1 expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639057.714892:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae242f23200/0x25c454990262c245 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e853c1 expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639057.714902:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f23200, rc 0) 00000100:00100000:2.0:1788639057.714952:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b679450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+11:8746:x1875523754011008:12345-192.168.206.18@tcp:101:mount.lustre.0 Request processed in 158us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639057.714959:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 288 00000100:00100000:3.0:1788639057.726070:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639057.726259:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754011136 00000100:00100000:0.0:1788639057.726271:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754011136 00000100:00100000:0.0:1788639057.726355:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 289 00000100:00100000:0.0:1788639057.726367:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b679050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+11:8746:x1875523754011136:12345-192.168.206.18@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788639057.726581:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b679050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+11:8746:x1875523754011136:12345-192.168.206.18@tcp:501:mount.lustre.0 Request processed in 215us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639057.726590:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 289 00000100:00100000:3.0:1788639057.728761:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639057.728898:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754011264 00000100:00100000:2.0:1788639057.728910:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754011264 00000100:00100000:2.0:1788639057.728979:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 290 00000100:00100000:2.0:1788639057.728989:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+11:8746:x1875523754011264:12345-192.168.206.18@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788639057.729174:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+11:8746:x1875523754011264:12345-192.168.206.18@tcp:503:mount.lustre.0 Request processed in 185us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639057.729182:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 290 00000100:00100000:1.0:1788639057.742585:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639057.742817:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754011392 00000100:00100000:2.0:1788639057.742828:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754011392 00000100:00100000:2.0:1788639057.743013:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 291 00000100:00100000:2.0:1788639057.743025:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+11:8750:x1875523754011392:12345-192.168.206.18@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788639057.743171:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+11:8750:x1875523754011392:12345-192.168.206.18@tcp:502:llog_process_th.0 Request processed in 148us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639057.743179:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 291 00000100:00100000:3.0:1788639057.788251:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639057.788405:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754011520 00000100:00100000:0.0:1788639057.788415:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754011520 00000100:00100000:0.0:1788639057.788470:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 292 00000100:00100000:0.0:1788639057.788480:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+11:8750:x1875523754011520:12345-192.168.206.18@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788639057.788665:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+11:8750:x1875523754011520:12345-192.168.206.18@tcp:502:llog_process_th.0 Request processed in 186us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639057.788674:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 292 00000100:00100000:3.0:1788639057.806387:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639057.808288:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754011648 00000100:00100000:1.0:1788639057.808300:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754011648 00000100:00100000:1.0:1788639057.808366:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 293 00000100:00100000:1.0:1788639057.808376:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+11:8750:x1875523754011648:12345-192.168.206.18@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788639057.808538:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+11:8750:x1875523754011648:12345-192.168.206.18@tcp:502:llog_process_th.0 Request processed in 162us (2158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639057.808547:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 293 00000100:00100000:1.0:1788639057.815741:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639057.815879:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754011776 00000100:00100000:2.0:1788639057.815889:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754011776 00000100:00100000:2.0:1788639057.815940:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 294 00000100:00100000:2.0:1788639057.815951:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b678050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+11:8746:x1875523754011776:12345-192.168.206.18@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788639057.815966:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639057.815983:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae242f22c00/0x25c454990262c24c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e853f2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639057.816022:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae242f22c00/0x25c454990262c24c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e853f2 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639057.816033:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae242f22c00/0x25c454990262c24c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e853f2 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639057.816042:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f22c00, rc 0) 00000100:00100000:2.0:1788639057.816095:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b678050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+12:8746:x1875523754011776:12345-192.168.206.18@tcp:101:mount.lustre.0 Request processed in 146us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639057.816102:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 294 00000100:00100000:3.0:1788639057.820932:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639057.821203:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754011904 00000100:00100000:0.0:1788639057.821216:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754011904 00000100:00100000:0.0:1788639057.821297:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 295 00000100:00100000:0.0:1788639057.821310:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+12:8746:x1875523754011904:12345-192.168.206.18@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788639057.821746:0:6508:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788639057.821796:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788639057.821801:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788639057.821805:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788639057.821808:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788639057.821812:0:6508:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1788639057.824367:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+12:8746:x1875523754011904:12345-192.168.206.18@tcp:256:mount.lustre.0 Request processed in 3044us (3434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639057.824385:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 295 00000100:00100000:1.0:1788639057.828251:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639057.828365:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754012032 00000100:00100000:2.0:1788639057.828375:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754012032 00000100:00100000:2.0:1788639057.828432:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 296 00000100:00100000:2.0:1788639057.828441:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+12:8746:x1875523754012032:12345-192.168.206.18@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788639057.828457:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639057.828473:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae242f23400/0x25c454990262c253 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e853f9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639057.828499:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae242f23400/0x25c454990262c253 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e853f9 expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639057.828528:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae242f23400/0x25c454990262c253 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e853f9 expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639057.828537:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f23400, rc 0) 00000100:00100000:2.0:1788639057.828602:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+13:8746:x1875523754012032:12345-192.168.206.18@tcp:101:mount.lustre.0 Request processed in 162us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639057.828609:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 296 00000100:00100000:3.0:1788639057.830749:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639057.831178:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754012160 00000100:00100000:0.0:1788639057.831194:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754012160 00000100:00100000:0.0:1788639057.831308:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 297 00000100:00100000:0.0:1788639057.831319:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+13:8746:x1875523754012160:12345-192.168.206.18@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788639057.831469:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+13:8746:x1875523754012160:12345-192.168.206.18@tcp:501:mount.lustre.0 Request processed in 151us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639057.831478:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 297 00000100:00100000:3.0:1788639057.834308:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639057.835100:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754012288 00000100:00100000:0.0:1788639057.835115:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754012288 00000100:00100000:0.0:1788639057.835183:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 298 00000100:00100000:0.0:1788639057.835195:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+13:8746:x1875523754012288:12345-192.168.206.18@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788639057.835343:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+13:8746:x1875523754012288:12345-192.168.206.18@tcp:503:mount.lustre.0 Request processed in 150us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639057.835351:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 298 00000100:00100000:2.0:1788639057.840320:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639057.841026:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754012416 00000100:00100000:0.0:1788639057.841042:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754012416 00000100:00100000:0.0:1788639057.841112:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 299 00000100:00100000:0.0:1788639057.841125:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+13:8756:x1875523754012416:12345-192.168.206.18@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788639057.841353:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+13:8756:x1875523754012416:12345-192.168.206.18@tcp:502:llog_process_th.0 Request processed in 230us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639057.841362:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 299 00000100:00100000:3.0:1788639057.844267:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639057.844438:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754012544 00000100:00100000:2.0:1788639057.844450:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754012544 00000100:00100000:2.0:1788639057.844519:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 300 00000100:00100000:2.0:1788639057.844530:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+13:8756:x1875523754012544:12345-192.168.206.18@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788639057.844778:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+13:8756:x1875523754012544:12345-192.168.206.18@tcp:502:llog_process_th.0 Request processed in 240us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639057.844787:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 300 00000100:00100000:3.0:1788639057.852755:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639057.852861:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754012672 00000100:00100000:2.0:1788639057.852874:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754012672 00000100:00100000:2.0:1788639057.852933:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 16 00000100:00100000:2.0:1788639057.852944:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2404:x1875523754012672:12345-192.168.206.18@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788639057.852980:0:6518:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from aeb8e47b-1fde-42ab-834f-69a8d71ffb89@192.168.206.18@tcp t0 exp 0000000000000000 cur 316 last 0 00000020:00000080:2.0:1788639057.853035:0:6518:0:(genops.c:1385:class_connect()) connect: client aeb8e47b-1fde-42ab-834f-69a8d71ffb89, cookie 0x25c454990262c25a 00000100:00100000:3.0:1788639057.853062:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000004:00100000:2.0:1788639057.853065:0:6518:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788639057.853132:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754012928 00000100:00100000:0.0:1788639057.853137:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754012928 00000100:00100000:0.0:1788639057.853174:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 17 00000100:00100000:0.0:1788639057.853180:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2404:x1875523754012928:12345-192.168.206.18@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788639057.853196:0:10169:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from aeb8e47b-1fde-42ab-834f-69a8d71ffb89@192.168.206.18@tcp t0 exp 0000000000000000 cur 316 last 0 00000100:00080000:2.0:1788639057.853208:0:6518:0:(import.c:65:import_set_state_nolock()) ffff9ae242f29800 : changing import state from RECOVER to FULL 00000020:00000080:0.0:1788639057.853218:0:10169:0:(genops.c:1385:class_connect()) connect: client aeb8e47b-1fde-42ab-834f-69a8d71ffb89, cookie 0x25c454990262c261 00000004:00100000:0.0:1788639057.853230:0:10169:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788639057.853297:0:10169:0:(import.c:65:import_set_state_nolock()) ffff9ae2432a6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788639057.853300:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+6:2404:x1875523754012672:12345-192.168.206.18@tcp:38:mount.lustre.0 Request processed in 357us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639057.853321:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+6:2404:x1875523754012928:12345-192.168.206.18@tcp:38:mount.lustre.0 Request processed in 141us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639057.853327:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 16 00000100:00100000:0.0:1788639057.853330:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 17 00000100:00100000:1.0:1788639057.856019:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639057.856152:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639057.856203:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639057.856372:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754013312 00000100:00100000:0.0:1788639057.856383:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754013312 00000100:00100000:3.0:1788639057.856391:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754013440 00000100:00100000:3.0:1788639057.856404:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754013440 00000100:00100000:0.0:1788639057.856461:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754013184 00000100:00100000:0.0:1788639057.856468:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754013184 00000100:00100000:3.0:1788639057.856478:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 123 00000100:00100000:3.0:1788639057.856494:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2405:x1875523754013312:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639057.856506:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 124 00000100:00100000:0.0:1788639057.856522:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2405:x1875523754013440:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639057.856600:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2405:x1875523754013312:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 108us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639057.856610:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 123 00000100:00080000:1.0:1788639057.856706:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788639057.856712:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788639057.859235:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2405:x1875523754013440:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 2696us (3061us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639057.860421:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 18 00000100:00100000:0.0:1788639057.860493:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 124 00000100:00100000:2.0:1788639057.861493:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+6:8746:x1875523754013184:12345-192.168.206.18@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788639057.861529:0:11314:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788639057.861605:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+6:8746:x1875523754013184:12345-192.168.206.18@tcp:41:mount.lustre.0 Request processed in 129us (5401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639057.861629:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 18 00000100:00100000:3.0:1788639057.861803:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639057.861915:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639057.862329:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754012800 00000100:00100000:1.0:1788639057.862337:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754012800 00000100:00100000:3.0:1788639057.864558:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639057.872822:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754013056 00000100:00100000:1.0:1788639057.872835:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754013056 00000100:00100000:1.0:1788639057.872908:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754013568 00000100:00100000:1.0:1788639057.872911:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754013568 00000100:00100000:1.0:1788639057.872934:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 19 00000100:00100000:1.0:1788639057.872943:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+7:0:x1875523754012800:12345-192.168.206.18@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788639057.872974:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788639057.873046:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+7:0:x1875523754012800:12345-192.168.206.18@tcp:41:mount.lustre.0 Request processed in 104us (11244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639057.873054:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 19 00000100:00100000:1.0:1788639057.873071:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 20 00000100:00100000:1.0:1788639057.873078:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+6:0:x1875523754013056:12345-192.168.206.18@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788639057.873090:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788639057.873132:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+6:0:x1875523754013056:12345-192.168.206.18@tcp:41:mount.lustre.0 Request processed in 54us (11217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639057.873138:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 20 00000100:00100000:1.0:1788639057.873150:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 21 00000100:00100000:1.0:1788639057.873156:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+6:8746:x1875523754013568:12345-192.168.206.18@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788639057.873185:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+6:8746:x1875523754013568:12345-192.168.206.18@tcp:40:mount.lustre.0 Request processed in 29us (8639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639057.873190:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 21 00000100:00080000:1.0:1788639057.873227:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788639057.875505:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639057.877147:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639057.877704:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639057.878749:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754013952 00000100:00100000:0.0:1788639057.878763:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754013952 00000100:00100000:0.0:1788639057.878830:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 5 00000100:00100000:0.0:1788639057.878852:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+6:8746:x1875523754013952:12345-192.168.206.18@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788639057.878932:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+6:8746:x1875523754013952:12345-192.168.206.18@tcp:900:mount.lustre.0 Request processed in 82us (3435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639057.878940:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 5 00000100:00100000:1.0:1788639057.879588:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754013696 00000100:00100000:1.0:1788639057.879594:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754013696 00000100:00100000:1.0:1788639057.879754:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754013824 00000100:00100000:1.0:1788639057.879758:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754013824 00000100:00100000:1.0:1788639057.879791:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 20 00000100:00100000:1.0:1788639057.879797:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2404:x1875523754013696:12345-192.168.206.18@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788639057.879823:0:8431:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from aeb8e47b-1fde-42ab-834f-69a8d71ffb89@192.168.206.18@tcp t0 exp 0000000000000000 cur 316 last 0 00000020:00000080:1.0:1788639057.879849:0:8431:0:(genops.c:1385:class_connect()) connect: client aeb8e47b-1fde-42ab-834f-69a8d71ffb89, cookie 0x25c454990262c268 00002000:00100000:1.0:1788639057.879859:0:8431:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli aeb8e47b-1fde-42ab-834f-69a8d71ffb89/ffff9ae375c28000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788639057.879875:0:8431:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788639057.879943:0:8431:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788639057.879968:0:8431:0:(import.c:65:import_set_state_nolock()) ffff9ae375c2e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788639057.880011:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+6:2404:x1875523754013696:12345-192.168.206.18@tcp:8:mount.lustre.0 Request processed in 213us (4354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639057.880018:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 20 00000100:00100000:1.0:1788639057.880033:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 21 00000100:00100000:1.0:1788639057.880037:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2404:x1875523754013824:12345-192.168.206.18@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788639057.880051:0:8431:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from aeb8e47b-1fde-42ab-834f-69a8d71ffb89@192.168.206.18@tcp t0 exp 0000000000000000 cur 316 last 0 00000020:00000080:1.0:1788639057.880066:0:8431:0:(genops.c:1385:class_connect()) connect: client aeb8e47b-1fde-42ab-834f-69a8d71ffb89, cookie 0x25c454990262c26f 00002000:00100000:1.0:1788639057.880071:0:8431:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli aeb8e47b-1fde-42ab-834f-69a8d71ffb89/ffff9ae2416ef000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788639057.880076:0:8431:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788639057.880108:0:8431:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788639057.880120:0:8431:0:(import.c:65:import_set_state_nolock()) ffff9ae2416e8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788639057.880141:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+6:2404:x1875523754013824:12345-192.168.206.18@tcp:8:mount.lustre.0 Request processed in 103us (2441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639057.880157:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 21 00000100:00100000:3.0:1788639057.882125:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639057.882255:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754014080 00000100:00100000:2.0:1788639057.882264:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754014080 00000100:00100000:2.0:1788639057.882356:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 1 00000100:00100000:2.0:1788639057.882366:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+6:8746:x1875523754014080:12345-192.168.206.18@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788639057.882444:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788639057.882514:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+6:8746:x1875523754014080:12345-192.168.206.18@tcp:33:mount.lustre.0 Request processed in 150us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639057.882521:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 1 00010000:00010000:3.0:1788639058.356916:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639059.130354:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242ef9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772961280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788639059.130429:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639059.130500:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772961280 00000100:00100000:2.0:1788639059.130507:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772961280 00000100:00100000:2.0:1788639059.130701:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788639059.130711:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae360685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772961280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788639059.130734:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788639059.130810:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae360685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772961280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639059.130834:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1788639059.130864:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788639059.130900:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242f0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772961408:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1788639059.130909:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae242ef9c00 x1875523772961280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639075 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639059.130933:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242ef9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772961280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788639059.130974:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639059.131032:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772961408 00000100:00100000:2.0:1788639059.131039:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772961408 00000100:00100000:2.0:1788639059.131177:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788639059.131186:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae342e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772961408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788639059.131198:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788639059.131237:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae342e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772961408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639059.131243:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1788639059.131634:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788639059.131807:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae242f0a680 x1875523772961408/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639075 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639059.131832:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242f0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772961408:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788639059.389657:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639060.404899:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639061.428951:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639061.684898:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342e3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772961536:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788639061.684969:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639061.685043:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523772962048:0@lo:400:kworker.0 00000100:00100000:0.0:1788639061.685060:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772961920:0@lo:400:kworker.0 00000100:00100000:2.0:1788639061.685072:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639061.685097:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772962560:0@lo:400:kworker.0 00000100:00100000:0.0:1788639061.685103:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639061.685127:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639061.685129:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875523772962432:0@lo:400:kworker.0 00000100:00100000:2.0:1788639061.685151:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772963072:0@lo:400:kworker.0 00000100:00100000:0.0:1788639061.685165:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639061.685178:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639061.685189:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875523772962944:0@lo:400:kworker.0 00000100:00100000:2.0:1788639061.685211:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772961536 00000100:00100000:0.0:1788639061.685217:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639061.685231:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772961536 00000100:00100000:0.0:1788639061.685254:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772962048 00000100:00100000:0.0:1788639061.685259:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772962048 00000100:00100000:0.0:1788639061.685299:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772962432 00000100:00100000:2.0:1788639061.685302:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788639061.685304:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772962432 00000100:00100000:2.0:1788639061.685313:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae360686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772961536:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788639061.685327:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772962944 00000100:00100000:0.0:1788639061.685331:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772962944 00002000:00000024:2.0:1788639061.685341:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788639061.685352:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788639061.685361:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae360684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523772962048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639061.685385:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae360686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772961536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639061.685392:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788639061.685405:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae360684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523772962048:12345-0@lo:400:kworker.0 Request processed in 44us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639061.685413:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:2.0:1788639061.685416:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788639061.685421:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788639061.685433:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788639061.685441:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875523772962432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639061.685449:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788639061.685459:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24319b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875523772962944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639061.685479:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875523772962432:12345-0@lo:400:kworker.0 Request processed in 38us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639061.685495:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24319b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875523772962944:12345-0@lo:400:kworker.0 Request processed in 37us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639061.685500:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00010000:00080000:0.0:1788639061.685537:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f34700 x1875523772962432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639061.685552:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875523772962432:0@lo:400:kworker.0 00010000:00080000:0.0:1788639061.685563:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f37100 x1875523772962944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639061.685572:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875523772962944:0@lo:400:kworker.0 00000100:00100000:3.0:1788639061.685652:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242efbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523772961664:0@lo:400:kworker.0 00000100:00100000:3.0:1788639061.685769:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639061.685780:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788639061.685803:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772962176:0@lo:400:kworker.0 00000100:00100000:2.0:1788639061.685827:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523772962048:0@lo:400:kworker.0 00000100:00100000:3.0:1788639061.685834:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788639061.685844:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae342e3e680 x1875523772961536/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639077 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639061.685859:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772962688:0@lo:400:kworker.0 00000100:00100000:2.0:1788639061.685860:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342e3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772961536:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788639061.685889:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639061.685917:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772961920 00000100:00100000:3.0:1788639061.685918:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788639061.685922:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772961920 00000100:00100000:3.0:1788639061.685927:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242ef9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523772961792:0@lo:400:kworker.0 00000100:00100000:2.0:1788639061.685945:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772962176 00000100:00100000:2.0:1788639061.685949:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772962176 00000100:00100000:3.0:1788639061.685954:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639061.685965:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788639061.685974:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772961920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639061.685975:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875523772962304:0@lo:400:kworker.0 00000100:00100000:3.0:1788639061.686007:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639061.686028:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772961920:12345-0@lo:400:kworker.0 Request processed in 55us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639061.686033:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875523772962816:0@lo:400:kworker.0 00000100:00100000:2.0:1788639061.686049:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788639061.686063:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788639061.686069:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae342e3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772962176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639061.686076:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639061.686110:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae342e3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772962176:12345-0@lo:400:kworker.0 Request processed in 41us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639061.686113:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772962176:0@lo:400:kworker.0 00000100:00100000:2.0:1788639061.686119:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788639061.686146:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772962560 00000100:00100000:3.0:1788639061.686151:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772962560 00000100:00100000:2.0:1788639061.686153:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772961792 00000100:00100000:2.0:1788639061.686158:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772961792 00000100:00100000:2.0:1788639061.686172:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772962304 00000100:00100000:2.0:1788639061.686174:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772962304 00000100:00100000:3.0:1788639061.686197:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772963072 00000100:00100000:2.0:1788639061.686197:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772962816 00000100:00100000:3.0:1788639061.686204:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772963072 00000100:00100000:2.0:1788639061.686204:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772962816 00000100:00100000:2.0:1788639061.686233:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788639061.686236:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772962688 00000100:00100000:2.0:1788639061.686241:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae342e3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523772961792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639061.686242:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772962688 00000100:00100000:3.0:1788639061.686262:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788639061.686268:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae360684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772962560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639061.686306:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae360684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772962560:12345-0@lo:400:kworker.0 Request processed in 37us (1179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639061.686312:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788639061.686324:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788639061.686330:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae360687b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772963072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639061.686357:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae360687b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772963072:12345-0@lo:400:kworker.0 Request processed in 28us (1180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639061.686362:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788639061.686373:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788639061.686379:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae342e3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772962688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639061.686407:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae342e3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772962688:12345-0@lo:400:kworker.0 Request processed in 29us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639061.686413:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788639061.686433:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788639061.686439:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae342e3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875523772962304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639061.686467:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae342e3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875523772962304:12345-0@lo:400:kworker.0 Request processed in 29us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639061.686479:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788639061.686493:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788639061.686499:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae342e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875523772962816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639061.686527:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae342e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875523772962816:12345-0@lo:400:kworker.0 Request processed in 29us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639061.686533:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:3.0:1788639061.686547:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788639061.686551:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788639061.686553:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788639061.686570:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f36680 x1875523772963072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639061.686580:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772963072:0@lo:400:kworker.0 00010000:00080000:3.0:1788639061.686590:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f34380 x1875523772962560/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639061.686598:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772962560:0@lo:400:kworker.0 00000100:00100000:0.0:1788639061.686662:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772961664 00000100:00100000:0.0:1788639061.686667:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772961664 00000100:00100000:0.0:1788639061.686709:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1788639061.686717:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+24:3643:x1875523772961664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639061.686745:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772961920:0@lo:400:kworker.0 00000100:00100000:0.0:1788639061.686765:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+24:3643:x1875523772961664:12345-0@lo:400:kworker.0 Request processed in 48us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639061.686773:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1788639061.687714:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae342e3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523772961792:12345-0@lo:400:kworker.0 Request processed in 1472us (1757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639061.687722:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788639061.687809:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242ef9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523772961792:0@lo:400:kworker.0 00000100:00100000:3.0:1788639061.687822:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875523772962304:0@lo:400:kworker.0 00000100:00100000:3.0:1788639061.687832:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875523772962816:0@lo:400:kworker.0 00000100:00100000:3.0:1788639061.687842:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242efbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523772961664:0@lo:400:kworker.0 00010000:00080000:3.0:1788639061.687855:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f34000 x1875523772962688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639061.687864:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772962688:0@lo:400:kworker.0 00000100:00100000:1.0:1788639062.197081:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342e3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772963328:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788639062.197143:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639062.197210:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788639062.197215:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772963200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788639062.197236:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639062.197369:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772963200 00000100:00100000:3.0:1788639062.197470:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772963200 00000100:00100000:2.0:1788639062.197491:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772963328 00000100:00100000:2.0:1788639062.197498:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772963328 00000100:00100000:2.0:1788639062.197541:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788639062.197549:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772963328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788639062.197641:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788639062.197698:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772963328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 149us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639062.197704:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788639062.197844:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342e3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772963328:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788639062.198508:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788639062.198520:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772963200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788639062.198538:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788639062.198595:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772963200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (1357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639062.198602:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1788639062.198704:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f6b100 x1875523772963200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639078 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639062.198720:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772963200:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788639062.454105:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639062.710500:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772963456:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788639062.710568:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639062.710714:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772963456 00000100:00100000:1.0:1788639062.710722:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772963456 00000100:00100000:1.0:1788639062.710783:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788639062.710793:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772963456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788639062.710823:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788639062.710870:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772963456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639062.710877:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788639062.710922:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772963456:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788639063.008142:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639063.009591:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639063.015021:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639063.015061:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639063.015092:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639063.016513:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754014336 00000100:00100000:2.0:1788639063.016529:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754014336 00000100:00100000:2.0:1788639063.016628:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754014592 00000100:00100000:2.0:1788639063.016632:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754014592 00000100:00100000:2.0:1788639063.016663:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 131 00000100:00100000:2.0:1788639063.016673:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae342e3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2408:x1875523754014336:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639063.016776:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae342e3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2408:x1875523754014336:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 103us (8647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639063.016784:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 131 00000100:00100000:2.0:1788639063.016804:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 132 00000100:00100000:2.0:1788639063.016811:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae342e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+6:2408:x1875523754014592:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639063.016839:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae342e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+6:2408:x1875523754014592:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 29us (7260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639063.016846:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 132 00000100:00080000:2.0:1788639063.016865:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788639063.017486:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639063.017515:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639063.017545:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754014848 00000100:00100000:3.0:1788639063.017552:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754014848 00000100:00100000:3.0:1788639063.017596:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754014976 00000100:00100000:3.0:1788639063.017600:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754014976 00000100:00100000:3.0:1788639063.017651:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 56 00000100:00100000:3.0:1788639063.017801:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae342e3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+6:2408:x1875523754014848:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639063.017874:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae342e3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+6:2408:x1875523754014848:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 215us (2869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639063.017883:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 56 00000100:00100000:3.0:1788639063.017907:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 57 00000100:00100000:3.0:1788639063.017918:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+6:2408:x1875523754014976:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639063.017966:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+6:2408:x1875523754014976:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 49us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639063.017975:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 57 00000100:00100000:3.0:1788639063.018009:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754014208 00000100:00100000:3.0:1788639063.018014:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754014208 00000100:00100000:3.0:1788639063.018055:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 302 00000100:00100000:3.0:1788639063.018065:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+13:2408:x1875523754014208:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639063.018096:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+13:2408:x1875523754014208:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 33us (3033us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639063.018103:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 302 00000100:00100000:1.0:1788639063.019275:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754014464 00000100:00100000:1.0:1788639063.019288:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754014464 00000100:00100000:1.0:1788639063.019334:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754014720 00000100:00100000:1.0:1788639063.019338:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754014720 00000100:00100000:1.0:1788639063.019384:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 133 00000100:00100000:1.0:1788639063.019393:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242efbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2408:x1875523754014464:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:1.0:1788639063.019582:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242efbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2408:x1875523754014464:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 189us (4487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639063.019590:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 133 00000100:00100000:1.0:1788639063.019607:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 134 00000100:00080000:2.0:1788639063.019919:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788639063.019926:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788639063.019929:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788639063.019999:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+6:2408:x1875523754014720:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:1.0:1788639063.020037:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+6:2408:x1875523754014720:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 424us (2557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639063.020045:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 134 00000001:02000400:2.0:1788639063.074581:0:12184:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg618-client.virtnet: executing check_config_client /mnt/lustre 00000001:00100000:0.0:1788639063.223605:0:7446:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of aeb8e47b-1fde-42ab-834f-69a8d71ffb89 00000001:00100000:1.0:1788639063.223687:0:6494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of aeb8e47b-1fde-42ab-834f-69a8d71ffb89 00000001:00100000:1.0:1788639063.224250:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aeb8e47b-1fde-42ab-834f-69a8d71ffb89 00000001:00100000:2.0:1788639063.224896:0:9509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aeb8e47b-1fde-42ab-834f-69a8d71ffb89 00010000:00010000:3.0:1788639063.478962:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639064.245002:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772963584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788639064.245071:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639064.248002:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772963712:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788639064.248065:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639064.254688:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772963584 00000100:00100000:2.0:1788639064.254701:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772963584 00000100:00100000:2.0:1788639064.254769:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772963712 00000100:00100000:2.0:1788639064.254773:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772963712 00000100:00100000:2.0:1788639064.254796:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788639064.254805:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772963584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788639064.254835:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788639064.254902:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772963584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (9831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639064.254920:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1788639064.254933:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788639064.254942:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788639064.254950:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772963712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788639064.254961:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788639064.254989:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772963712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (6923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639064.254995:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:3.0:1788639064.256776:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f69500 x1875523772963584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639080 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639064.256799:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772963584:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788639064.257120:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2432c8a80 x1875523772963712/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639080 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639064.257135:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772963712:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788639064.500710:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639065.527799:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639066.548850:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639066.808001:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772963840:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788639066.808100:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639066.813296:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772963840 00000100:00100000:0.0:1788639066.813317:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772963840 00000100:00100000:0.0:1788639066.813402:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788639066.813417:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772963840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788639066.813461:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788639066.813577:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772963840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 164us (5475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639066.813584:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1788639066.813612:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788639066.814786:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772963968:0@lo:400:kworker.0 00000100:00100000:1.0:1788639066.814869:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639066.815071:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772963968 00000100:00100000:1.0:1788639066.815078:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772963968 00000100:00100000:1.0:1788639066.815135:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1788639066.815145:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+24:3641:x1875523772963968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639066.815194:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+24:3641:x1875523772963968:12345-0@lo:400:kworker.0 Request processed in 50us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639066.815202:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1788639066.815249:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772963968:0@lo:400:kworker.0 00000100:00100000:1.0:1788639066.815287:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788639066.815294:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875523772964096:0@lo:400:kworker.0 00000100:00100000:1.0:1788639066.815323:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639066.815355:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772964096 00000100:00100000:1.0:1788639066.815359:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772964096 00000100:00100000:1.0:1788639066.815386:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788639066.815392:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875523772964096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639066.815438:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875523772964096:12345-0@lo:400:kworker.0 Request processed in 47us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639066.815445:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788639066.815470:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875523772964096:0@lo:400:kworker.0 00000100:00100000:1.0:1788639066.815496:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772964224:0@lo:400:kworker.0 00000100:00100000:1.0:1788639066.815521:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639066.815546:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772964224 00000100:00100000:1.0:1788639066.815549:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772964224 00000100:00100000:1.0:1788639066.815571:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788639066.815576:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3691a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772964224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639066.815608:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3691a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772964224:12345-0@lo:400:kworker.0 Request processed in 31us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639066.815650:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788639066.815673:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772964224:0@lo:400:kworker.0 00000100:00100000:1.0:1788639066.815696:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788639066.815701:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3691a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875523772964352:0@lo:400:kworker.0 00000100:00100000:1.0:1788639066.815732:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639066.815756:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772964352 00000100:00100000:1.0:1788639066.815759:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772964352 00000100:00100000:1.0:1788639066.815779:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788639066.815785:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3691a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875523772964352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639066.815823:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3691a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875523772964352:12345-0@lo:400:kworker.0 Request processed in 38us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639066.815829:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788639066.815850:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3691a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875523772964352:0@lo:400:kworker.0 00000100:00100000:1.0:1788639066.815874:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3691a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772964480:0@lo:400:kworker.0 00000100:00100000:1.0:1788639066.816046:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639066.816069:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772964480 00000100:00100000:1.0:1788639066.816073:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772964480 00000100:00100000:1.0:1788639066.816095:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788639066.816101:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3691a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772964480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639066.816128:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3691a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772964480:12345-0@lo:400:kworker.0 Request processed in 27us (82us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639066.816134:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788639066.816154:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3691a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772964480:0@lo:400:kworker.0 00000100:00100000:1.0:1788639066.816175:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788639066.816189:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3691a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875523772964608:0@lo:400:kworker.0 00000100:00100000:1.0:1788639066.816216:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639066.816238:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772964608 00000100:00100000:1.0:1788639066.816241:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772964608 00000100:00100000:1.0:1788639066.816275:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788639066.816280:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3691ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875523772964608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639066.816312:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3691ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875523772964608:12345-0@lo:400:kworker.0 Request processed in 32us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639066.816318:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788639066.816342:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3691a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875523772964608:0@lo:400:kworker.0 00000100:00100000:1.0:1788639066.816369:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3691a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875523772964736:0@lo:400:kworker.0 00000100:00100000:1.0:1788639066.816391:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639066.816461:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772964736 00000100:00100000:1.0:1788639066.816466:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772964736 00000100:00100000:1.0:1788639066.816490:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788639066.816497:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3691ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875523772964736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639066.816531:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3691ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875523772964736:12345-0@lo:400:kworker.0 Request processed in 35us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639066.816536:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00010000:00080000:1.0:1788639066.816562:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae3691a9c00 x1875523772964736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639066.816574:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3691a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875523772964736:0@lo:400:kworker.0 00000100:00100000:1.0:1788639066.816600:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788639066.816606:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3691a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772964864:0@lo:400:kworker.0 00000100:00100000:1.0:1788639066.816658:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639066.816697:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3691ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772964992:0@lo:400:kworker.0 00000100:00100000:1.0:1788639066.816712:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639066.816765:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788639066.816770:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3691aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875523772965120:0@lo:400:kworker.0 00000100:00100000:1.0:1788639066.816794:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639066.816817:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772965120 00000100:00100000:1.0:1788639066.816821:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772965120 00000100:00100000:1.0:1788639066.816846:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788639066.816853:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875523772965120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639066.816885:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875523772965120:12345-0@lo:400:kworker.0 Request processed in 33us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639066.816891:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788639066.816916:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3691aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875523772965120:0@lo:400:kworker.0 00000100:00100000:1.0:1788639066.816955:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3691aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875523772965248:0@lo:400:kworker.0 00000100:00100000:3.0:1788639066.816976:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772964864 00000100:00100000:1.0:1788639066.816981:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639066.816994:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772964864 00000100:00100000:1.0:1788639066.817008:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772965248 00000100:00100000:1.0:1788639066.817014:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772965248 00000100:00100000:3.0:1788639066.817034:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772964992 00000100:00100000:3.0:1788639066.817039:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772964992 00000100:00100000:3.0:1788639066.817062:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788639066.817070:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3691a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772964864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639066.817107:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788639066.817115:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36914d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875523772965248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639066.817141:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3691a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772964864:12345-0@lo:400:kworker.0 Request processed in 59us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639066.817149:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36914d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875523772965248:12345-0@lo:400:kworker.0 Request processed in 34us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639066.817154:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788639066.817162:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788639066.817178:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788639066.817186:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3691a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772964992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639066.817234:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3691a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772964992:12345-0@lo:400:kworker.0 Request processed in 48us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639066.817242:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1788639066.817256:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae3691aad80 x1875523772965248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639066.817267:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3691aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875523772965248:0@lo:400:kworker.0 00010000:00080000:3.0:1788639066.817291:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae3691ab100 x1875523772964992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1788639066.817295:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae3691a9c00 x1875523772964864/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639066.817319:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3691ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772964992:0@lo:400:kworker.0 00000100:00100000:1.0:1788639066.817320:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3691a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772964864:0@lo:400:kworker.0 00000100:00100000:1.0:1788639066.817367:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788639066.817373:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36914c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772965376:0@lo:400:kworker.0 00000100:00100000:1.0:1788639066.817396:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788639066.817456:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788639066.817461:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788639066.817463:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788639066.817510:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772965376 00000100:00100000:3.0:1788639066.817516:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772965376 00000100:00100000:3.0:1788639066.817560:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788639066.817567:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36914c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772965376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639066.817605:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36914c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772965376:12345-0@lo:400:kworker.0 Request processed in 39us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639066.817611:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:3.0:1788639066.817675:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae36914c000 x1875523772965376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639066.817685:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36914c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772965376:0@lo:400:kworker.0 00010000:00080000:0.0:1788639066.817806:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae24233d880 x1875523772963840/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639082 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639066.817828:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772963840:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788639066.818034:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788639067.316860:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788639067.316885:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772965504:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788639067.316952:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639067.317023:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772965504 00000100:00100000:3.0:1788639067.317030:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772965504 00000100:00100000:3.0:1788639067.317076:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788639067.317086:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772965504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788639067.317116:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788639067.317158:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772965504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639067.317170:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788639067.317212:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772965504:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788639067.317405:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788639067.317416:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772965632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788639067.317448:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639067.317510:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772965632 00000100:00100000:2.0:1788639067.317514:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772965632 00000100:00100000:2.0:1788639067.317548:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788639067.317555:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36914ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772965632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788639067.317568:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788639067.317602:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36914ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772965632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639067.317607:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:1.0:1788639067.317846:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f6bb80 x1875523772965632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639083 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639067.317860:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772965632:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788639067.572833:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639067.828791:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788639067.829374:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36914fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772965760:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788639067.829438:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639067.829495:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772965760 00000100:00100000:3.0:1788639067.829503:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772965760 00000100:00100000:3.0:1788639067.829546:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788639067.829551:0:6521:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1788639067.829556:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772965760:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788639067.829563:0:6521:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000004:00000024:3.0:1788639067.829589:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788639067.829673:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772965760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639067.829682:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788639067.829831:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36914fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772965760:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788639068.130506:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639068.130549:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639068.130581:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639068.130685:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754015232 00000100:00100000:2.0:1788639068.130695:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754015232 00000100:00100000:2.0:1788639068.130760:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754015488 00000100:00100000:2.0:1788639068.130764:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754015488 00000100:00100000:2.0:1788639068.130789:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 141 00000100:00100000:2.0:1788639068.130799:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2407:x1875523754015232:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639068.130881:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2407:x1875523754015232:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 83us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639068.130889:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 141 00000100:00100000:2.0:1788639068.130907:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 142 00000100:00100000:2.0:1788639068.130914:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2407:x1875523754015488:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639068.130939:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2407:x1875523754015488:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 26us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639068.130945:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 142 00000100:00080000:2.0:1788639068.130963:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788639068.131202:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639068.131232:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639068.131250:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639068.131270:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639068.131308:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754015104 00000100:00100000:2.0:1788639068.131312:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754015104 00000100:00100000:2.0:1788639068.131341:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 304 00000100:00100000:2.0:1788639068.131347:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+13:2407:x1875523754015104:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639068.131381:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+13:2407:x1875523754015104:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 33us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639068.131388:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 304 00000100:00100000:2.0:1788639068.131437:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754015360 00000100:00100000:2.0:1788639068.131442:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754015360 00000100:00100000:2.0:1788639068.131466:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754015616 00000100:00100000:2.0:1788639068.131469:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754015616 00000100:00100000:2.0:1788639068.131488:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 143 00000100:00100000:2.0:1788639068.131494:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2407:x1875523754015360:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639068.131524:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2407:x1875523754015360:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 30us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639068.131531:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 143 00000100:00100000:2.0:1788639068.131552:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 144 00000100:00100000:2.0:1788639068.131559:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3691a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2407:x1875523754015616:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639068.131586:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3691a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2407:x1875523754015616:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 27us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639068.131592:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 144 00000100:00080000:2.0:1788639068.131610:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788639068.133273:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754015744 00000100:00100000:0.0:1788639068.133285:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754015744 00000100:00100000:0.0:1788639068.133384:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754015872 00000100:00100000:0.0:1788639068.133388:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754015872 00000100:00100000:1.0:1788639068.133413:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 61 00000100:00100000:1.0:1788639068.133425:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2407:x1875523754015744:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:1.0:1788639068.133484:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2407:x1875523754015744:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 62us (2901us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639068.133492:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 61 00000100:00080000:3.0:1788639068.133564:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788639068.133568:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788639068.134037:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 62 00000100:00100000:0.0:1788639068.134045:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3691aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2407:x1875523754015872:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639068.134074:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3691aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2407:x1875523754015872:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 31us (2804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639068.134079:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 62 00010000:00010000:3.0:1788639068.598310:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639069.365735:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788639069.365841:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772965888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788639069.366677:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639069.367774:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772965888 00000100:00100000:2.0:1788639069.367786:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772965888 00000100:00100000:0.0:1788639069.367874:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772966016:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788639069.367877:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788639069.367894:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243198700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772965888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788639069.367935:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788639069.367949:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639069.368011:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243198700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772965888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (2007us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639069.368020:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788639069.368040:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772966016 00000100:00100000:2.0:1788639069.368044:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772966016 00000100:00100000:2.0:1788639069.368062:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788639069.368068:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772966016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788639069.368078:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788639069.368116:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772966016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639069.368123:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:2.0:1788639069.368174:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f68700 x1875523772965888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639085 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639069.368198:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772965888:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1788639069.368984:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f69180 x1875523772966016/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639085 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639069.369004:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772966016:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788639069.370414:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788639069.620882:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788639069.871584:0:12501:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788639069.872272:0:12501:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788639070.644832:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639071.668857:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788639071.836974:0:12598:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788639071.837183:0:12598:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788639071.925767:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875523772966528:0@lo:400:kworker.0 00000100:00100000:3.0:1788639071.925828:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639071.925881:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772967040:0@lo:400:kworker.0 00000100:00100000:3.0:1788639071.925916:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639071.925936:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772967552:0@lo:400:kworker.0 00000100:00100000:3.0:1788639071.925956:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639071.925957:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772966528 00000100:00100000:1.0:1788639071.925964:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772966528 00000100:00100000:3.0:1788639071.925989:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1788639071.925995:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3691ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772966144:0@lo:400:kworker.0 00000100:00100000:1.0:1788639071.926016:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788639071.926019:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639071.926024:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875523772966528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639071.926036:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772966656:0@lo:400:kworker.0 00000100:00100000:3.0:1788639071.926056:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639071.926067:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875523772966528:12345-0@lo:400:kworker.0 Request processed in 44us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639071.926075:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788639071.926463:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772967168:0@lo:400:kworker.0 00000100:00100000:3.0:1788639071.926489:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639071.926517:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772967680:0@lo:400:kworker.0 00000100:00100000:3.0:1788639071.926537:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639071.926553:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772967040 00000100:00100000:1.0:1788639071.926558:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772967040 00000100:00100000:3.0:1788639071.926568:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875523772966528:0@lo:400:kworker.0 00000100:00100000:1.0:1788639071.926585:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772967552 00000100:00100000:1.0:1788639071.926588:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772967552 00000100:00100000:3.0:1788639071.926591:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523772966272:0@lo:400:kworker.0 00000100:00100000:1.0:1788639071.926599:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772967168 00000100:00100000:1.0:1788639071.926601:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772967168 00000100:00100000:1.0:1788639071.926613:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772967680 00000100:00100000:3.0:1788639071.926636:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639071.926636:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772967680 00000100:00100000:1.0:1788639071.926652:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788639071.926654:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875523772966784:0@lo:400:kworker.0 00000100:00100000:1.0:1788639071.926658:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242083480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772967040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639071.926674:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639071.926690:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875523772967296:0@lo:400:kworker.0 00000100:00100000:1.0:1788639071.926703:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242083480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772967040:12345-0@lo:400:kworker.0 Request processed in 34us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639071.926710:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788639071.926722:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639071.926723:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788639071.926728:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242080700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772967552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639071.926739:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788639071.926745:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772966400:0@lo:400:kworker.0 00000100:00100000:1.0:1788639071.926753:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242080700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772967552:12345-0@lo:400:kworker.0 Request processed in 26us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639071.926759:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788639071.926763:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639071.926769:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788639071.926774:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242081f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772967168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639071.926778:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875523772966912:0@lo:400:kworker.0 00000100:00100000:3.0:1788639071.926794:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639071.926796:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242081f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772967168:12345-0@lo:400:kworker.0 Request processed in 23us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639071.926819:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875523772967424:0@lo:400:kworker.0 00000100:00100000:3.0:1788639071.926839:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639071.926870:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788639071.926877:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242083b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772967680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639071.926903:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242083b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772967680:12345-0@lo:400:kworker.0 Request processed in 28us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639071.926909:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788639071.926930:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772966144 00000100:00100000:1.0:1788639071.926933:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788639071.926934:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772966144 00000100:00100000:1.0:1788639071.926948:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772966272 00000100:00100000:1.0:1788639071.926951:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772966272 00000100:00100000:3.0:1788639071.926956:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1788639071.926961:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+24:3641:x1875523772966144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639071.926963:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772966784 00000100:00100000:1.0:1788639071.926965:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772966784 00000100:00100000:1.0:1788639071.926975:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772967296 00000100:00100000:1.0:1788639071.926977:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772967296 00000100:00100000:3.0:1788639071.926996:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+24:3641:x1875523772966144:12345-0@lo:400:kworker.0 Request processed in 35us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639071.927002:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1788639071.927027:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772966656 00000100:00100000:3.0:1788639071.927030:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772966656 00000100:00100000:3.0:1788639071.927049:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772966400 00000100:00100000:1.0:1788639071.927050:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772966912 00000100:00100000:3.0:1788639071.927052:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772966400 00000100:00100000:1.0:1788639071.927052:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772966912 00000100:00100000:1.0:1788639071.927063:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772967424 00000100:00100000:3.0:1788639071.927065:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788639071.927065:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772967424 00000100:00100000:1.0:1788639071.927077:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788639071.927082:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523772966272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639071.927118:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523772966272:12345-0@lo:400:kworker.0 Request processed in 36us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639071.927124:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788639071.927135:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788639071.927140:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36d1aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875523772966784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639071.927165:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36d1aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875523772966784:12345-0@lo:400:kworker.0 Request processed in 25us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639071.927170:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788639071.927180:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788639071.927185:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875523772967296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639071.927208:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875523772967296:12345-0@lo:400:kworker.0 Request processed in 23us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639071.927213:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788639071.927223:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788639071.927236:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875523772966912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639071.927263:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875523772966912:12345-0@lo:400:kworker.0 Request processed in 29us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639071.927269:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788639071.927280:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788639071.927285:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2416e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875523772967424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639071.927309:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2416e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875523772967424:12345-0@lo:400:kworker.0 Request processed in 24us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639071.927315:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00010000:00080000:1.0:1788639071.927344:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae36d1ab800 x1875523772966912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639071.927355:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875523772966912:0@lo:400:kworker.0 00010000:00080000:1.0:1788639071.927366:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f3b480 x1875523772967424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639071.927374:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875523772967424:0@lo:400:kworker.0 00000100:00100000:1.0:1788639071.927384:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523772966272:0@lo:400:kworker.0 00000100:00100000:1.0:1788639071.927393:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875523772966784:0@lo:400:kworker.0 00000100:00100000:3.0:1788639071.927398:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772966656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639071.927401:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875523772967296:0@lo:400:kworker.0 00000100:00100000:3.0:1788639071.927431:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772966656:12345-0@lo:400:kworker.0 Request processed in 360us (1374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639071.927437:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788639071.927449:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788639071.927455:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772966400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639071.927486:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772966400:12345-0@lo:400:kworker.0 Request processed in 31us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639071.927496:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:3.0:1788639071.927517:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788639071.927521:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788639071.927523:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788639071.927526:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788639071.927545:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772966400:0@lo:400:kworker.0 00000100:00100000:3.0:1788639071.927701:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3691ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772966144:0@lo:400:kworker.0 00000100:00100000:3.0:1788639071.927713:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772966656:0@lo:400:kworker.0 00010000:00080000:3.0:1788639071.927722:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f39500 x1875523772967168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639071.927732:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772967168:0@lo:400:kworker.0 00010000:00080000:3.0:1788639071.927741:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f38e00 x1875523772967680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639071.927748:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772967680:0@lo:400:kworker.0 00010000:00080000:3.0:1788639071.927757:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae36d1abb80 x1875523772967040/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639071.927763:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772967040:0@lo:400:kworker.0 00010000:00080000:3.0:1788639071.927772:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f39880 x1875523772967552/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639071.927779:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772967552:0@lo:400:kworker.0 00000100:00100000:2.0:1788639071.930368:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788639071.930387:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772967808:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788639071.930441:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639071.930478:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772967808 00000100:00100000:2.0:1788639071.930484:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772967808 00000100:00100000:2.0:1788639071.930518:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788639071.930525:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772967808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788639071.930549:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788639071.930581:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772967808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639071.930587:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:2.0:1788639071.930638:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2416e6d80 x1875523772967808/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639087 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639071.930655:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772967808:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788639072.436833:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788639072.436863:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772967936:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788639072.436934:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639072.437077:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772967936 00000100:00100000:3.0:1788639072.437093:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772967936 00000100:00100000:3.0:1788639072.437170:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788639072.437180:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772967936:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788639072.437254:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788639072.437347:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772967936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 168us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639072.437356:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788639072.437456:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772967936:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788639072.442422:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788639072.442458:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772968064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788639072.442557:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639072.442923:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772968064 00000100:00100000:2.0:1788639072.442933:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772968064 00000100:00100000:2.0:1788639072.443063:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788639072.443075:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772968064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788639072.443472:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788639072.443546:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772968064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 473us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639072.443554:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:0.0:1788639072.443720:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f69180 x1875523772968064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639088 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639072.443744:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772968064:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788639072.693041:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639072.949479:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788639072.949507:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36914fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772968192:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788639072.949587:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639072.949706:0:12414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772968192 00000100:00100000:1.0:1788639072.949715:0:12414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772968192 00000100:00100000:1.0:1788639072.949770:0:12414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788639072.949780:0:12414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36914ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772968192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788639072.949822:0:12414:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788639072.949868:0:12414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36914ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772968192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639072.949875:0:12414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788639072.949927:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36914fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772968192:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788639073.251264:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639073.251318:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639073.251340:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639073.251361:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639073.251380:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639073.251396:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639073.251418:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639073.251449:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754016256 00000100:00100000:0.0:1788639073.251462:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754016256 00000100:00100000:0.0:1788639073.251529:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754016512 00000100:00100000:0.0:1788639073.251532:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754016512 00000100:00100000:0.0:1788639073.251547:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754016128 00000100:00100000:0.0:1788639073.251550:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754016128 00000100:00100000:0.0:1788639073.251562:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754016384 00000100:00100000:0.0:1788639073.251565:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754016384 00000100:00100000:0.0:1788639073.251584:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 151 00000100:00100000:0.0:1788639073.251595:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2405:x1875523754016256:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639073.251764:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2405:x1875523754016256:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 159us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639073.251773:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 151 00000100:00100000:0.0:1788639073.251793:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 152 00000100:00100000:0.0:1788639073.251800:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2405:x1875523754016512:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639073.251825:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2405:x1875523754016512:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 26us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639073.251832:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 152 00000100:00100000:0.0:1788639073.251844:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 153 00000100:00100000:0.0:1788639073.251856:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2405:x1875523754016128:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639073.251880:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2405:x1875523754016128:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 31us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639073.251887:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 153 00000100:00100000:0.0:1788639073.251899:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 154 00000100:00100000:0.0:1788639073.251906:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2405:x1875523754016384:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639073.251930:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2405:x1875523754016384:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 25us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639073.251935:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 154 00000100:00100000:0.0:1788639073.251962:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754016768 00000100:00100000:0.0:1788639073.251966:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754016768 00000100:00100000:0.0:1788639073.252209:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754016640 00000100:00100000:0.0:1788639073.252214:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754016640 00000100:00100000:0.0:1788639073.252238:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 67 00000100:00100000:0.0:1788639073.252336:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2405:x1875523754016768:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639073.252378:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2405:x1875523754016768:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 133us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639073.252385:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 67 00000100:00100000:0.0:1788639073.252397:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 68 00000100:00100000:0.0:1788639073.252404:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2405:x1875523754016640:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639073.252427:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2405:x1875523754016640:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 24us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639073.252434:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 68 00000100:00080000:0.0:1788639073.252465:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788639073.252469:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788639073.252472:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788639073.252474:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788639073.252739:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754016000 00000100:00100000:3.0:1788639073.252746:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754016000 00000100:00100000:3.0:1788639073.252807:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 306 00000100:00100000:3.0:1788639073.252815:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+13:2405:x1875523754016000:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639073.252858:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+13:2405:x1875523754016000:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 44us (1620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639073.252865:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 306 00000020:00000004:0.0:1788639073.716528:0:12696:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788639073.717536:0:12696:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788639073.717878:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639074.485800:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788639074.485843:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36914fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772968448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788639074.485953:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639074.486034:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772968320:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788639074.486075:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639074.486119:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772968448 00000100:00100000:2.0:1788639074.486129:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772968448 00000100:00100000:2.0:1788639074.486189:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772968320 00000100:00100000:2.0:1788639074.486192:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772968320 00000100:00100000:2.0:1788639074.486212:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788639074.486228:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36e163450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772968448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788639074.486275:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788639074.486335:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36e163450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772968448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639074.486343:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788639074.486723:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788639074.486733:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772968320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788639074.486744:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788639074.486777:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772968320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639074.486784:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:2.0:1788639074.486807:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788639074.488536:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae36914fb80 x1875523772968448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639090 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639074.488572:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36914fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772968448:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1788639074.488588:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f6bb80 x1875523772968320/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639090 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639074.488603:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772968320:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788639074.743037:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639075.764924:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788639075.832365:0:12794:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788639075.833045:0:12794:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788639076.789825:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639077.046089:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788639077.046119:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772968576:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788639077.046211:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639077.046374:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772968576 00000100:00100000:2.0:1788639077.046384:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772968576 00000100:00100000:2.0:1788639077.046463:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788639077.046476:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2416e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772968576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788639077.046516:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788639077.046576:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2416e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772968576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639077.046600:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:2.0:1788639077.046690:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2416e5f80 x1875523772968576/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639093 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639077.046714:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772968576:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788639077.046793:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788639077.048412:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01f1eef9-e690-4065-bf99-bf821af7b626:3642:1875523772968704:0@lo:400:kworker.0 00000100:00100000:2.0:1788639077.048485:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639077.048542:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772969216:0@lo:400:kworker.0 00000100:00100000:2.0:1788639077.048573:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639077.048594:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375fb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772969728:0@lo:400:kworker.0 00000100:00100000:2.0:1788639077.048641:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639077.048677:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788639077.048684:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523772969088:0@lo:400:kworker.0 00000100:00100000:2.0:1788639077.048714:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639077.048734:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375fb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772969600:0@lo:400:kworker.0 00000100:00100000:2.0:1788639077.048756:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639077.048774:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375fb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772970112:0@lo:400:kworker.0 00000100:00100000:2.0:1788639077.048796:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639077.048829:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772969216 00000100:00100000:2.0:1788639077.048836:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772969216 00000100:00100000:2.0:1788639077.048885:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788639077.048895:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772969216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639077.048950:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772969216:12345-0@lo:400:kworker.0 Request processed in 57us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639077.048957:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788639077.048994:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772969728 00000100:00100000:2.0:1788639077.048998:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772969728 00000100:00100000:2.0:1788639077.049033:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772969600 00000100:00100000:2.0:1788639077.049037:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772969600 00000100:00100000:2.0:1788639077.049048:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772970112 00000100:00100000:2.0:1788639077.049050:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772970112 00000100:00100000:2.0:1788639077.049066:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788639077.049072:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772969728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639077.049104:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772969728:12345-0@lo:400:kworker.0 Request processed in 31us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639077.049109:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788639077.049121:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788639077.049126:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772969600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639077.049152:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772969600:12345-0@lo:400:kworker.0 Request processed in 26us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639077.049158:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788639077.049169:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788639077.049175:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772970112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639077.049200:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772970112:12345-0@lo:400:kworker.0 Request processed in 25us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639077.049206:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788639077.049224:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772969088 00000100:00100000:2.0:1788639077.049227:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772969088 00000100:00100000:2.0:1788639077.049254:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788639077.049260:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523772969088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639077.049289:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523772969088:12345-0@lo:400:kworker.0 Request processed in 30us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639077.049304:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:2.0:1788639077.049333:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788639077.049337:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788639077.049374:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523772969088:0@lo:400:kworker.0 00010000:00080000:2.0:1788639077.049388:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375fb3100 x1875523772969600/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639077.049400:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375fb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772969600:0@lo:400:kworker.0 00010000:00080000:2.0:1788639077.049409:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375fb2680 x1875523772970112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639077.049417:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375fb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772970112:0@lo:400:kworker.0 00000100:00100000:2.0:1788639077.049426:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772969216:0@lo:400:kworker.0 00010000:00080000:2.0:1788639077.049434:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375fb3b80 x1875523772969728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639077.049441:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375fb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772969728:0@lo:400:kworker.0 00000100:00100000:1.0:1788639077.051497:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523772968832:0@lo:400:kworker.0 00000100:00100000:1.0:1788639077.051601:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639077.051684:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875523772969344:0@lo:400:kworker.0 00000100:00100000:1.0:1788639077.051710:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639077.051728:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375fb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875523772969856:0@lo:400:kworker.0 00000100:00100000:1.0:1788639077.051751:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639077.051779:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788639077.051787:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772968960:0@lo:400:kworker.0 00000100:00100000:1.0:1788639077.051815:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639077.051835:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375fb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875523772969472:0@lo:400:kworker.0 00000100:00100000:1.0:1788639077.051870:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639077.051889:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375fb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875523772969984:0@lo:400:kworker.0 00000100:00100000:1.0:1788639077.051912:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639077.051951:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772968960 00000100:00100000:1.0:1788639077.051960:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772968960 00000100:00100000:1.0:1788639077.052029:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788639077.052038:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36914e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772968960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639077.052100:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36914e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772968960:12345-0@lo:400:kworker.0 Request processed in 62us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639077.052108:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788639077.052156:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772968960:0@lo:400:kworker.0 00000100:00100000:0.0:1788639077.052392:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772968704 00000100:00100000:0.0:1788639077.052398:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772968704 00000100:00100000:0.0:1788639077.052441:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788639077.052449:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+24:3642:x1875523772968704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639077.052489:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+24:3642:x1875523772968704:12345-0@lo:400:kworker.0 Request processed in 41us (4004us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639077.052495:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788639077.052542:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772968832 00000100:00100000:0.0:1788639077.052547:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772968832 00000100:00100000:0.0:1788639077.052565:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772969344 00000100:00100000:0.0:1788639077.052567:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772969344 00000100:00100000:0.0:1788639077.052588:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772969856 00000100:00100000:0.0:1788639077.052599:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772969856 00000100:00100000:0.0:1788639077.052637:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772969472 00000100:00100000:0.0:1788639077.052640:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772969472 00000100:00100000:0.0:1788639077.052674:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772969984 00000100:00100000:0.0:1788639077.052677:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772969984 00000100:00100000:0.0:1788639077.052693:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788639077.052700:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36914c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523772968832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639077.052738:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36914c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523772968832:12345-0@lo:400:kworker.0 Request processed in 39us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639077.052750:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788639077.052761:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788639077.052767:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36914d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875523772969344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639077.052794:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36914d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875523772969344:12345-0@lo:400:kworker.0 Request processed in 27us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639077.052799:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788639077.052810:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788639077.052814:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36914f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875523772969856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639077.052837:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36914f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875523772969856:12345-0@lo:400:kworker.0 Request processed in 22us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639077.052842:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788639077.052850:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788639077.052856:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36914dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875523772969472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639077.052881:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36914dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875523772969472:12345-0@lo:400:kworker.0 Request processed in 26us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639077.052887:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788639077.052896:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788639077.052901:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36914fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875523772969984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639077.052931:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36914fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875523772969984:12345-0@lo:400:kworker.0 Request processed in 30us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639077.052937:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00010000:00080000:0.0:1788639077.052971:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375fb3480 x1875523772969472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639077.052983:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375fb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875523772969472:0@lo:400:kworker.0 00010000:00080000:0.0:1788639077.052995:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375fb0000 x1875523772969984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639077.053008:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375fb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875523772969984:0@lo:400:kworker.0 00000100:00100000:0.0:1788639077.053018:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523772968832:0@lo:400:kworker.0 00000100:00100000:0.0:1788639077.053027:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875523772969344:0@lo:400:kworker.0 00000100:00100000:0.0:1788639077.053036:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375fb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875523772969856:0@lo:400:kworker.0 00000100:00080000:2.0:1788639077.053060:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788639077.053065:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788639077.053094:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01f1eef9-e690-4065-bf99-bf821af7b626:3642:1875523772968704:0@lo:400:kworker.0 00000100:00100000:0.0:1788639077.558907:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788639077.558933:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375fb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772970240:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788639077.559030:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639077.559120:0:12414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772970240 00000100:00100000:0.0:1788639077.559129:0:12414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772970240 00000100:00100000:0.0:1788639077.559209:0:12414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788639077.559219:0:12414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772970240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788639077.559264:0:12414:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788639077.559314:0:12414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772970240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639077.559322:0:12414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788639077.559392:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375fb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772970240:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788639077.559862:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788639077.559874:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772970368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788639077.559912:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639077.559984:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772970368 00000100:00100000:3.0:1788639077.559990:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772970368 00000100:00100000:3.0:1788639077.560041:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788639077.560048:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36914d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772970368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788639077.560065:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788639077.560108:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36914d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772970368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639077.560113:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:3.0:1788639077.560155:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2416e6680 x1875523772970368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639093 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639077.560177:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772970368:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788639077.814541:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788639077.860377:0:12891:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788639077.860938:0:12891:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788639078.080953:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772970496:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788639078.081046:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639078.081158:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772970496 00000100:00100000:3.0:1788639078.081167:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772970496 00000100:00100000:3.0:1788639078.081223:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788639078.081234:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2416e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772970496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788639078.081277:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788639078.081329:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2416e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772970496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639078.081337:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788639078.081392:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772970496:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788639078.367974:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639078.368028:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639078.368060:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639078.368086:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639078.368113:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639078.368177:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754016896 00000100:00100000:3.0:1788639078.368189:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754016896 00000100:00100000:3.0:1788639078.368249:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 308 00000100:00100000:3.0:1788639078.368261:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+13:2405:x1875523754016896:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639078.368343:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+13:2405:x1875523754016896:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 84us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639078.368351:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 308 00000100:00100000:3.0:1788639078.368388:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754017024 00000100:00100000:3.0:1788639078.368392:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754017024 00000100:00100000:3.0:1788639078.368430:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754017280 00000100:00100000:3.0:1788639078.368433:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754017280 00000100:00100000:3.0:1788639078.368447:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754017152 00000100:00100000:3.0:1788639078.368449:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754017152 00000100:00100000:3.0:1788639078.368460:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754017408 00000100:00100000:3.0:1788639078.368463:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754017408 00000100:00100000:3.0:1788639078.368477:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 161 00000100:00100000:3.0:1788639078.368483:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2416e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2405:x1875523754017024:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639078.368527:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2416e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2405:x1875523754017024:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 43us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639078.368534:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 161 00000100:00100000:3.0:1788639078.368547:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 162 00000100:00100000:3.0:1788639078.368553:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2416e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2405:x1875523754017280:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639078.368578:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2416e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2405:x1875523754017280:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 25us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639078.368584:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 162 00000100:00100000:3.0:1788639078.368595:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 163 00000100:00100000:3.0:1788639078.368601:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2416e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2405:x1875523754017152:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639078.368667:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2416e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2405:x1875523754017152:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 56us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639078.368674:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 163 00000100:00100000:3.0:1788639078.368686:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 164 00000100:00100000:3.0:1788639078.368692:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2416e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2405:x1875523754017408:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639078.368713:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2416e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2405:x1875523754017408:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 22us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639078.368718:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 164 00000100:00080000:3.0:1788639078.368866:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788639078.368871:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788639078.372158:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639078.372213:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639078.372282:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754017536 00000100:00100000:1.0:1788639078.372294:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754017536 00000100:00100000:1.0:1788639078.372365:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754017664 00000100:00100000:1.0:1788639078.372368:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754017664 00000100:00100000:1.0:1788639078.372393:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 22 00000100:00100000:1.0:1788639078.372403:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2404:x1875523754017536:12345-192.168.206.18@tcp:9:kworker.0 00000020:00000080:1.0:1788639078.372440:0:8430:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262c268 00000100:00080000:1.0:1788639078.372452:0:8430:0:(import.c:65:import_set_state_nolock()) ffff9ae375c2e000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788639078.372520:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788639078.372769:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+2:2404:x1875523754017536:12345-192.168.206.18@tcp:9:kworker.0 Request processed in 358us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639078.372777:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 22 00000100:00100000:1.0:1788639078.372795:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 23 00000100:00100000:1.0:1788639078.372801:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2404:x1875523754017664:12345-192.168.206.18@tcp:9:kworker.0 00000020:00000080:1.0:1788639078.372813:0:8430:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262c26f 00000100:00080000:1.0:1788639078.372819:0:8430:0:(import.c:65:import_set_state_nolock()) ffff9ae2416e8800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788639078.372859:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788639078.372928:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+2:2404:x1875523754017664:12345-192.168.206.18@tcp:9:kworker.0 Request processed in 127us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639078.372936:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 23 00010000:00010000:1.0:1788639078.372954:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639078.373118:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788639078.373467:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788639078.373473:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788639078.836929:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639079.605900:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788639079.605921:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36914ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772970624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788639079.605983:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639079.606045:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772970624 00000100:00100000:1.0:1788639079.606052:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772970624 00000100:00100000:1.0:1788639079.606147:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788639079.606155:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36914c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772970624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788639079.606181:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788639079.606224:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36914c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772970624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639079.606231:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:1.0:1788639079.606272:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae36914ed80 x1875523772970624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639095 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639079.606290:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36914ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772970624:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788639079.606373:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788639079.609323:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772970752:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788639079.609384:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639079.613324:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772970752 00000100:00100000:3.0:1788639079.613338:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772970752 00000100:00100000:3.0:1788639079.613414:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788639079.613425:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36914ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772970752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788639079.613448:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788639079.613639:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788639079.618135:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36914ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772970752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4707us (8745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639079.618149:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:1.0:1788639079.619780:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f69180 x1875523772970752/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639095 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639079.619806:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772970752:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788639079.862660:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639080.888669:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639081.909800:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788639082.037014:0:13036:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1788639082.172514:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788639082.172651:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772970880:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788639082.172811:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639082.172890:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772970880 00000100:00100000:2.0:1788639082.172901:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772970880 00000100:00100000:2.0:1788639082.172965:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788639082.172977:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772970880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788639082.173014:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788639082.173064:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772970880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639082.173072:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1788639082.173097:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788639082.173133:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f69180 x1875523772970880/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639098 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639082.173157:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772970880:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788639082.173249:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01f1eef9-e690-4065-bf99-bf821af7b626:3644:1875523772971008:0@lo:400:kworker.0 00000100:00100000:1.0:1788639082.173301:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639082.173341:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875523772971136:0@lo:400:kworker.0 00000100:00100000:1.0:1788639082.173345:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772971520:0@lo:400:kworker.0 00000100:00100000:2.0:1788639082.173381:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639082.173394:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639082.173408:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875523772971648:0@lo:400:kworker.0 00000100:00100000:1.0:1788639082.173425:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772972032:0@lo:400:kworker.0 00000100:00100000:2.0:1788639082.173438:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639082.173463:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875523772972160:0@lo:400:kworker.0 00000100:00100000:1.0:1788639082.173467:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639082.173502:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788639082.173506:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639082.173517:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875523772971392:0@lo:400:kworker.0 00000100:00100000:2.0:1788639082.173543:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788639082.173556:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772971264:0@lo:400:kworker.0 00000100:00100000:1.0:1788639082.173562:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639082.173591:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772971904:0@lo:400:kworker.0 00000100:00100000:2.0:1788639082.173599:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639082.173968:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875523772971776:0@lo:400:kworker.0 00000100:00100000:1.0:1788639082.173972:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639082.173999:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772972416:0@lo:400:kworker.0 00000100:00100000:2.0:1788639082.174009:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639082.174031:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639082.174040:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875523772972288:0@lo:400:kworker.0 00000100:00100000:2.0:1788639082.174073:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639082.174078:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772971008 00000100:00100000:1.0:1788639082.174085:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772971008 00000100:00100000:2.0:1788639082.174101:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772971136 00000100:00100000:2.0:1788639082.174107:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772971136 00000100:00100000:1.0:1788639082.174133:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1788639082.174137:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772971648 00000100:00100000:2.0:1788639082.174142:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772971648 00000100:00100000:1.0:1788639082.174146:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+24:3644:x1875523772971008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639082.174171:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772972160 00000100:00100000:2.0:1788639082.174176:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772972160 00000100:00100000:2.0:1788639082.174195:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772971392 00000100:00100000:2.0:1788639082.174199:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772971392 00000100:00100000:1.0:1788639082.174201:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+24:3644:x1875523772971008:12345-0@lo:400:kworker.0 Request processed in 56us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639082.174211:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1788639082.174212:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772971776 00000100:00100000:2.0:1788639082.174216:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772971776 00000100:00100000:2.0:1788639082.174231:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772972288 00000100:00100000:2.0:1788639082.174234:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772972288 00000100:00100000:1.0:1788639082.174251:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772971520 00000100:00100000:2.0:1788639082.174256:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788639082.174257:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772971520 00000100:00100000:2.0:1788639082.174265:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875523772971136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639082.174292:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772971264 00000100:00100000:1.0:1788639082.174297:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772971264 00000100:00100000:2.0:1788639082.174316:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875523772971136:12345-0@lo:400:kworker.0 Request processed in 52us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639082.174318:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788639082.174327:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788639082.174338:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772971520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639082.174348:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788639082.174356:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875523772971648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639082.174383:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772971520:12345-0@lo:400:kworker.0 Request processed in 48us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639082.174392:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788639082.174395:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875523772971648:12345-0@lo:400:kworker.0 Request processed in 39us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639082.174403:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788639082.174414:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788639082.174421:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788639082.174426:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772971264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639082.174432:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875523772972160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639082.174477:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772971264:12345-0@lo:400:kworker.0 Request processed in 53us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639082.174478:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875523772972160:12345-0@lo:400:kworker.0 Request processed in 46us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639082.174490:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788639082.174495:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788639082.174511:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788639082.174516:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875523772971392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639082.174541:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875523772971392:12345-0@lo:400:kworker.0 Request processed in 24us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639082.174546:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788639082.174554:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788639082.174559:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875523772971776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639082.174580:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875523772971776:12345-0@lo:400:kworker.0 Request processed in 21us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639082.174585:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788639082.174595:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788639082.174601:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875523772972288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639082.174664:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875523772972288:12345-0@lo:400:kworker.0 Request processed in 62us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639082.174670:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788639082.174869:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772972032 00000100:00100000:2.0:1788639082.174874:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772972032 00000100:00100000:2.0:1788639082.174905:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772971904 00000100:00100000:2.0:1788639082.174908:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772971904 00000100:00100000:2.0:1788639082.174918:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772972416 00000100:00100000:2.0:1788639082.174921:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772972416 00000100:00100000:2.0:1788639082.174933:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788639082.174939:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772972032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639082.174970:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772972032:12345-0@lo:400:kworker.0 Request processed in 32us (1507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639082.174985:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788639082.174996:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788639082.175001:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772971904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639082.175025:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772971904:12345-0@lo:400:kworker.0 Request processed in 24us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639082.175030:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788639082.175038:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788639082.175043:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772972416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639082.175066:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772972416:12345-0@lo:400:kworker.0 Request processed in 22us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639082.175071:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1788639082.175085:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788639082.175090:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788639082.175092:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788639082.175095:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788639082.175126:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772971264:0@lo:400:kworker.0 00010000:00080000:2.0:1788639082.175141:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2432c6d80 x1875523772971776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639082.175151:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875523772971776:0@lo:400:kworker.0 00010000:00080000:2.0:1788639082.175162:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae24233c700 x1875523772972288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639082.175171:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875523772972288:0@lo:400:kworker.0 00000100:00100000:2.0:1788639082.175183:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875523772971136:0@lo:400:kworker.0 00000100:00100000:2.0:1788639082.175195:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875523772971648:0@lo:400:kworker.0 00000100:00100000:2.0:1788639082.175213:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875523772972160:0@lo:400:kworker.0 00000100:00100000:1.0:1788639082.175231:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875523772971392:0@lo:400:kworker.0 00010000:00080000:1.0:1788639082.175248:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2432c7b80 x1875523772971904/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639082.175259:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772971904:0@lo:400:kworker.0 00010000:00080000:1.0:1788639082.175273:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae24233ca80 x1875523772972416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639082.175280:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772972416:0@lo:400:kworker.0 00000100:00100000:1.0:1788639082.175291:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772971520:0@lo:400:kworker.0 00010000:00080000:1.0:1788639082.175301:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2432c5180 x1875523772972032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639082.175309:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772972032:0@lo:400:kworker.0 00000100:00100000:1.0:1788639082.175319:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01f1eef9-e690-4065-bf99-bf821af7b626:3644:1875523772971008:0@lo:400:kworker.0 00000100:00100000:0.0:1788639082.676767:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788639082.676790:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375fb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772972544:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788639082.676867:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639082.676932:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772972544 00000100:00100000:1.0:1788639082.676949:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772972544 00000100:00100000:1.0:1788639082.677015:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788639082.677026:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772972544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788639082.677065:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788639082.677115:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772972544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639082.677122:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788639082.677263:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375fb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772972544:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788639082.678740:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788639082.678754:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375fb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772972672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788639082.678809:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639082.678842:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772972672 00000100:00100000:0.0:1788639082.678848:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772972672 00000100:00100000:0.0:1788639082.678883:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788639082.678889:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772972672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788639082.678905:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788639082.678943:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772972672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639082.678949:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:0.0:1788639082.678986:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375fb0e00 x1875523772972672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639098 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639082.679003:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375fb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772972672:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788639082.933264:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639083.192851:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772972800:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788639083.192954:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639083.194014:0:12414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772972800 00000100:00100000:2.0:1788639083.194028:0:12414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772972800 00000100:00100000:2.0:1788639083.194109:0:12414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788639083.194121:0:12414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2416e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772972800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788639083.194178:0:12414:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788639083.194511:0:12414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2416e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772972800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 392us (1556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639083.194520:0:12414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788639083.196264:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772972800:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788639083.492114:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639083.492162:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639083.492277:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754018048 00000100:00100000:3.0:1788639083.492291:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754018048 00000100:00100000:3.0:1788639083.492374:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 171 00000100:00100000:3.0:1788639083.492408:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2407:x1875523754018048:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639083.492509:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2407:x1875523754018048:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 105us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639083.492519:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 171 00000100:00080000:3.0:1788639083.492551:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788639083.492903:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639083.492945:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639083.492983:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639083.493005:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754018304 00000100:00100000:1.0:1788639083.493010:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754018304 00000100:00100000:1.0:1788639083.493045:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754017920 00000100:00100000:1.0:1788639083.493048:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754017920 00000100:00100000:1.0:1788639083.493065:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754018176 00000100:00100000:1.0:1788639083.493067:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754018176 00000100:00100000:1.0:1788639083.493081:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 172 00000100:00100000:1.0:1788639083.493088:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2407:x1875523754018304:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:1.0:1788639083.493130:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2407:x1875523754018304:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 41us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639083.493137:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 172 00000100:00100000:1.0:1788639083.493151:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 173 00000100:00100000:1.0:1788639083.493157:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36d1a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2408:x1875523754017920:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639083.493800:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754017792 00000100:00100000:2.0:1788639083.493807:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754017792 00000100:00100000:2.0:1788639083.493853:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 310 00000100:00100000:2.0:1788639083.493861:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+13:2407:x1875523754017792:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639083.493902:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+13:2407:x1875523754017792:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 43us (1804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639083.493909:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 310 00000100:00100000:1.0:1788639083.494105:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36d1a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2408:x1875523754017920:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 25us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639083.494131:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 173 00000100:00100000:1.0:1788639083.494152:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 174 00000100:00100000:1.0:1788639083.494162:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36d1a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2408:x1875523754018176:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:1.0:1788639083.496398:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36d1a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2408:x1875523754018176:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 2218us (3394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639083.496417:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 174 00000100:00080000:1.0:1788639083.503025:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788639083.503036:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788639083.957772:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788639084.215758:0:9509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aeb8e47b-1fde-42ab-834f-69a8d71ffb89 00000020:00000080:2.0:1788639084.215766:0:9509:0:(genops.c:885:class_export_put()) final put ffff9ae2416ef000/aeb8e47b-1fde-42ab-834f-69a8d71ffb89 00000020:00000080:3.0:1788639084.215826:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae2416ef000/aeb8e47b-1fde-42ab-834f-69a8d71ffb89 for lustre-OST0001 00000020:00000080:3.0:1788639084.215881:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae2416e8800 for lustre-OST0001 00000001:00100000:3.0:1788639084.216064:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aeb8e47b-1fde-42ab-834f-69a8d71ffb89 00000020:00000080:3.0:1788639084.216068:0:8425:0:(genops.c:885:class_export_put()) final put ffff9ae375c28000/aeb8e47b-1fde-42ab-834f-69a8d71ffb89 00000020:00000080:0.0:1788639084.216194:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae375c28000/aeb8e47b-1fde-42ab-834f-69a8d71ffb89 for lustre-OST0000 00000020:00000080:0.0:1788639084.216298:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae375c2e000 for lustre-OST0000 00000100:00100000:1.0:1788639084.728361:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772972928:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788639084.728435:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639084.728522:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772972928 00000100:00100000:1.0:1788639084.728530:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772972928 00000100:00100000:1.0:1788639084.728584:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788639084.728594:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36d1a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772972928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788639084.728655:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788639084.728701:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36d1a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772972928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639084.728709:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1788639084.728730:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788639084.728762:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae242081880 x1875523772972928/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639100 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639084.728781:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772972928:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788639084.737492:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772973056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788639084.737559:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639084.737697:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772973056 00000100:00100000:1.0:1788639084.737705:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772973056 00000100:00100000:1.0:1788639084.737765:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788639084.737785:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242081180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772973056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788639084.737806:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788639084.737856:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242081180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772973056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639084.737863:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:1.0:1788639084.737904:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae36d1a9f80 x1875523772973056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639100 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639084.737922:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772973056:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788639084.737971:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788639084.980873:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788639085.649994:0:13184:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe120e4710 20000000:00000080:3.0:1788639085.650012:0:13184:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ae2430fe400 uarg=0000000000000000 20000000:01000000:3.0:1788639085.650059:0:13184:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788639085.650065:0:13184:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788639085.650069:0:13184:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788639085.651040:0:13185:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1788639085.651255:0:13184:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788639085.669327:0:13184:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788639085.669358:0:13184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ae38217ba00/0x25c454990262c276 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639085.669378:0:13184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae340030e00/0x25c454990262c206 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e853ba expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639085.669388:0:13184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae242f23c00/0x25c454990262c214 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c20d expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639085.669395:0:13184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae3750faa00/0x25c454990262c222 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c21b expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639085.669402:0:13184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae3429e5800/0x25c454990262c230 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c229 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639085.669423:0:13184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae38217a400/0x25c454990262c23e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c237 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639085.669431:0:13184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae242f23400/0x25c454990262c253 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e853f9 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639085.669439:0:13184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ae38217ba00/0x25c454990262c276 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639085.669493:0:13184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae242f23400/0x25c454990262c253 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e853f9 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639085.669508:0:13184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae242f23400/0x25c454990262c253 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e853f9 expref: 12 pid: 6510 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639085.669523:0:13184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1875523772973184:192.168.206.18@tcp:104: 00010000:00010000:3.0:1788639085.669670:0:13184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae38217a400/0x25c454990262c23e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262c237 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639085.669680:0:13184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ae38217a400/0x25c454990262c23e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262c237 expref: 23 pid: 6508 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639085.669690:0:13184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1875523772973312:0@lo:104: 00000100:00100000:3.0:1788639085.669727:0:13184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788639085.669758:0:13184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae3429e5800/0x25c454990262c230 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262c229 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639085.669767:0:13184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ae3429e5800/0x25c454990262c230 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262c229 expref: 23 pid: 6508 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639085.669783:0:13184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1875523772973440:0@lo:104: 00000100:00100000:3.0:1788639085.669805:0:13184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639085.671537:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772973312 00000100:00100000:1.0:1788639085.671545:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772973312 00000100:00100000:1.0:1788639085.671582:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772973440 00000100:00100000:1.0:1788639085.671585:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772973440 00000100:00100000:1.0:1788639085.671600:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788639085.671609:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2416e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+4:13184:x1875523772973312:12345-0@lo:104: 00010000:00010000:1.0:1788639085.673182:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4600/0x25c454990262c237 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262c23e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639085.673274:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788639085.673283:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2416e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+4:13184:x1875523772973312:12345-0@lo:104: Request processed in 1673us (3553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639085.673292:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788639085.673321:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788639085.673330:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3691ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+3:13184:x1875523772973440:12345-0@lo:104: 00010000:00010000:1.0:1788639085.673339:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae242f23e00/0x25c454990262c229 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262c230 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639085.673389:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788639085.673395:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3691ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+3:13184:x1875523772973440:12345-0@lo:104: Request processed in 67us (3589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639085.673401:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:1.0:1788639085.673419:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788639085.673425:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4600/0x25c454990262c237 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262c23e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639085.673432:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3429e4600 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:1.0:1788639085.673436:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4600/0x25c454990262c237 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262c23e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639085.673444:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4600/0x25c454990262c237 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262c23e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788639085.673452:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4600/0x25c454990262c237 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262c23e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788639085.673457:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788639085.673497:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4600/0x25c454990262c237 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c23e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639085.673504:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788639085.673522:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4600/0x25c454990262c237 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c23e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639085.673529:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4600/0x25c454990262c237 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c23e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639085.673551:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788639085.673554:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae242f23e00/0x25c454990262c229 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262c230 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639085.673560:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f23e00 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:1.0:1788639085.673563:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae242f23e00/0x25c454990262c229 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262c230 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639085.673570:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae242f23e00/0x25c454990262c229 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262c230 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788639085.673576:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae242f23e00/0x25c454990262c229 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262c230 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788639085.673581:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788639085.673593:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae242f23e00/0x25c454990262c229 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c230 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639085.673598:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788639085.673604:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae242f23e00/0x25c454990262c229 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c230 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639085.673611:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae242f23e00/0x25c454990262c229 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c230 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639085.674880:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639085.674883:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639085.674885:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639085.675195:0:13184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae3750faa00/0x25c454990262c222 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262c21b expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639085.675209:0:13184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ae3750faa00/0x25c454990262c222 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262c21b expref: 23 pid: 6508 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639085.675221:0:13184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432ce300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1875523772973824:0@lo:104: 00000100:00100000:3.0:1788639085.675286:0:13184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788639085.675330:0:13184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae242f23c00/0x25c454990262c214 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262c20d expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639085.675339:0:13184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ae242f23c00/0x25c454990262c214 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262c20d expref: 23 pid: 6510 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639085.675348:0:13184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1875523772973952:0@lo:104: 00000100:00100000:3.0:1788639085.675367:0:13184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639085.675389:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772973824 00000100:00100000:3.0:1788639085.675395:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772973824 00000100:00100000:3.0:1788639085.675427:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772973952 00000100:00100000:3.0:1788639085.675430:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772973952 00000100:00100000:3.0:1788639085.675440:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788639085.675448:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:01f1eef9-e690-4065-bf99-bf821af7b626+4:13184:x1875523772973824:12345-0@lo:104: 00010000:00010000:3.0:1788639085.675460:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae242f22400/0x25c454990262c21b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262c222 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639085.675498:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788639085.675509:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:01f1eef9-e690-4065-bf99-bf821af7b626+4:13184:x1875523772973824:12345-0@lo:104: Request processed in 62us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639085.675516:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788639085.675531:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788639085.675537:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:01f1eef9-e690-4065-bf99-bf821af7b626+3:13184:x1875523772973952:12345-0@lo:104: 00010000:00010000:3.0:1788639085.675544:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4800/0x25c454990262c20d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262c214 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639085.675576:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788639085.675581:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:01f1eef9-e690-4065-bf99-bf821af7b626+3:13184:x1875523772973952:12345-0@lo:104: Request processed in 45us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639085.675587:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:3.0:1788639085.675601:0:9519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788639085.675606:0:9519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae242f22400/0x25c454990262c21b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262c222 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639085.676555:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772973568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788639085.676646:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639085.676679:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788639085.676688:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772973696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788639085.676708:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639085.676746:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772973568 00000100:00100000:1.0:1788639085.676752:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772973568 00010000:00010000:1.0:1788639085.676780:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae38217a400/0x25c454990262c23e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262c237 expref: 24 pid: 6508 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639085.676804:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772973696 00000100:00100000:1.0:1788639085.676807:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772973696 00010000:00010000:1.0:1788639085.676817:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae3429e5800/0x25c454990262c230 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262c229 expref: 25 pid: 6508 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639085.676831:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788639085.676838:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36d1aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+25:3641:x1875523772973568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788639085.676851:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788639085.676857:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae38217a400/0x25c454990262c23e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262c237 expref: 25 pid: 6508 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639085.676867:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae38217a400/0x25c454990262c23e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262c237 expref: 25 pid: 6508 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639085.676886:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788639085.676935:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36d1aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+25:3641:x1875523772973568:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639085.676942:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788639085.676956:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788639085.676962:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36d1a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+24:3641:x1875523772973696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788639085.676976:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788639085.676980:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae3429e5800/0x25c454990262c230 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262c229 expref: 24 pid: 6508 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639085.676988:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae3429e5800/0x25c454990262c230 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262c229 expref: 24 pid: 6508 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639085.676997:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788639085.677018:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36d1a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+24:3641:x1875523772973696:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639085.677024:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788639085.677067:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772973696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788639085.677076:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772973568:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788639085.677139:0:9520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788639085.677146:0:9520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4800/0x25c454990262c20d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262c214 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639085.677153:0:9520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3429e4800 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:1.0:1788639085.677157:0:9520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4800/0x25c454990262c20d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262c214 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639085.677166:0:9520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4800/0x25c454990262c20d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262c214 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788639085.677173:0:9520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4800/0x25c454990262c20d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262c214 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788639085.677178:0:9520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788639085.677211:0:9520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4800/0x25c454990262c20d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c214 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639085.677218:0:9520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788639085.677237:0:9520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4800/0x25c454990262c20d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c214 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639085.677244:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4800/0x25c454990262c20d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c214 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639085.677257:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639085.677258:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639085.677260:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639085.677270:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523772974080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788639085.677293:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788639085.677902:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639085.678267:0:9519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f22400 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:3.0:1788639085.678274:0:9519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae242f22400/0x25c454990262c21b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262c222 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639085.678285:0:9519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae242f22400/0x25c454990262c21b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262c222 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788639085.678292:0:9519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae242f22400/0x25c454990262c21b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262c222 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639085.678769:0:9519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788639085.678948:0:9519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae242f22400/0x25c454990262c21b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c222 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639085.678969:0:9519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788639085.678993:0:9519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae242f22400/0x25c454990262c21b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c222 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639085.679000:0:9519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae242f22400/0x25c454990262c21b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c222 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639085.679016:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639085.679018:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639085.679020:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639085.679049:0:13184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae340030e00/0x25c454990262c206 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e853ba expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639085.679061:0:13184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae340030e00/0x25c454990262c206 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e853ba expref: 12 pid: 6508 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639085.679078:0:13184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1875523772974336:192.168.206.18@tcp:104: 00000100:00100000:3.0:1788639085.679145:0:13184:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae37b589b40 going to sleep for 11 seconds 00010000:00010000:3.0:1788639085.679168:0:13184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae38217a400/0x25c454990262c23e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262c237 expref: 23 pid: 6508 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639085.679179:0:13184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1875523772973312:0@lo:104: 00010000:00010000:3.0:1788639085.679191:0:13184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae3429e5800/0x25c454990262c230 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262c229 expref: 22 pid: 6508 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639085.679200:0:13184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1875523772973440:0@lo:104: 00000100:00100000:3.0:1788639085.679208:0:13184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432ce300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1875523772973824:0@lo:104: 00000100:00100000:3.0:1788639085.679215:0:13184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1875523772973952:0@lo:104: 00000100:00100000:2.0:1788639085.679282:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772974080 00000100:00100000:2.0:1788639085.679288:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772974080 00010000:00010000:2.0:1788639085.679328:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae242f23c00/0x25c454990262c214 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262c20d expref: 22 pid: 6510 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639085.679367:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788639085.679375:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36d1abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+22:3643:x1875523772974080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788639085.679388:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788639085.679395:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae242f23c00/0x25c454990262c214 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262c20d expref: 22 pid: 6510 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639085.679404:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae242f23c00/0x25c454990262c214 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262c20d expref: 22 pid: 6510 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639085.679416:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae242f23c00/0x25c454990262c214 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262c20d expref: 22 pid: 6510 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639085.679426:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788639085.679462:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36d1abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+21:3643:x1875523772974080:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (2167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639085.679480:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788639085.680009:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01f1eef9-e690-4065-bf99-bf821af7b626:3644:1875523772974208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788639085.680042:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639085.680199:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523772974080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788639085.681227:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772974208 00000100:00100000:2.0:1788639085.681236:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772974208 00010000:00010000:2.0:1788639085.681267:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae3750faa00/0x25c454990262c222 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262c21b expref: 21 pid: 6508 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639085.681316:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788639085.681325:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36d1ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01f1eef9-e690-4065-bf99-bf821af7b626+21:3644:x1875523772974208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788639085.681337:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788639085.681342:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae3750faa00/0x25c454990262c222 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262c21b expref: 21 pid: 6508 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639085.681353:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae3750faa00/0x25c454990262c222 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262c21b expref: 21 pid: 6508 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639085.681382:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae3750faa00/0x25c454990262c222 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262c21b expref: 21 pid: 6508 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639085.681396:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788639085.681445:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36d1ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01f1eef9-e690-4065-bf99-bf821af7b626+20:3644:x1875523772974208:12345-0@lo:103:ldlm_bl.0 Request processed in 121us (1403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639085.681451:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788639085.681502:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01f1eef9-e690-4065-bf99-bf821af7b626:3644:1875523772974208:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788639085.711699:0:13184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1875523772973184:192.168.206.18@tcp:104: 00000100:00100000:3.0:1788639085.711709:0:13184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13184:1875523772974336:192.168.206.18@tcp:104: 00010000:00010000:3.0:1788639085.711739:0:13184:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ae38217ba00/0x25c454990262c276 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639085.713568:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639085.713950:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639085.714611:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754018560 00000100:00100000:3.0:1788639085.714737:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754018560 00010000:00010000:3.0:1788639085.714779:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae340030e00/0x25c454990262c206 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e853ba expref: 13 pid: 6508 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639085.714819:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754018432 00000100:00100000:3.0:1788639085.714822:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754018432 00010000:00010000:3.0:1788639085.714833:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae242f23400/0x25c454990262c253 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e853f9 expref: 14 pid: 6510 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639085.714859:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 44 00000100:00100000:3.0:1788639085.714870:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242081880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1343f14-ed5c-4943-b596-61180b04fa87+14:2407:x1875523754018560:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788639085.714886:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639085.714892:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae340030e00/0x25c454990262c206 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e853ba expref: 14 pid: 6508 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639085.714904:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae340030e00/0x25c454990262c206 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e853ba expref: 14 pid: 6508 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639085.714921:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae340030e00/0x25c454990262c206 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e853ba expref: 14 pid: 6508 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639085.714937:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639085.714997:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242081880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1343f14-ed5c-4943-b596-61180b04fa87+13:2407:x1875523754018560:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 128us (1436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639085.715017:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 44 00000100:00100000:3.0:1788639085.715034:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 45 00000100:00100000:3.0:1788639085.715040:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ff9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1343f14-ed5c-4943-b596-61180b04fa87+12:2407:x1875523754018432:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788639085.715048:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639085.715052:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae242f23400/0x25c454990262c253 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e853f9 expref: 12 pid: 6510 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639085.715061:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae242f23400/0x25c454990262c253 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e853f9 expref: 12 pid: 6510 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639085.715071:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae242f23400/0x25c454990262c253 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e853f9 expref: 12 pid: 6510 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639085.715082:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ae38217ba00/0x25c454990262c276 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639085.715091:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae38217ba00/0x25c454990262c276 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639085.715105:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae38217ba00/0x25c454990262c276 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639085.715113:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae38217ba00/0x25c454990262c276 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639085.715120:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ae38217ba00/0x25c454990262c276 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639085.715309:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ae38217ba00/0x25c454990262c276 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639085.715321:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae38217ba00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:3.0:1788639085.715325:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ae38217ba00/0x25c454990262c276 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639085.715333:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ae38217ba00/0x25c454990262c276 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639085.715350:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ae38217ba00/0x25c454990262c276 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639085.715361:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639085.715382:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ff9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1343f14-ed5c-4943-b596-61180b04fa87+11:2407:x1875523754018432:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 342us (1433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639085.715389:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 45 00010000:00010000:3.0:1788639085.715437:0:13184:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ae38217ba00/0x25c454990262c276 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639085.715446:0:13184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ae38217ba00/0x25c454990262c276 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639085.715452:0:13184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae38217ba00/0x25c454990262c276 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639086.005801:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639086.943765:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639086.950045:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754018688 00000100:00100000:3.0:1788639086.950059:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754018688 00000100:00100000:3.0:1788639086.950120:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 311 00000100:00100000:3.0:1788639086.950131:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+11:6177:x1875523754018688:12345-192.168.206.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788639086.950146:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639086.950174:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae38217ba00/0x25c454990262c27d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e8542a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639086.950203:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae38217ba00/0x25c454990262c27d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8542a expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639086.950215:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae38217ba00/0x25c454990262c27d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8542a expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639086.950225:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae38217ba00, rc 0) 00000100:00100000:3.0:1788639086.950290:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+12:6177:x1875523754018688:12345-192.168.206.18@tcp:101:ll_cfg_requeue.0 Request processed in 161us (6533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639086.950298:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 311 00000100:00100000:0.0:1788639086.956231:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639086.956486:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754018816 00000100:00100000:2.0:1788639086.956496:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754018816 00000100:00100000:2.0:1788639086.956553:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 312 00000100:00100000:2.0:1788639086.956562:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+12:6177:x1875523754018816:12345-192.168.206.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788639086.956749:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+12:6177:x1875523754018816:12345-192.168.206.18@tcp:501:ll_cfg_requeue.0 Request processed in 187us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639086.956758:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 312 00000100:00100000:0.0:1788639086.958703:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639086.959163:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754018944 00000100:00100000:2.0:1788639086.959173:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754018944 00000100:00100000:2.0:1788639086.959246:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 313 00000100:00100000:2.0:1788639086.959256:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370fff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+12:6177:x1875523754018944:12345-192.168.206.18@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788639086.959385:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370fff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+12:6177:x1875523754018944:12345-192.168.206.18@tcp:503:ll_cfg_requeue.0 Request processed in 130us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639086.959394:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 313 00000100:00100000:3.0:1788639086.964414:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639086.964787:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754019072 00000100:00100000:2.0:1788639086.964801:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754019072 00000100:00100000:2.0:1788639086.964853:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 314 00000100:00100000:2.0:1788639086.964863:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+12:6177:x1875523754019072:12345-192.168.206.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788639086.964880:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639086.964896:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae242f22e00/0x25c454990262c284 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85431 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639086.964979:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae242f22e00/0x25c454990262c284 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85431 expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639086.964989:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae242f22e00/0x25c454990262c284 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85431 expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639086.965051:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f22e00, rc 0) 00000100:00100000:2.0:1788639086.965095:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+13:6177:x1875523754019072:12345-192.168.206.18@tcp:101:ll_cfg_requeue.0 Request processed in 235us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639086.965101:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 314 10000000:01000000:1.0:1788639086.965185:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788639086.965190:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae375f89000 from 7 10000000:01000000:1.0:1788639086.965194:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788639086.965224:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa600/0x25c454990262c28b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639086.965235:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa600/0x25c454990262c28b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639086.965243:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa600/0x25c454990262c28b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639086.965272:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1a9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772974464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788639086.965313:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639086.965348:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243115480 going to sleep for 11 seconds 00000100:00100000:3.0:1788639086.965407:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772974464 00000100:00100000:3.0:1788639086.965411:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772974464 00000100:00100000:3.0:1788639086.965428:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1788639086.965433:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+20:6513:x1875523772974464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788639086.965438:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639086.965446:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae38217a400/0x25c454990262c292 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262c28b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639086.965507:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae38217a400/0x25c454990262c292 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262c28b expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639086.965515:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae38217a400/0x25c454990262c292 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c28b expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639086.965520:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae38217a400, rc 0) 00000100:00100000:3.0:1788639086.965558:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+21:6513:x1875523772974464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639086.965565:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1788639086.966968:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1a9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772974464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788639086.966992:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa600/0x25c454990262c28b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c292 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639086.967004:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa600/0x25c454990262c28b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262c292 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639086.967276:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1a9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772974592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788639086.967324:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639086.967360:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243115480 going to sleep for 11 seconds 00000100:00100000:3.0:1788639086.967681:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772974592 00000100:00100000:3.0:1788639086.967688:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772974592 00000100:00100000:3.0:1788639086.967728:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1788639086.967845:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+21:6513:x1875523772974592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788639086.967963:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+21:6513:x1875523772974592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639086.968066:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639086.968087:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754019200 00000100:00100000:2.0:1788639086.968091:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754019200 00000100:00100000:3.0:1788639086.970712:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1788639086.970791:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1a9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772974592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788639086.970849:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772974720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788639086.970915:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639086.970957:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d262c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788639086.971038:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772974720 00000100:00100000:2.0:1788639086.971045:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772974720 00000100:00100000:3.0:1788639086.971098:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 317 00000100:00100000:3.0:1788639086.971182:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370fff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+13:6177:x1875523754019200:12345-192.168.206.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788639086.971311:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370fff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+13:6177:x1875523754019200:12345-192.168.206.18@tcp:501:ll_cfg_requeue.0 Request processed in 132us (3245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639086.971318:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 317 00000100:00100000:3.0:1788639086.971339:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788639086.971345:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+21:6513:x1875523772974720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788639086.971425:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+21:6513:x1875523772974720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639086.971432:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788639086.971573:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772974720:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788639086.972302:0:13208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788639086.972357:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788639086.972385:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788639086.972393:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa600/0x25c454990262c28b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c292 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639086.972403:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa600/0x25c454990262c28b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c292 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639086.972412:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788639086.972415:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae375ea2800 from 7 10000000:01000000:3.0:1788639086.972417:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788639086.972446:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae38217a600/0x25c454990262c299 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639086.972453:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae38217a600/0x25c454990262c299 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639086.972462:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae38217a600/0x25c454990262c299 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639086.972479:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772974848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788639086.972518:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639086.972538:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d2623c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788639086.972552:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772974848 00000100:00100000:3.0:1788639086.972557:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772974848 00000100:00100000:3.0:1788639086.972582:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1788639086.972589:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+21:6513:x1875523772974848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788639086.972745:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639086.972757:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae38217a800/0x25c454990262c2a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262c299 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639086.972778:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae38217a800/0x25c454990262c2a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262c299 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639086.972787:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae38217a800/0x25c454990262c2a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c299 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639086.972796:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae38217a800, rc 0) 00000100:00100000:3.0:1788639086.972875:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+22:6513:x1875523772974848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 286us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639086.972881:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1788639086.972988:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772974848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788639086.973004:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae38217a600/0x25c454990262c299 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c2a0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639086.973012:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae38217a600/0x25c454990262c299 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262c2a0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639086.973078:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242083800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772974976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788639086.973103:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639086.973197:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243338b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788639086.973230:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772974976 00000100:00100000:3.0:1788639086.973234:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772974976 00000100:00100000:3.0:1788639086.973296:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1788639086.973305:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae369901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+22:6513:x1875523772974976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788639086.973401:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae369901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+22:6513:x1875523772974976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 98us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639086.973409:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1788639086.973461:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242083800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772974976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788639086.973487:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242083800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772975104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788639086.973522:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639086.973583:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243338b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788639086.973839:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772975104 00000100:00100000:3.0:1788639086.973844:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772975104 00000100:00100000:3.0:1788639086.973870:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1788639086.973876:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae369903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+22:6513:x1875523772975104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788639086.973950:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae369903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+22:6513:x1875523772975104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639086.973965:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1788639086.974045:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639086.974100:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754019328 00000100:00100000:2.0:1788639086.974104:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754019328 00000100:00100000:2.0:1788639086.974125:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 322 00000100:00100000:2.0:1788639086.974132:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae369902c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+13:6177:x1875523754019328:12345-192.168.206.18@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788639086.974201:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae369902c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+13:6177:x1875523754019328:12345-192.168.206.18@tcp:503:ll_cfg_requeue.0 Request processed in 68us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639086.974207:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 322 00000100:00100000:2.0:1788639086.974398:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242083800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772975104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788639086.975120:0:13209:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788639086.975172:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788639086.975189:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788639086.975198:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae38217a600/0x25c454990262c299 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c2a0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639086.975208:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae38217a600/0x25c454990262c299 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c2a0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788639086.975229:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788639086.975231:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae3506e9000 from 7 10000000:01000000:2.0:1788639086.975233:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788639086.975262:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f22400/0x25c454990262c2a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639086.975270:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae242f22400/0x25c454990262c2a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639086.975279:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae242f22400/0x25c454990262c2a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639086.975297:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242083800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772975232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788639086.975334:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639086.975359:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2432ac600 going to sleep for 11 seconds 00000100:00100000:2.0:1788639086.975372:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772975232 00000100:00100000:2.0:1788639086.975377:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772975232 00000100:00100000:2.0:1788639086.975399:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1788639086.975406:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae369902850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+22:6513:x1875523772975232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788639086.975415:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639086.975425:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae242f23e00/0x25c454990262c2ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262c2a7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639086.975445:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae242f23e00/0x25c454990262c2ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262c2a7 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639086.975456:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae242f23e00/0x25c454990262c2ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c2a7 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639086.975475:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f23e00, rc 0) 00000100:00100000:2.0:1788639086.975507:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae369902850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+23:6513:x1875523772975232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639086.975512:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1788639086.975543:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242083800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772975232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788639086.975555:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae242f22400/0x25c454990262c2a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c2ae expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639086.975563:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae242f22400/0x25c454990262c2a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262c2ae expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639086.975605:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242083800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772975360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788639086.975881:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639086.975906:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2432ac600 going to sleep for 11 seconds 00000100:00100000:3.0:1788639086.975996:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772975360 00000100:00100000:3.0:1788639086.976001:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772975360 00000100:00100000:3.0:1788639086.976061:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1788639086.976069:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae369903c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+23:6513:x1875523772975360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788639086.976161:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae369903c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+23:6513:x1875523772975360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 93us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639086.976168:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1788639086.976217:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242083800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772975360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788639086.976245:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242083800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772975488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788639086.976282:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639086.976297:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2432ac600 going to sleep for 11 seconds 00000100:00100000:3.0:1788639086.976332:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772975488 00000100:00100000:3.0:1788639086.976335:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772975488 00000100:00100000:3.0:1788639086.976389:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1788639086.976396:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae369900050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+23:6513:x1875523772975488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788639086.976465:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae369900050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+23:6513:x1875523772975488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639086.976471:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1788639086.976524:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242083800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772975488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788639086.977166:0:13210:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788639086.977211:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788639086.977227:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788639086.977236:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f22400/0x25c454990262c2a7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c2ae expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639086.977256:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae242f22400/0x25c454990262c2a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c2ae expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788639086.977266:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788639086.977268:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae3461e3800 from 7 10000000:01000000:2.0:1788639086.977271:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788639086.977296:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f22200/0x25c454990262c2b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639086.977304:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae242f22200/0x25c454990262c2b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639086.977314:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae242f22200/0x25c454990262c2b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639086.977329:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242083800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772975616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788639086.977365:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639086.977392:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2432ac0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788639086.977407:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772975616 00000100:00100000:2.0:1788639086.977412:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772975616 00000100:00100000:2.0:1788639086.977447:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1788639086.977454:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae369900850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+23:6513:x1875523772975616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788639086.977462:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639086.977472:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae242f22800/0x25c454990262c2bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262c2b5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639086.977489:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae242f22800/0x25c454990262c2bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262c2b5 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639086.977508:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae242f22800/0x25c454990262c2bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c2b5 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639086.977516:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f22800, rc 0) 00000100:00100000:2.0:1788639086.977546:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae369900850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+24:6513:x1875523772975616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639086.977552:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1788639086.977582:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242083800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772975616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788639086.977594:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae242f22200/0x25c454990262c2b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c2bc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639086.977602:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae242f22200/0x25c454990262c2b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262c2bc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639086.977673:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242083800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772975744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788639086.977696:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639086.977712:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2432ac0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788639086.977723:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772975744 00000100:00100000:2.0:1788639086.977727:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772975744 00000100:00100000:2.0:1788639086.977742:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1788639086.977747:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+24:6513:x1875523772975744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788639086.977823:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+24:6513:x1875523772975744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 74us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639086.977829:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1788639086.977858:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242083800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772975744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788639086.977890:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242083800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772975872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788639086.977922:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639086.977935:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2432ac0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788639086.977945:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772975872 00000100:00100000:2.0:1788639086.977948:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772975872 00000100:00100000:2.0:1788639086.977963:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1788639086.977969:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+24:6513:x1875523772975872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788639086.978032:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+24:6513:x1875523772975872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 63us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639086.978039:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1788639086.978074:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242083800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772975872:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788639086.979271:0:13211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788639086.979442:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788639086.979461:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788639086.979469:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f22200/0x25c454990262c2b5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c2bc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639086.979479:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae242f22200/0x25c454990262c2b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c2bc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639087.029409:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639087.286683:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772976000:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788639087.286749:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639087.286817:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772976000 00000100:00100000:2.0:1788639087.286825:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772976000 00000100:00100000:2.0:1788639087.286876:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788639087.286886:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242081880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772976000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788639087.286914:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788639087.286967:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242081880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772976000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639087.286974:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1788639087.286993:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788639087.287023:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae242083800 x1875523772976000/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639103 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639087.287040:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772976000:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788639087.287219:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523772976256:0@lo:400:kworker.0 00000100:00100000:1.0:1788639087.287255:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639087.287275:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875523772976768:0@lo:400:kworker.0 00000100:00100000:1.0:1788639087.287295:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639087.287315:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243153800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875523772977280:0@lo:400:kworker.0 00000100:00100000:1.0:1788639087.287333:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639087.287352:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788639087.287357:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772976384:0@lo:400:kworker.0 00000100:00100000:1.0:1788639087.287378:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639087.287395:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875523772976896:0@lo:400:kworker.0 00000100:00100000:1.0:1788639087.287425:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639087.287442:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243153480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875523772977408:0@lo:400:kworker.0 00000100:00100000:1.0:1788639087.287461:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639087.287486:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772976256 00000100:00100000:1.0:1788639087.287491:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772976256 00000100:00100000:1.0:1788639087.287513:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772976768 00000100:00100000:1.0:1788639087.287515:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772976768 00000100:00100000:1.0:1788639087.287530:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772977280 00000100:00100000:1.0:1788639087.287533:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772977280 00000100:00100000:1.0:1788639087.287544:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772976896 00000100:00100000:1.0:1788639087.287546:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772976896 00000100:00100000:1.0:1788639087.287556:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772977408 00000100:00100000:1.0:1788639087.287559:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772977408 00000100:00100000:1.0:1788639087.287571:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788639087.287577:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36e148a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523772976256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639087.287643:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36e148a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523772976256:12345-0@lo:400:kworker.0 Request processed in 66us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639087.287650:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788639087.287665:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788639087.287671:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36e14b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875523772976768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639087.287698:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36e14b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875523772976768:12345-0@lo:400:kworker.0 Request processed in 27us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639087.287704:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788639087.287715:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788639087.287720:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36e14a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875523772977280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639087.287746:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36e14a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875523772977280:12345-0@lo:400:kworker.0 Request processed in 26us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639087.287761:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788639087.287774:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788639087.287779:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36e149500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875523772976896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639087.287807:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36e149500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875523772976896:12345-0@lo:400:kworker.0 Request processed in 28us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639087.287813:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788639087.287824:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788639087.287829:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36e14b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875523772977408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639087.287856:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36e14b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875523772977408:12345-0@lo:400:kworker.0 Request processed in 27us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639087.287861:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00010000:00080000:1.0:1788639087.287899:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae36d1ab480 x1875523772976896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639087.287909:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875523772976896:0@lo:400:kworker.0 00010000:00080000:1.0:1788639087.287920:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae243153480 x1875523772977408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639087.287928:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243153480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875523772977408:0@lo:400:kworker.0 00000100:00100000:1.0:1788639087.287938:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523772976256:0@lo:400:kworker.0 00000100:00100000:1.0:1788639087.287946:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875523772976768:0@lo:400:kworker.0 00000100:00100000:1.0:1788639087.287954:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243153800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875523772977280:0@lo:400:kworker.0 00000100:00100000:2.0:1788639087.288224:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01f1eef9-e690-4065-bf99-bf821af7b626:3642:1875523772976128:0@lo:400:kworker.0 00000100:00100000:2.0:1788639087.288263:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639087.288300:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772976640:0@lo:400:kworker.0 00000100:00100000:2.0:1788639087.288322:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639087.288340:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243152d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772977152:0@lo:400:kworker.0 00000100:00100000:2.0:1788639087.288362:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639087.288381:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788639087.288386:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523772976512:0@lo:400:kworker.0 00000100:00100000:2.0:1788639087.288405:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639087.288420:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772977024:0@lo:400:kworker.0 00000100:00100000:2.0:1788639087.288438:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639087.288451:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243150a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772977536:0@lo:400:kworker.0 00000100:00100000:2.0:1788639087.288470:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639087.288496:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772976384 00000100:00100000:2.0:1788639087.288501:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772976384 00000100:00100000:2.0:1788639087.288530:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772976640 00000100:00100000:2.0:1788639087.288533:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772976640 00000100:00100000:2.0:1788639087.288546:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788639087.288552:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36e148e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772976384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639087.288598:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36e148e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772976384:12345-0@lo:400:kworker.0 Request processed in 46us (1218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639087.288604:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788639087.288649:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788639087.288655:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772976640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639087.288685:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772976640:12345-0@lo:400:kworker.0 Request processed in 31us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639087.288690:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788639087.288706:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772977152 00000100:00100000:2.0:1788639087.288710:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772977152 00000100:00100000:2.0:1788639087.288731:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772977024 00000100:00100000:2.0:1788639087.288734:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772977024 00000100:00100000:2.0:1788639087.288743:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772977536 00000100:00100000:2.0:1788639087.288745:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772977536 00000100:00100000:2.0:1788639087.288755:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788639087.288759:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772977152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639087.288785:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772977152:12345-0@lo:400:kworker.0 Request processed in 26us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639087.288790:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788639087.288799:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788639087.288804:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772977024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639087.288831:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772977024:12345-0@lo:400:kworker.0 Request processed in 27us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639087.288836:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788639087.288845:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788639087.288849:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772977536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639087.288883:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772977536:12345-0@lo:400:kworker.0 Request processed in 33us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639087.288889:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1788639087.288916:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788639087.288920:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788639087.288922:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788639087.288925:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788639087.288947:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae243150380 x1875523772977024/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639087.288958:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772977024:0@lo:400:kworker.0 00010000:00080000:2.0:1788639087.288968:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae243150a80 x1875523772977536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639087.288975:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243150a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772977536:0@lo:400:kworker.0 00000100:00100000:2.0:1788639087.288985:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772976640:0@lo:400:kworker.0 00010000:00080000:2.0:1788639087.288993:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae243152d80 x1875523772977152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639087.289000:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243152d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772977152:0@lo:400:kworker.0 00000100:00100000:2.0:1788639087.289030:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772976384:0@lo:400:kworker.0 00000100:00100000:2.0:1788639087.289046:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772976512 00000100:00100000:2.0:1788639087.289049:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772976512 00000100:00100000:2.0:1788639087.289071:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788639087.289076:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523772976512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639087.289109:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523772976512:12345-0@lo:400:kworker.0 Request processed in 32us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639087.289222:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772976128 00000100:00100000:1.0:1788639087.289226:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772976128 00000100:00100000:1.0:1788639087.289266:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1788639087.289273:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+24:3642:x1875523772976128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639087.289304:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+24:3642:x1875523772976128:12345-0@lo:400:kworker.0 Request processed in 32us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639087.289309:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1788639087.291040:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788639087.291195:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523772976512:0@lo:400:kworker.0 00000100:00100000:2.0:1788639087.291206:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01f1eef9-e690-4065-bf99-bf821af7b626:3642:1875523772976128:0@lo:400:kworker.0 00000100:00100000:0.0:1788639087.797449:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772977792:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788639087.797528:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639087.797668:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375fb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772977664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788639087.797700:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639087.797778:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772977664 00000100:00100000:0.0:1788639087.797785:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772977664 00000100:00100000:0.0:1788639087.797832:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788639087.797842:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772977664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788639087.797864:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788639087.797910:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772977664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639087.797917:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:0.0:1788639087.797953:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375fb0e00 x1875523772977664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639103 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639087.797970:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375fb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772977664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788639087.798047:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772977792 00000100:00100000:1.0:1788639087.798052:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772977792 00000100:00100000:1.0:1788639087.798080:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788639087.798086:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772977792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788639087.798110:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788639087.798148:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772977792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639087.798154:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788639087.798226:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772977792:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788639088.053134:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639088.319016:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375fb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772977920:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788639088.319081:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639088.319287:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772977920 00000100:00100000:0.0:1788639088.319294:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772977920 00000100:00100000:0.0:1788639088.319340:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788639088.319349:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772977920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788639088.319381:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788639088.325486:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772977920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6129us (6396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639088.325500:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788639088.328296:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375fb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772977920:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788639088.617074:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639088.621192:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639088.621242:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639088.621263:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639088.621291:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639088.621321:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754019712 00000100:00100000:2.0:1788639088.621330:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754019712 00000100:00100000:2.0:1788639088.621381:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754019968 00000100:00100000:2.0:1788639088.621384:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754019968 00000100:00100000:2.0:1788639088.621399:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754019584 00000100:00100000:2.0:1788639088.621401:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754019584 00000100:00100000:2.0:1788639088.621411:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754019840 00000100:00100000:2.0:1788639088.621414:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754019840 00000100:00100000:2.0:1788639088.621430:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 181 00000100:00100000:2.0:1788639088.621438:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2408:x1875523754019712:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639088.621505:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2408:x1875523754019712:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 67us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639088.621513:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 181 00000100:00100000:2.0:1788639088.621530:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 182 00000100:00100000:2.0:1788639088.621537:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2408:x1875523754019968:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639088.621582:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2408:x1875523754019968:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 45us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639088.621588:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 182 00000100:00100000:2.0:1788639088.621601:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 183 00000100:00100000:2.0:1788639088.621636:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2408:x1875523754019584:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639088.621662:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2408:x1875523754019584:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 44us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639088.621668:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 183 00000100:00100000:2.0:1788639088.621680:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 184 00000100:00100000:2.0:1788639088.621686:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2408:x1875523754019840:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639088.621707:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2408:x1875523754019840:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 22us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639088.621712:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 184 00000100:00080000:2.0:1788639088.621736:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788639088.621739:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788639088.622003:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754019456 00000100:00100000:3.0:1788639088.622008:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754019456 00000100:00100000:3.0:1788639088.622046:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 330 00000100:00100000:3.0:1788639088.622054:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+13:2408:x1875523754019456:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639088.622091:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+13:2408:x1875523754019456:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 38us (5025us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639088.622107:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 330 00010000:00010000:0.0:1788639089.077903:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788639089.672239:0:13383:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg618-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788639089.845428:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788639089.845448:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772978048:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788639089.845509:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639089.845567:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772978048 00000100:00100000:3.0:1788639089.845573:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772978048 00000100:00100000:3.0:1788639089.845663:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788639089.845672:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772978048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788639089.845699:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788639089.845742:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772978048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639089.845748:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:3.0:1788639089.845767:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788639089.845794:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2432ce300 x1875523772978048/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639105 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639089.845811:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772978048:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788639089.852279:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788639089.852305:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772978176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788639089.852363:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639089.852412:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772978176 00000100:00100000:2.0:1788639089.852419:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772978176 00000100:00100000:2.0:1788639089.852466:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788639089.852474:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772978176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788639089.852494:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788639089.852535:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772978176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639089.852552:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:2.0:1788639089.852574:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788639089.852613:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f35180 x1875523772978176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639105 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639089.852647:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772978176:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788639090.101637:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639091.125870:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639092.148923:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639092.406686:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e148380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523772978688:0@lo:400:kworker.0 00000100:00100000:0.0:1788639092.406702:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e14aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772978560:0@lo:400:kworker.0 00000100:00100000:1.0:1788639092.406756:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639092.406756:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639092.406861:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523772978304:0@lo:400:kworker.0 00000100:00100000:2.0:1788639092.406899:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639092.406910:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e149c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875523772978432:0@lo:400:kworker.0 00000100:00100000:2.0:1788639092.406937:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772978688 00000100:00100000:3.0:1788639092.406943:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639092.406945:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772978688 00000100:00100000:2.0:1788639092.406990:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772978432 00000100:00100000:2.0:1788639092.406993:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772978432 00000100:00100000:1.0:1788639092.407011:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e149180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772979200:0@lo:400:kworker.0 00000100:00100000:2.0:1788639092.407017:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788639092.407027:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523772978688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639092.407041:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639092.407061:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772979712:0@lo:400:kworker.0 00000100:00100000:2.0:1788639092.407079:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523772978688:12345-0@lo:400:kworker.0 Request processed in 54us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639092.407088:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639092.407089:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788639092.407112:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788639092.407120:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875523772978432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639092.407133:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e148380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523772978688:0@lo:400:kworker.0 00000100:00100000:2.0:1788639092.407168:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875523772978432:12345-0@lo:400:kworker.0 Request processed in 49us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639092.407174:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788639092.407202:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772979200 00000100:00100000:2.0:1788639092.407205:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772979200 00000100:00100000:2.0:1788639092.407232:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772979712 00000100:00100000:2.0:1788639092.407235:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772979712 00000100:00100000:2.0:1788639092.407270:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788639092.407276:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36d1ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772979200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639092.407311:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36d1ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772979200:12345-0@lo:400:kworker.0 Request processed in 35us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639092.407317:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788639092.407329:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788639092.407335:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36d1aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772979712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639092.407362:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36d1aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772979712:12345-0@lo:400:kworker.0 Request processed in 27us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639092.407367:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:2.0:1788639092.407385:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788639092.407389:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788639092.411656:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772978304 00000100:00100000:3.0:1788639092.411671:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772978304 00000100:00100000:1.0:1788639092.412030:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e14ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772978816:0@lo:400:kworker.0 00000100:00100000:1.0:1788639092.412096:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639092.412231:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1788639092.412240:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+24:3643:x1875523772978304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639092.412290:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+24:3643:x1875523772978304:12345-0@lo:400:kworker.0 Request processed in 51us (5392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639092.412306:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1788639092.412468:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772978560 00000100:00100000:3.0:1788639092.412473:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772978560 00000100:00100000:3.0:1788639092.412504:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772978816 00000100:00100000:3.0:1788639092.412507:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772978816 00000100:00100000:3.0:1788639092.412519:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788639092.412526:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772978560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639092.412563:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772978560:12345-0@lo:400:kworker.0 Request processed in 37us (5809us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639092.412569:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788639092.412580:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788639092.412597:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36d1a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772978816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639092.412643:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36d1a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772978816:12345-0@lo:400:kworker.0 Request processed in 47us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639092.412650:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00010000:00080000:3.0:1788639092.412698:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae36e149180 x1875523772979200/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639092.412712:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e149180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772979200:0@lo:400:kworker.0 00010000:00080000:3.0:1788639092.412723:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae243150380 x1875523772979712/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639092.412732:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772979712:0@lo:400:kworker.0 00000100:00100000:2.0:1788639092.420607:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e149c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875523772978432:0@lo:400:kworker.0 00000100:00100000:2.0:1788639092.420636:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e14bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875523772978944:0@lo:400:kworker.0 00000100:00100000:2.0:1788639092.420695:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639092.420724:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243152d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875523772979456:0@lo:400:kworker.0 00000100:00100000:2.0:1788639092.420742:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639092.420766:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772978944 00000100:00100000:3.0:1788639092.420774:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772978944 00000100:00100000:2.0:1788639092.420782:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772979968:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788639092.420810:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639092.420835:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772979456 00000100:00100000:3.0:1788639092.420840:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772979456 00000100:00100000:2.0:1788639092.420845:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772979968 00000100:00100000:2.0:1788639092.420850:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772979968 00000100:00100000:2.0:1788639092.420882:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788639092.420891:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772979968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788639092.420917:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788639092.420951:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788639092.420951:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772979968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639092.420964:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875523772978944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639092.420968:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788639092.420998:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788639092.421007:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875523772979456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639092.421014:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875523772978944:12345-0@lo:400:kworker.0 Request processed in 53us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639092.421021:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788639092.421042:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875523772979456:12345-0@lo:400:kworker.0 Request processed in 37us (299us total) trans 0 rc 0/0 00000100:00080000:3.0:1788639092.421049:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788639092.421084:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2432cd880 x1875523772979968/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639108 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639092.421100:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772979968:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788639092.421111:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e14bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875523772978944:0@lo:400:kworker.0 00000100:00100000:3.0:1788639092.421120:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243152d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875523772979456:0@lo:400:kworker.0 00000100:00100000:2.0:1788639092.421838:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788639092.424226:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e14aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772978560:0@lo:400:kworker.0 00000100:00100000:0.0:1788639092.424412:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875523772979072:0@lo:400:kworker.0 00000100:00100000:0.0:1788639092.424465:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639092.424561:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243150a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875523772979584:0@lo:400:kworker.0 00000100:00100000:0.0:1788639092.424596:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639092.425012:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e14ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772978816:0@lo:400:kworker.0 00000100:00100000:1.0:1788639092.425022:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772979328:0@lo:400:kworker.0 00000100:00100000:1.0:1788639092.425049:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639092.425250:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243153800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772979840:0@lo:400:kworker.0 00000100:00100000:1.0:1788639092.425275:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639092.425297:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772979328 00000100:00100000:3.0:1788639092.425304:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772979328 00000100:00100000:1.0:1788639092.425321:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e14b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523772978304:0@lo:400:kworker.0 00000100:00100000:1.0:1788639092.425356:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772979840 00000100:00100000:1.0:1788639092.425359:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772979840 00000100:00100000:1.0:1788639092.425387:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788639092.425395:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36d1a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772979328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639092.425441:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36d1a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772979328:12345-0@lo:400:kworker.0 Request processed in 47us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639092.425448:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788639092.425464:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788639092.425470:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36d1abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772979840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639092.425497:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36d1abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772979840:12345-0@lo:400:kworker.0 Request processed in 27us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639092.425503:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:1.0:1788639092.425529:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae36e149880 x1875523772979328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639092.425539:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772979328:0@lo:400:kworker.0 00000100:00080000:3.0:1788639092.425752:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788639092.425756:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788639092.426297:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae243153800 x1875523772979840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639092.426308:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243153800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772979840:0@lo:400:kworker.0 00000100:00100000:3.0:1788639092.437811:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772979584 00000100:00100000:3.0:1788639092.437825:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772979584 00000100:00080000:0.0:1788639092.437884:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788639092.437992:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772979072 00000100:00100000:2.0:1788639092.437998:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772979072 00000100:00100000:3.0:1788639092.438005:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788639092.438019:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875523772979584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639092.438109:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875523772979584:12345-0@lo:400:kworker.0 Request processed in 96us (13513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639092.438116:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788639092.438147:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788639092.438154:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875523772979072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639092.438206:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875523772979072:12345-0@lo:400:kworker.0 Request processed in 53us (13741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639092.438211:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00080000:0.0:1788639092.438844:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788639092.438884:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae36e148000 x1875523772979072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639092.438900:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875523772979072:0@lo:400:kworker.0 00010000:00080000:0.0:1788639092.438913:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae243150a80 x1875523772979584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639092.438923:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243150a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875523772979584:0@lo:400:kworker.0 00000100:00100000:3.0:1788639092.917224:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788639092.917324:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772980096:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788639092.917386:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639092.917444:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772980096 00000100:00100000:3.0:1788639092.917451:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772980096 00000100:00100000:3.0:1788639092.917491:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788639092.917514:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772980096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788639092.917536:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788639092.917574:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772980096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639092.917591:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:3.0:1788639092.917724:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2432cd880 x1875523772980096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639108 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639092.917740:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772980096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788639092.918777:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788639092.918790:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772980224:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788639092.918835:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639092.918926:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772980224 00000100:00100000:1.0:1788639092.918932:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772980224 00000100:00100000:1.0:1788639092.918974:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788639092.918983:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772980224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788639092.919020:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788639092.919060:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772980224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639092.919066:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788639092.919212:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772980224:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788639093.176108:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639093.431385:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788639093.431408:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375fb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772980352:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788639093.431470:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639093.431602:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772980352 00000100:00100000:0.0:1788639093.431610:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772980352 00000100:00100000:0.0:1788639093.431681:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788639093.431690:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772980352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788639093.431719:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788639093.431767:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772980352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639093.431774:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788639093.431857:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375fb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772980352:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788639093.732979:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639093.733009:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639093.733037:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639093.733057:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639093.733075:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639093.733098:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754020352 00000100:00100000:2.0:1788639093.733107:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754020352 00000100:00100000:2.0:1788639093.733164:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754020608 00000100:00100000:2.0:1788639093.733167:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754020608 00000100:00100000:2.0:1788639093.733194:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754020224 00000100:00100000:2.0:1788639093.733196:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754020224 00000100:00100000:2.0:1788639093.733204:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754020480 00000100:00100000:2.0:1788639093.733206:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754020480 00000100:00100000:2.0:1788639093.733218:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 191 00000100:00100000:2.0:1788639093.733236:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2405:x1875523754020352:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639093.733296:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2405:x1875523754020352:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 71us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639093.733303:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 191 00000100:00100000:2.0:1788639093.733317:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 192 00000100:00100000:2.0:1788639093.733322:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2405:x1875523754020608:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639093.733356:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2405:x1875523754020608:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 34us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639093.733362:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 192 00000100:00100000:2.0:1788639093.733372:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 193 00000100:00100000:2.0:1788639093.733377:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f78c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2405:x1875523754020224:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639093.733395:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f78c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2405:x1875523754020224:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 19us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639093.733400:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 193 00000100:00100000:2.0:1788639093.733409:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 194 00000100:00100000:2.0:1788639093.733413:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f78f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2405:x1875523754020480:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639093.733430:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f78f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2405:x1875523754020480:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 16us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639093.733434:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 194 00000100:00080000:2.0:1788639093.733449:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788639093.733456:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788639093.735476:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754020096 00000100:00100000:3.0:1788639093.735487:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754020096 00000100:00100000:3.0:1788639093.735543:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 332 00000100:00100000:3.0:1788639093.735551:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+13:2405:x1875523754020096:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639093.735644:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+13:2405:x1875523754020096:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 94us (2673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639093.735652:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 332 00010000:00010000:0.0:1788639094.196840:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639094.964861:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772980480:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788639094.964933:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639094.965231:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772980480 00000100:00100000:3.0:1788639094.965239:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772980480 00000100:00100000:3.0:1788639094.965298:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788639094.965308:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772980480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788639094.965335:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788639094.965380:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772980480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639094.965386:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1788639094.965453:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788639094.965484:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2432cd880 x1875523772980480/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639110 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639094.965518:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772980480:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788639094.968302:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772980608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788639094.968364:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639094.969252:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772980608 00000100:00100000:1.0:1788639094.969260:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772980608 00000100:00100000:1.0:1788639094.969318:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788639094.969326:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f78ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772980608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788639094.969347:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788639094.969395:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f78ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772980608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639094.969401:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:0.0:1788639094.969503:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788639094.969581:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae36d1ab480 x1875523772980608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639110 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639094.969599:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772980608:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1788639095.068053:0:13532:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 16:11:34 (1788639094) === 00010000:00010000:3.0:1788639095.220831:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639095.417121:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639095.417209:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639095.417295:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754020736 00000100:00100000:1.0:1788639095.417305:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754020736 00000100:00100000:1.0:1788639095.417381:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 22 00000100:00100000:1.0:1788639095.417393:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae342e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2406:x1875523754020736:12345-192.168.206.18@tcp:41:mkdir.0 00000004:00000024:1.0:1788639095.417439:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788639095.417529:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae342e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2406:x1875523754020736:12345-192.168.206.18@tcp:41:mkdir.0 Request processed in 138us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639095.417536:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 22 00000100:00100000:0.0:1788639095.417714:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754020864 00000100:00100000:0.0:1788639095.417719:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754020864 00000100:00100000:0.0:1788639095.417754:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 2 00000100:00100000:0.0:1788639095.417761:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae360685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:5deb128c-4fe3-4f51-b21e-f30846e08445+6:10519:x1875523754020864:12345-192.168.206.18@tcp:700:mkdir.0 00000100:00100000:0.0:1788639095.417801:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae360685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:5deb128c-4fe3-4f51-b21e-f30846e08445+6:10519:x1875523754020864:12345-192.168.206.18@tcp:700:mkdir.0 Request processed in 41us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639095.417817:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 2 00000100:00080000:2.0:1788639095.418376:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788639095.420782:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639095.420968:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754021120 00000100:00100000:0.0:1788639095.420978:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754021120 00000100:00100000:0.0:1788639095.421035:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 23 00000100:00100000:0.0:1788639095.421046:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae360685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+6:10519:x1875523754021120:12345-192.168.206.18@tcp:36:mkdir.0 00010000:00010000:0.0:1788639095.421198:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788639095.421223:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375f55200/0x25c454990262c165 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e853a5 expref: 6 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.421243:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae375d62d00) 00010000:00010000:0.0:1788639095.421255:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788639095.421340:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031c00/0x25c454990262c2c3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.421355:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031c00/0x25c454990262c2c3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.421365:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031c00/0x25c454990262c2c3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.421435:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031800/0x25c454990262c2ca lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.421443:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031800/0x25c454990262c2ca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.421450:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031800/0x25c454990262c2ca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.422065:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031600/0x25c454990262c2d1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.422089:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031600/0x25c454990262c2d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.422096:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031600/0x25c454990262c2d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788639095.422110:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000310861e9 reply state 00000000836eae19 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031600/0x25c454990262c2d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.422119:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031600/0x25c454990262c2d1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.422125:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ae375d62900) 00010000:00010000:0.0:1788639095.422127:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788639095.422130:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788639095.422134:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788639095.422140:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031c00/0x25c454990262c2c3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.422146:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031c00/0x25c454990262c2c3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.422158:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031c00/0x25c454990262c2c3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.422163:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae340031c00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639095.422168:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031c00/0x25c454990262c2c3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.422176:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031c00/0x25c454990262c2c3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.422185:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae375d62400) 00010000:00010000:0.0:1788639095.422187:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639095.422191:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031c00/0x25c454990262c2c3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.422196:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031c00/0x25c454990262c2c3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788639095.422210:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000310861e9 reply state 00000000836eae19 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031800/0x25c454990262c2ca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.422218:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031800/0x25c454990262c2ca lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.422224:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ae375d62300) 00010000:00010000:0.0:1788639095.422226:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788639095.422228:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788639095.422310:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae360685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+7:10519:x1875523754021120:12345-192.168.206.18@tcp:36:mkdir.0 Request processed in 1264us (1535us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788639095.422318:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 23 00000100:00100000:0.0:1788639095.448753:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639095.448841:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754021248 00000100:00100000:3.0:1788639095.448858:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754021248 00000100:00100000:3.0:1788639095.448913:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 24 00000100:00100000:3.0:1788639095.448923:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f7c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+7:10521:x1875523754021248:12345-192.168.206.18@tcp:101:chmod.0 00010000:00010000:3.0:1788639095.448944:0:10169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639095.448970:0:10169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217be00/0x25c454990262c2d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85438 expref: -99 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.449029:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c2df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.449043:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c2df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.449055:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c2df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788639095.449110:0:10169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788639095.449114:0:10169:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788639095.449148:0:10169:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c2df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.449184:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217be00/0x25c454990262c2d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85438 expref: 9 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.449204:0:10169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c2df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85438 expref: 8 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.449212:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae242381700) 00010000:00010000:3.0:1788639095.449214:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788639095.449218:0:10169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae38217b000, rc 0) 00000100:00100000:3.0:1788639095.449279:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f7c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+8:10521:x1875523754021248:12345-192.168.206.18@tcp:101:chmod.0 Request processed in 357us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639095.449286:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 24 00000100:00100000:2.0:1788639095.455348:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639095.455478:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754021504 00000100:00100000:3.0:1788639095.455487:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754021504 00000100:00100000:3.0:1788639095.455544:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 25 00000100:00100000:3.0:1788639095.455554:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae360686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+8:10521:x1875523754021504:12345-192.168.206.18@tcp:36:chmod.0 00010000:00010000:3.0:1788639095.455642:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639095.455670:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c2df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85438 expref: 8 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.455690:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae242381700) 00010000:00010000:3.0:1788639095.455700:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788639095.455721:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c2e6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.455733:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c2e6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.455758:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c2e6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788639095.455966:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000076b7332d reply state 00000000e6d3efc4 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c2e6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.455978:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c2e6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.455984:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae242381800) 00010000:00010000:3.0:1788639095.455987:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788639095.455989:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788639095.455996:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788639095.456065:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae360686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+9:10521:x1875523754021504:12345-192.168.206.18@tcp:36:chmod.0 Request processed in 512us (725us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788639095.456268:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 25 00000100:00100000:2.0:1788639095.483233:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639095.483327:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754021632 00000100:00100000:0.0:1788639095.483338:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754021632 00000100:00100000:0.0:1788639095.483406:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 26 00000100:00100000:0.0:1788639095.483417:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+9:10523:x1875523754021632:12345-192.168.206.18@tcp:101:chown.0 00010000:00010000:0.0:1788639095.483437:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639095.483458:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031c00/0x25c454990262c2ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e8543f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.483523:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030400/0x25c454990262c2f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.483537:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030400/0x25c454990262c2f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.483549:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030400/0x25c454990262c2f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788639095.483598:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788639095.483602:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788639095.483670:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030400/0x25c454990262c2f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.483697:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031c00/0x25c454990262c2ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8543f expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.483714:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030400/0x25c454990262c2f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8543f expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.483723:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae242381800) 00010000:00010000:0.0:1788639095.483738:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788639095.483742:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae340030400, rc 0) 00000100:00100000:0.0:1788639095.483805:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+10:10523:x1875523754021632:12345-192.168.206.18@tcp:101:chown.0 Request processed in 390us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639095.486093:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 26 00000100:00100000:0.0:1788639095.490018:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639095.490201:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754021760 00000100:00100000:2.0:1788639095.490210:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754021760 00000100:00100000:2.0:1788639095.490260:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 27 00000100:00100000:2.0:1788639095.490270:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f7c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+10:10523:x1875523754021760:12345-192.168.206.18@tcp:101:chown.0 00010000:00010000:2.0:1788639095.490291:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639095.490313:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23800/0x25c454990262c2fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85446 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639095.490375:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23400/0x25c454990262c302 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639095.490389:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23400/0x25c454990262c302 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639095.490401:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23400/0x25c454990262c302 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639095.490436:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23c00/0x25c454990262c309 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639095.490445:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23c00/0x25c454990262c309 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639095.490452:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23c00/0x25c454990262c309 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639095.490523:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22600/0x25c454990262c310 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639095.490531:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22600/0x25c454990262c310 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639095.490538:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22600/0x25c454990262c310 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788639095.490588:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788639095.490591:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788639095.490610:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22600/0x25c454990262c310 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639095.490661:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23400/0x25c454990262c302 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639095.490667:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23400/0x25c454990262c302 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639095.490674:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23400/0x25c454990262c302 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639095.490688:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f23400 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639095.490692:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23400/0x25c454990262c302 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639095.490699:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23400/0x25c454990262c302 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639095.490709:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae242381800) 00010000:00010000:2.0:1788639095.490711:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639095.490715:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23400/0x25c454990262c302 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639095.490721:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23400/0x25c454990262c302 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639095.490732:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23c00/0x25c454990262c309 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639095.490736:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23c00/0x25c454990262c309 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639095.490742:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23c00/0x25c454990262c309 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639095.490746:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f23c00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639095.490748:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23c00/0x25c454990262c309 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639095.490753:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23c00/0x25c454990262c309 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639095.490771:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ae375d62300) 00010000:00010000:2.0:1788639095.490773:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639095.490776:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23c00/0x25c454990262c309 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639095.490780:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23c00/0x25c454990262c309 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639095.490804:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23800/0x25c454990262c2fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85446 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639095.490817:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22600/0x25c454990262c310 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85446 expref: 11 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639095.490824:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ae375d62900) 00010000:00010000:2.0:1788639095.490827:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788639095.490830:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f22600, rc 0) 00000100:00100000:2.0:1788639095.490888:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f7c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+11:10523:x1875523754021760:12345-192.168.206.18@tcp:101:chown.0 Request processed in 618us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639095.490895:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 27 00000100:00100000:2.0:1788639095.494395:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639095.494744:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754021888 00000100:00100000:3.0:1788639095.494754:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754021888 00000100:00100000:3.0:1788639095.494825:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 6 00000100:00100000:3.0:1788639095.494838:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5deb128c-4fe3-4f51-b21e-f30846e08445+11:10523:x1875523754021888:12345-192.168.206.18@tcp:900:chown.0 00000100:00100000:3.0:1788639095.494928:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5deb128c-4fe3-4f51-b21e-f30846e08445+11:10523:x1875523754021888:12345-192.168.206.18@tcp:900:chown.0 Request processed in 93us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639095.494937:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 6 00000100:00100000:0.0:1788639095.500170:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639095.500267:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754022144 00000100:00100000:1.0:1788639095.500277:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754022144 00000100:00100000:1.0:1788639095.500377:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 28 00000100:00100000:1.0:1788639095.500387:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f7c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+11:10523:x1875523754022144:12345-192.168.206.18@tcp:36:chown.0 00010000:00010000:1.0:1788639095.500447:0:11314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788639095.500474:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22600/0x25c454990262c310 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85446 expref: 11 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639095.500510:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ae375d62900) 00010000:00010000:1.0:1788639095.500516:0:11314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788639095.500539:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262c317 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639095.500551:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262c317 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639095.500561:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262c317 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788639095.503947:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:0.0:1788639095.504080:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031800/0x25c454990262c2ca lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.504094:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031800/0x25c454990262c2ca lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.504102:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031800/0x25c454990262c2ca lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.504108:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae340031800 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639095.504113:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031800/0x25c454990262c2ca lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.504120:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031800/0x25c454990262c2ca lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.504136:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ae375d62300) 00010000:00010000:0.0:1788639095.504139:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639095.504144:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031800/0x25c454990262c2ca lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.504150:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031800/0x25c454990262c2ca lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.504186:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031600/0x25c454990262c2d1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.504192:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031600/0x25c454990262c2d1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.504198:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031600/0x25c454990262c2d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.504203:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae340031600 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639095.504206:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031600/0x25c454990262c2d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.504212:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031600/0x25c454990262c2d1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.504220:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ae375d62900) 00010000:00010000:0.0:1788639095.504222:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639095.504225:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031600/0x25c454990262c2d1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.504231:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031600/0x25c454990262c2d1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.504244:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c2e6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.504250:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c2e6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.504256:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c2e6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.504266:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae38217b800 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639095.504269:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c2e6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.504276:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c2e6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.504284:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae242381800) 00010000:00010000:0.0:1788639095.504287:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788639095.504290:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c2e6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.504296:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c2e6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788639095.504522:0:11314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a58de1cf reply state 00000000acd580fa transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262c317 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639095.504538:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262c317 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639095.504545:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ae375d62900) 00010000:00010000:1.0:1788639095.504547:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788639095.504550:0:11314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788639095.504561:0:11314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:1.0:1788639095.504694:0:11314:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1788639095.504713:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f7c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+7:10523:x1875523754022144:12345-192.168.206.18@tcp:36:chown.0 Request processed in 4324us (4550us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788639095.504722:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 28 00010000:00010000:0.0:1788639095.505005:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262c317 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.505014:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262c317 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.505020:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262c317 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.505026:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fb000 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639095.505029:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262c317 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.505036:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262c317 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.505057:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ae375d62900) 00010000:00010000:0.0:1788639095.505059:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788639095.505062:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262c317 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.505081:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262c317 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639095.530911:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639095.531002:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754022272 00000100:00100000:0.0:1788639095.531011:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754022272 00000100:00100000:0.0:1788639095.531077:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 29 00000100:00100000:0.0:1788639095.531089:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+6:10524:x1875523754022272:12345-192.168.206.18@tcp:101:touch.500 00010000:00010000:0.0:1788639095.531111:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639095.531130:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031600/0x25c454990262c31e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e8544d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788639095.534694:0:6516:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3501us 00010000:00010000:3.0:1788639095.544769:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c325 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.544793:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c325 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.544823:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c325 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.544839:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217be00/0x25c454990262c32c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.544846:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217be00/0x25c454990262c32c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.544853:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217be00/0x25c454990262c32c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.544996:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b600/0x25c454990262c333 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.545004:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b600/0x25c454990262c333 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.545010:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b600/0x25c454990262c333 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788639095.545040:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788639095.545044:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788639095.545103:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b600/0x25c454990262c333 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.545115:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c325 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.545121:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c325 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.545137:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c325 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.545143:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae38217b000 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639095.545147:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c325 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.545155:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c325 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.545167:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae242381800) 00010000:00010000:3.0:1788639095.545170:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639095.545174:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c325 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.545180:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c325 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.545192:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217be00/0x25c454990262c32c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.545197:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217be00/0x25c454990262c32c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.545202:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217be00/0x25c454990262c32c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.545207:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae38217be00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639095.545210:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217be00/0x25c454990262c32c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.545225:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217be00/0x25c454990262c32c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.545233:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ae242381700) 00010000:00010000:3.0:1788639095.545235:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639095.545238:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217be00/0x25c454990262c32c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.545244:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217be00/0x25c454990262c32c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.545279:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031600/0x25c454990262c31e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8544d expref: 8 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.545294:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b600/0x25c454990262c333 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8544d expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.545301:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ae242381a00) 00010000:00010000:3.0:1788639095.545303:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788639095.545306:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae38217b600, rc 0) 00000100:00100000:3.0:1788639095.545375:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+7:10524:x1875523754022272:12345-192.168.206.18@tcp:101:touch.500 Request processed in 14288us (14471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639095.545383:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 29 00000100:00100000:1.0:1788639095.552849:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639095.555610:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754022528 00000100:00100000:0.0:1788639095.555656:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754022528 00000100:00100000:0.0:1788639095.555716:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 30 00000100:00100000:0.0:1788639095.555726:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36d1ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+7:10524:x1875523754022528:12345-192.168.206.18@tcp:101:touch.500 00010000:00010000:0.0:1788639095.555745:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639095.555763:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031800/0x25c454990262c33a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85454 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.555860:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031c00/0x25c454990262c341 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.555874:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031c00/0x25c454990262c341 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.555898:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031c00/0x25c454990262c341 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.555954:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031200/0x25c454990262c348 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.555962:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031200/0x25c454990262c348 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.555968:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031200/0x25c454990262c348 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788639095.557325:0:6518:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:0.0:1788639095.557988:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030e00/0x25c454990262c34f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.558005:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030e00/0x25c454990262c34f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.558016:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030e00/0x25c454990262c34f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.558047:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031c00/0x25c454990262c341 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.558054:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031c00/0x25c454990262c341 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.558061:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031c00/0x25c454990262c341 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.558067:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae340031c00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639095.558499:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031c00/0x25c454990262c341 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.558508:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031c00/0x25c454990262c341 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.558521:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ae242381a00) 00010000:00010000:0.0:1788639095.558524:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639095.558529:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031c00/0x25c454990262c341 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.558536:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031c00/0x25c454990262c341 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788639095.558550:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c7ce8359 reply state 0000000084ef16d3 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031200/0x25c454990262c348 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.558559:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031200/0x25c454990262c348 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.558576:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xe19035d1 (ffff9ae375d62900) 00010000:00010000:0.0:1788639095.558578:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788639095.558581:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788639095.558929:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031800/0x25c454990262c33a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85454 expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.558947:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030e00/0x25c454990262c34f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85454 expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.558954:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9ae375d62300) 00010000:00010000:0.0:1788639095.558957:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788639095.558966:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae340030e00, rc 0) 00000100:00100000:0.0:1788639095.559033:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36d1ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+10:10524:x1875523754022528:12345-192.168.206.18@tcp:101:touch.500 Request processed in 3308us (6193us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788639095.559042:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 30 00000100:00100000:0.0:1788639095.564342:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639095.564426:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754022784 00000100:00100000:1.0:1788639095.564436:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754022784 00000100:00100000:1.0:1788639095.564491:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 31 00000100:00100000:1.0:1788639095.564501:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f7c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+10:10524:x1875523754022784:12345-192.168.206.18@tcp:36:touch.500 00010000:00010000:1.0:1788639095.564574:0:11314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788639095.564602:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030e00/0x25c454990262c34f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85454 expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639095.564644:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9ae375d62300) 00010000:00010000:1.0:1788639095.564656:0:11314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788639095.564708:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c35d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639095.564726:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c35d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639095.564736:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c35d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788639095.564846:0:11314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006a8ea9f9 reply state 00000000c0bdb57b transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c35d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639095.565222:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c35d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639095.565230:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9ae350c03c00) 00010000:00010000:1.0:1788639095.565233:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788639095.565236:0:11314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788639095.565329:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f7c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+11:10524:x1875523754022784:12345-192.168.206.18@tcp:36:touch.500 Request processed in 829us (997us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788639095.565336:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 31 00000100:00100000:2.0:1788639095.570003:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639095.570089:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754022912 00000100:00100000:3.0:1788639095.570099:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754022912 00000100:00100000:3.0:1788639095.570178:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 32 00000100:00100000:3.0:1788639095.570188:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+11:10524:x1875523754022912:12345-192.168.206.18@tcp:101:touch.500 00010000:00010000:3.0:1788639095.570222:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639095.570241:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217be00/0x25c454990262c364 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e8545b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.570295:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217be00/0x25c454990262c364 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8545b expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.570309:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217be00/0x25c454990262c364 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8545b expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.570328:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9ae350c03c00) 00010000:00010000:3.0:1788639095.570331:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788639095.570334:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae38217be00, rc 0) 00000100:00100000:3.0:1788639095.570392:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+12:10524:x1875523754022912:12345-192.168.206.18@tcp:101:touch.500 Request processed in 205us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639095.570399:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 32 00000100:00100000:2.0:1788639095.573547:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639095.574552:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754023040 00000100:00100000:1.0:1788639095.574563:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754023040 00000100:00100000:1.0:1788639095.574639:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 24 00000100:00100000:1.0:1788639095.574659:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2404:x1875523754023040:12345-192.168.206.18@tcp:8:touch.500 00010000:00080000:1.0:1788639095.574691:0:8829:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 5deb128c-4fe3-4f51-b21e-f30846e08445@192.168.206.18@tcp t0 exp 0000000000000000 cur 354 last 0 00000020:00000080:1.0:1788639095.574723:0:8829:0:(genops.c:1385:class_connect()) connect: client 5deb128c-4fe3-4f51-b21e-f30846e08445, cookie 0x25c454990262c36b 00002000:00100000:1.0:1788639095.574734:0:8829:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5deb128c-4fe3-4f51-b21e-f30846e08445/ffff9ae2431aa800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788639095.574743:0:8829:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788639095.574817:0:8829:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788639095.574845:0:8829:0:(import.c:65:import_set_state_nolock()) ffff9ae2416ef000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788639095.574917:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2404:x1875523754023040:12345-192.168.206.18@tcp:8:touch.500 Request processed in 258us (1378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639095.574924:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 24 00000100:00100000:1.0:1788639095.577293:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639095.577361:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754023168 00000100:00100000:3.0:1788639095.577369:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754023168 00000100:00080000:2.0:1788639095.577479:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788639095.577558:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 25 00000100:00100000:3.0:1788639095.577579:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36d1ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+6:0:x1875523754023168:12345-192.168.206.18@tcp:2:touch.500 00000001:00080000:0.0:1788639095.584189:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:0.0:1788639095.584204:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5deb128c-4fe3-4f51-b21e-f30846e08445 00000100:00100000:1.0:1788639095.585236:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36d1ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+5:0:x1875523754023168:12345-192.168.206.18@tcp:2:touch.500 Request processed in 7662us (7943us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788639095.585247:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 25 00000100:00100000:2.0:1788639095.590491:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639095.590703:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754023424 00000100:00100000:3.0:1788639095.590713:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754023424 00000100:00100000:3.0:1788639095.590812:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 2 00000100:00100000:3.0:1788639095.590822:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+12:10524:x1875523754023424:12345-192.168.206.18@tcp:35:touch.500 00000100:00100000:3.0:1788639095.591274:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+13:10524:x1875523754023424:12345-192.168.206.18@tcp:35:touch.500 Request processed in 452us (791us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788639095.591298:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 2 00000100:00100000:2.0:1788639095.604350:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639095.604819:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754023552 00000100:00100000:0.0:1788639095.604830:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754023552 00000100:00100000:0.0:1788639095.605177:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 33 00000100:00100000:0.0:1788639095.605189:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+13:10525:x1875523754023552:12345-192.168.206.18@tcp:101:rm.0 00010000:00010000:0.0:1788639095.605212:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639095.605234:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031800/0x25c454990262c372 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85462 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.605301:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031c00/0x25c454990262c379 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.605318:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031c00/0x25c454990262c379 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.605332:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031c00/0x25c454990262c379 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788639095.605372:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788639095.605376:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788639095.605423:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031c00/0x25c454990262c379 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.605447:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031800/0x25c454990262c372 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85462 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.605473:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031c00/0x25c454990262c379 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85462 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.605481:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ae242381a00) 00010000:00010000:0.0:1788639095.605484:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788639095.605487:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae340031c00, rc 0) 00000100:00100000:0.0:1788639095.605549:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+14:10525:x1875523754023552:12345-192.168.206.18@tcp:101:rm.0 Request processed in 363us (1208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639095.605556:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 33 00000100:00100000:1.0:1788639095.609090:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639095.619552:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754023808 00000100:00100000:2.0:1788639095.619578:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754023808 00000100:00100000:2.0:1788639095.619667:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 34 00000100:00100000:2.0:1788639095.619677:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36e148000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+14:10525:x1875523754023808:12345-192.168.206.18@tcp:101:rm.0 00010000:00010000:2.0:1788639095.619696:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639095.619717:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262c380 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85469 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788639095.619816:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788639095.619977:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262c380 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85469 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639095.619993:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae242381800) 00010000:00010000:2.0:1788639095.619996:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788639095.620002:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262c380 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85469 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639095.620025:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78be00, rc 0) 00000100:00100000:2.0:1788639095.620093:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36e148000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+15:10525:x1875523754023808:12345-192.168.206.18@tcp:101:rm.0 Request processed in 418us (11023us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1788639095.620101:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 34 00000100:00100000:1.0:1788639095.627005:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639095.627219:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754023936 00000100:00100000:0.0:1788639095.627228:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754023936 00000100:00100000:0.0:1788639095.627314:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 3 00000100:00100000:0.0:1788639095.627326:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36e14aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+15:10525:x1875523754023936:12345-192.168.206.18@tcp:37:rm.0 00000100:00100000:0.0:1788639095.633541:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36e14aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+15:10525:x1875523754023936:12345-192.168.206.18@tcp:37:rm.0 Request processed in 6208us (6536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639095.633554:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 3 00000100:00100000:2.0:1788639095.639551:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639095.639645:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754024192 00000100:00100000:3.0:1788639095.639654:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754024192 00000100:00100000:3.0:1788639095.639707:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 4 00000100:00100000:3.0:1788639095.639716:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ef5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+15:10525:x1875523754024192:12345-192.168.206.18@tcp:35:rm.0 00000100:00100000:3.0:1788639095.639920:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ef5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+16:10525:x1875523754024192:12345-192.168.206.18@tcp:35:rm.0 Request processed in 204us (376us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788639095.639929:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 4 00000100:00100000:1.0:1788639095.667534:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639095.667767:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754024448 00000100:00100000:3.0:1788639095.667778:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754024448 00000100:00100000:3.0:1788639095.667840:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 35 00000100:00100000:3.0:1788639095.667849:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36e149880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+16:10525:x1875523754024448:12345-192.168.206.18@tcp:101:rm.0 00010000:00010000:3.0:1788639095.667872:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639095.668161:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c38e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85470 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.668279:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a200/0x25c454990262c395 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.668303:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a200/0x25c454990262c395 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.668316:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a200/0x25c454990262c395 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788639095.668327:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788639095.668443:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c38e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85470 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.668483:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a200/0x25c454990262c395 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85470 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.668492:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ae242381a00) 00010000:00010000:3.0:1788639095.668495:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788639095.668498:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae38217a200, rc 0) 00000100:00100000:3.0:1788639095.669111:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36e149880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+18:10525:x1875523754024448:12345-192.168.206.18@tcp:101:rm.0 Request processed in 1155us (1477us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788639095.669120:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 35 00000100:00100000:1.0:1788639095.680012:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639095.680139:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754024576 00000100:00100000:0.0:1788639095.680148:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754024576 00000100:00100000:0.0:1788639095.680204:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 36 00000100:00100000:0.0:1788639095.680215:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36e14b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+18:10525:x1875523754024576:12345-192.168.206.18@tcp:41:rm.0 00000004:00000024:0.0:1788639095.680336:0:10169:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:0.0:1788639095.680411:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36e14b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+18:10525:x1875523754024576:12345-192.168.206.18@tcp:41:rm.0 Request processed in 197us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639095.680418:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 36 00000100:00100000:2.0:1788639095.689136:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639095.689256:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754024704 00000100:00100000:3.0:1788639095.689382:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754024704 00000100:00100000:3.0:1788639095.689446:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 37 00000100:00100000:3.0:1788639095.689456:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+18:10525:x1875523754024704:12345-192.168.206.18@tcp:101:rm.0 00010000:00010000:3.0:1788639095.689477:0:11314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639095.689831:0:11314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c3a3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85477 expref: -99 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.689979:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c3aa lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.690052:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c3aa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.690064:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c3aa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.690075:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217aa00/0x25c454990262c3b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.690094:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217aa00/0x25c454990262c3b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.690100:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217aa00/0x25c454990262c3b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.690215:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae341480600/0x25c454990262c3b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.690223:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae341480600/0x25c454990262c3b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.690229:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae341480600/0x25c454990262c3b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788639095.690393:0:11314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788639095.690398:0:11314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788639095.690416:0:11314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae341480600/0x25c454990262c3b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.690427:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae341480600/0x25c454990262c3b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.690434:0:11314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c3aa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.690439:0:11314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c3aa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.690445:0:11314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c3aa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.690459:0:11314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae38217b800 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639095.690463:0:11314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c3aa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.690470:0:11314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c3aa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.690480:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ae242381a00) 00010000:00010000:3.0:1788639095.690846:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639095.690852:0:11314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c3aa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.690858:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c3aa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.690874:0:11314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217aa00/0x25c454990262c3b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.690879:0:11314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217aa00/0x25c454990262c3b1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.690951:0:11314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217aa00/0x25c454990262c3b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.690955:0:11314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae38217aa00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639095.690958:0:11314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217aa00/0x25c454990262c3b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.690964:0:11314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217aa00/0x25c454990262c3b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.690981:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xe19035d1 (ffff9ae375d62900) 00010000:00010000:3.0:1788639095.690983:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639095.690986:0:11314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217aa00/0x25c454990262c3b1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.690991:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217aa00/0x25c454990262c3b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.691203:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c3a3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85477 expref: 20 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.691217:0:11314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae341480600/0x25c454990262c3b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85477 expref: 19 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.691224:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9ae350c03c00) 00010000:00010000:3.0:1788639095.691226:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788639095.691228:0:11314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae341480600, rc 0) 00000100:00100000:3.0:1788639095.691411:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+19:10525:x1875523754024704:12345-192.168.206.18@tcp:101:rm.0 Request processed in 1955us (2282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639095.691419:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 37 00000100:00100000:1.0:1788639095.699045:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639095.699268:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754024960 00000100:00100000:3.0:1788639095.699287:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754024960 00000100:00100000:3.0:1788639095.699402:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 38 00000100:00100000:3.0:1788639095.699424:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36e14ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+19:10525:x1875523754024960:12345-192.168.206.18@tcp:36:rm.0 00010000:00010000:3.0:1788639095.699503:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788639095.699540:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae341480600/0x25c454990262c3b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85477 expref: 19 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.699607:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217be00/0x25c454990262c364 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8545b expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.699683:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9ae350c03c00) 00010000:00010000:3.0:1788639095.699697:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031c00/0x25c454990262c379 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85462 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.699720:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ae242381a00) 00010000:00010000:3.0:1788639095.699725:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788639095.699758:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae341480800/0x25c454990262c3bf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.699775:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae341480800/0x25c454990262c3bf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.699786:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae341480800/0x25c454990262c3bf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.699799:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c3c6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.699806:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c3c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.699813:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c3c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.699939:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217aa00/0x25c454990262c3cd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.699959:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217aa00/0x25c454990262c3cd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.699966:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217aa00/0x25c454990262c3cd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788639095.701932:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1788639095.701949:0:6516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 354496332520ns, next at 355496329101ns, rc = 0 00010000:00010000:3.0:1788639095.702851:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c3d4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.702878:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c3d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.702892:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c3d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.702901:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c3d4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.702908:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c3d4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.702914:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c3d4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.702953:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788639095.703162:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217aa00/0x25c454990262c3cd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.703169:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217aa00/0x25c454990262c3cd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.703197:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217aa00/0x25c454990262c3cd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.703204:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae38217aa00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639095.703208:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217aa00/0x25c454990262c3cd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.703218:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217aa00/0x25c454990262c3cd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.703234:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9ae350c03c00) 00010000:00010000:3.0:1788639095.703237:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788639095.703243:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217aa00/0x25c454990262c3cd lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.703250:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217aa00/0x25c454990262c3cd lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.703279:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae341480800/0x25c454990262c3bf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.703286:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae341480800/0x25c454990262c3bf lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.703293:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae341480800/0x25c454990262c3bf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.703299:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae341480800 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639095.703302:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae341480800/0x25c454990262c3bf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.703320:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae341480800/0x25c454990262c3bf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.703329:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ae242381a00) 00010000:00010000:3.0:1788639095.703332:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639095.703335:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae341480800/0x25c454990262c3bf lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.703341:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae341480800/0x25c454990262c3bf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788639095.703515:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000029c1c761 reply state 000000005dfe0655 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c3c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.703530:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c3c6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639095.703537:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xe19035d1 (ffff9ae375d62900) 00010000:00010000:3.0:1788639095.703540:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788639095.703544:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788639095.703825:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788639095.703835:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c3d4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639095.703842:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae38217b800 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:2.0:1788639095.703855:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c3d4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639095.703862:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c3d4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639095.703873:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9ae350c03c00) 00010000:00010000:2.0:1788639095.703875:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788639095.703878:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c3d4 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639095.703884:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c3d4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639095.703899:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639095.703901:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639095.703903:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639095.704251:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36e14ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+18:10525:x1875523754024960:12345-192.168.206.18@tcp:36:rm.0 Request processed in 4820us (5205us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788639095.704262:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 38 00000100:00100000:1.0:1788639095.714230:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639095.714361:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754025216 00000100:00100000:0.0:1788639095.714377:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754025216 00000100:00100000:0.0:1788639095.714870:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 5 00000100:00100000:0.0:1788639095.714884:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36e14bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+18:10525:x1875523754025216:12345-192.168.206.18@tcp:35:rm.0 00000100:00100000:0.0:1788639095.715326:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36e14bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+19:10525:x1875523754025216:12345-192.168.206.18@tcp:35:rm.0 Request processed in 444us (1108us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788639095.715335:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 5 00000100:00100000:2.0:1788639095.721182:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639095.721295:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754025472 00000100:00100000:0.0:1788639095.721310:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754025472 00000100:00100000:0.0:1788639095.721434:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 39 00000100:00100000:0.0:1788639095.721447:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+19:10525:x1875523754025472:12345-192.168.206.18@tcp:36:rm.0 00010000:00010000:0.0:1788639095.721522:0:10169:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788639095.721556:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a200/0x25c454990262c395 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85470 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.721596:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b600/0x25c454990262c333 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8544d expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.721610:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ae242381a00) 00010000:00010000:0.0:1788639095.721678:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030400/0x25c454990262c2f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8543f expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.721688:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae242381800) 00010000:00010000:0.0:1788639095.721694:0:10169:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788639095.722689:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031800/0x25c454990262c3db lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.722713:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031800/0x25c454990262c3db lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.722747:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031800/0x25c454990262c3db lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.722763:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031000/0x25c454990262c3e2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.722771:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031000/0x25c454990262c3e2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.722778:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031000/0x25c454990262c3e2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.722885:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030c00/0x25c454990262c3e9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.722894:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030c00/0x25c454990262c3e9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.722901:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030c00/0x25c454990262c3e9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788639095.724308:0:10169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788639095.724342:0:10169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030c00/0x25c454990262c3e9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.724367:0:10169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030c00/0x25c454990262c3e9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.724376:0:10169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030c00/0x25c454990262c3e9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.724382:0:10169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae340030c00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639095.724403:0:10169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030c00/0x25c454990262c3e9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.724413:0:10169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030c00/0x25c454990262c3e9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.724430:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ae375d62400) 00010000:00010000:0.0:1788639095.724433:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788639095.724440:0:10169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030c00/0x25c454990262c3e9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.724447:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030c00/0x25c454990262c3e9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.724484:0:10169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031800/0x25c454990262c3db lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.724492:0:10169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031800/0x25c454990262c3db lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.724498:0:10169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031800/0x25c454990262c3db lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.724503:0:10169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae340031800 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639095.724506:0:10169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031800/0x25c454990262c3db lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.724512:0:10169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031800/0x25c454990262c3db lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.724519:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae375d62f00) 00010000:00010000:0.0:1788639095.724522:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639095.724533:0:10169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031800/0x25c454990262c3db lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.724540:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031800/0x25c454990262c3db lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788639095.724555:0:10169:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000014bdf33f reply state 00000000352520bc transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031000/0x25c454990262c3e2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.724578:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031000/0x25c454990262c3e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639095.724586:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ae375d62d00) 00010000:00010000:0.0:1788639095.724589:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788639095.724592:0:10169:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788639095.724750:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+18:10525:x1875523754025472:12345-192.168.206.18@tcp:36:rm.0 Request processed in 3297us (3575us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788639095.724762:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 39 00010000:00010000:1.0:1788639096.245156:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639097.269201:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639097.525319:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788639097.525383:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772980736:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788639097.525447:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639097.525513:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772980736 00000100:00100000:3.0:1788639097.525520:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772980736 00000100:00100000:3.0:1788639097.525594:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788639097.525603:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772980736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788639097.525656:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788639097.525698:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772980736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639097.525705:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1788639097.525723:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788639097.525749:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2432cc380 x1875523772980736/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639113 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639097.525767:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772980736:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788639097.526291:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae360687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875523772980992:0@lo:400:kworker.0 00000100:00100000:3.0:1788639097.526325:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639097.526345:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243152d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875523772981504:0@lo:400:kworker.0 00000100:00100000:3.0:1788639097.526365:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639097.526388:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875523772982016:0@lo:400:kworker.0 00000100:00100000:3.0:1788639097.526407:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639097.526423:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788639097.526428:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01f1eef9-e690-4065-bf99-bf821af7b626:3644:1875523772980864:0@lo:400:kworker.0 00000100:00100000:3.0:1788639097.526451:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639097.526468:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243153800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772981376:0@lo:400:kworker.0 00000100:00100000:3.0:1788639097.526525:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639097.526544:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772981888:0@lo:400:kworker.0 00000100:00100000:3.0:1788639097.526579:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639097.526606:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772980992 00000100:00100000:3.0:1788639097.526610:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772980992 00000100:00100000:3.0:1788639097.526659:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772981504 00000100:00100000:3.0:1788639097.526662:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772981504 00000100:00100000:3.0:1788639097.526697:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772982016 00000100:00100000:3.0:1788639097.526700:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772982016 00000100:00100000:3.0:1788639097.526714:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788639097.526720:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2433a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875523772980992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639097.526758:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2433a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875523772980992:12345-0@lo:400:kworker.0 Request processed in 38us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639097.526764:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788639097.526777:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788639097.526782:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2433a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875523772981504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639097.526804:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2433a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875523772981504:12345-0@lo:400:kworker.0 Request processed in 23us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639097.526810:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788639097.526819:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788639097.526824:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2433a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875523772982016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639097.526845:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2433a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875523772982016:12345-0@lo:400:kworker.0 Request processed in 21us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639097.526850:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788639097.526871:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772980864 00000100:00100000:3.0:1788639097.526875:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772980864 00000100:00100000:3.0:1788639097.526897:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1788639097.526902:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+24:3644:x1875523772980864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639097.526928:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+24:3644:x1875523772980864:12345-0@lo:400:kworker.0 Request processed in 26us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639097.526934:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1788639097.526958:0:12414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772981376 00000100:00100000:3.0:1788639097.526962:0:12414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772981376 00000100:00100000:3.0:1788639097.526985:0:12414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788639097.526998:0:12414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2433a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772981376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639097.527030:0:12414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2433a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772981376:12345-0@lo:400:kworker.0 Request processed in 33us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639097.527036:0:12414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788639097.527054:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772981888 00000100:00100000:3.0:1788639097.528171:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772981888 00000100:00100000:3.0:1788639097.528288:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788639097.528298:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2433a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772981888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639097.528350:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2433a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772981888:12345-0@lo:400:kworker.0 Request processed in 54us (1770us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639097.528357:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1788639097.533613:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788639097.533636:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788639097.533659:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243150a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523772981248:0@lo:400:kworker.0 00000100:00100000:2.0:1788639097.533724:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639097.533763:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772981760:0@lo:400:kworker.0 00000100:00100000:2.0:1788639097.533785:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639097.533802:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2433a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772982272:0@lo:400:kworker.0 00000100:00100000:2.0:1788639097.533819:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639097.533838:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788639097.533844:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242f0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772981120:0@lo:400:kworker.0 00000100:00100000:2.0:1788639097.533902:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639097.533934:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875523772981632:0@lo:400:kworker.0 00000100:00100000:2.0:1788639097.533955:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639097.533980:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2433a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875523772982144:0@lo:400:kworker.0 00000100:00100000:2.0:1788639097.534013:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639097.534156:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772981248 00000100:00100000:0.0:1788639097.534164:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772981248 00000100:00100000:0.0:1788639097.534213:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772981632 00000100:00100000:0.0:1788639097.534216:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772981632 00000100:00100000:2.0:1788639097.534379:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772982144 00000100:00100000:2.0:1788639097.534384:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772982144 00000100:00100000:0.0:1788639097.534434:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788639097.534444:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523772981248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639097.534508:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523772981248:12345-0@lo:400:kworker.0 Request processed in 66us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639097.534515:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788639097.534530:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788639097.534592:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772981760 00000100:00100000:3.0:1788639097.534597:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772981760 00000100:00100000:3.0:1788639097.534636:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772981120 00000100:00100000:3.0:1788639097.534640:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772981120 00000100:00100000:3.0:1788639097.534683:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788639097.534690:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772981120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639097.534726:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772981120:12345-0@lo:400:kworker.0 Request processed in 37us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639097.534732:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788639097.534775:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01f1eef9-e690-4065-bf99-bf821af7b626:3644:1875523772980864:0@lo:400:kworker.0 00000100:00100000:3.0:1788639097.534788:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243153800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772981376:0@lo:400:kworker.0 00010000:00080000:3.0:1788639097.534802:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2416e6d80 x1875523772981888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639097.534813:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772981888:0@lo:400:kworker.0 00000100:00100000:3.0:1788639097.534839:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae360687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875523772980992:0@lo:400:kworker.0 00000100:00100000:3.0:1788639097.534851:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243152d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875523772981504:0@lo:400:kworker.0 00000100:00100000:3.0:1788639097.534861:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875523772982016:0@lo:400:kworker.0 00000100:00100000:1.0:1788639097.534877:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772982272 00000100:00100000:1.0:1788639097.534881:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772982272 00000100:00100000:2.0:1788639097.535180:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788639097.535187:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875523772982144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639097.535218:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875523772982144:12345-0@lo:400:kworker.0 Request processed in 32us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639097.535224:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788639097.542388:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875523772981632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639097.542501:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875523772981632:12345-0@lo:400:kworker.0 Request processed in 7965us (8544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639097.542526:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00080000:0.0:1788639097.542580:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788639097.542585:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788639097.542588:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788639097.542662:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242f0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772981120:0@lo:400:kworker.0 00010000:00080000:0.0:1788639097.542680:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae243150380 x1875523772981632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639097.542692:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875523772981632:0@lo:400:kworker.0 00010000:00080000:0.0:1788639097.542703:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2433a4700 x1875523772982144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639097.542710:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2433a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875523772982144:0@lo:400:kworker.0 00000100:00100000:0.0:1788639097.542721:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243150a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523772981248:0@lo:400:kworker.0 00000100:00100000:1.0:1788639097.542847:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788639097.542868:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24319b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772981760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639097.542919:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24319b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772981760:12345-0@lo:400:kworker.0 Request processed in 56us (9132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639097.542932:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788639097.542961:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788639097.542967:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24319b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772982272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639097.542998:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24319b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772982272:12345-0@lo:400:kworker.0 Request processed in 32us (9178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639097.543003:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:0.0:1788639097.543106:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2416e5f80 x1875523772981760/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639097.543116:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772981760:0@lo:400:kworker.0 00010000:00080000:0.0:1788639097.543127:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2433a4a80 x1875523772982272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639097.543134:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2433a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772982272:0@lo:400:kworker.0 00000100:00100000:0.0:1788639098.036832:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788639098.036906:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2433a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772982400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788639098.037067:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639098.037240:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e149c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772982528:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788639098.037283:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639098.038076:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772982528 00000100:00100000:1.0:1788639098.038086:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772982528 00000100:00100000:1.0:1788639098.038142:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788639098.038152:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f7c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772982528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788639098.038183:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788639098.038264:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f7c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772982528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639098.038272:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788639098.038924:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e149c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772982528:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788639098.040226:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772982400 00000100:00100000:3.0:1788639098.040236:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772982400 00000100:00100000:3.0:1788639098.040291:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788639098.040300:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f7c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772982400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788639098.040321:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788639098.040793:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f7c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772982400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 494us (3726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639098.040802:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:0.0:1788639098.048870:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2433a6300 x1875523772982400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639114 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639098.048901:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2433a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772982400:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788639098.292831:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639098.549312:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f7c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772982656:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788639098.549398:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639098.549828:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772982656 00000100:00100000:0.0:1788639098.549836:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772982656 00000100:00100000:0.0:1788639098.550004:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788639098.550013:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2433a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772982656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788639098.550045:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788639098.550253:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2433a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772982656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 241us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639098.550261:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788639098.550399:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f7c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772982656:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788639098.850201:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639098.850261:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639098.850296:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639098.850322:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639098.850346:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639098.850541:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754025856 00000100:00100000:3.0:1788639098.850563:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754025856 00000100:00100000:3.0:1788639098.850673:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754026112 00000100:00100000:3.0:1788639098.850677:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754026112 00000100:00100000:3.0:1788639098.850701:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754025728 00000100:00100000:3.0:1788639098.850704:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754025728 00000100:00100000:3.0:1788639098.850737:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 201 00000100:00100000:3.0:1788639098.850749:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36e149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2405:x1875523754025856:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639098.850845:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36e149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2405:x1875523754025856:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 98us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639098.850853:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 201 00000100:00100000:3.0:1788639098.850883:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 202 00000100:00100000:3.0:1788639098.850889:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36e148380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2405:x1875523754026112:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639098.850918:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36e148380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2405:x1875523754026112:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 30us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639098.850924:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 202 00000100:00100000:3.0:1788639098.850938:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 203 00000100:00100000:3.0:1788639098.850944:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36e149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+18:2405:x1875523754025728:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639098.850974:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36e149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+18:2405:x1875523754025728:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 30us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639098.850980:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 203 00000100:00100000:3.0:1788639098.851028:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754025984 00000100:00100000:3.0:1788639098.851032:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754025984 00000100:00100000:3.0:1788639098.851077:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 85 00000100:00100000:3.0:1788639098.851083:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36e14aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2405:x1875523754025984:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639098.851596:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754025600 00000100:00100000:0.0:1788639098.851609:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754025600 00000100:00100000:0.0:1788639098.851701:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 334 00000100:00100000:0.0:1788639098.851710:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+13:2405:x1875523754025600:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639098.851783:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+13:2405:x1875523754025600:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 74us (1596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639098.851792:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 334 00000100:00080000:0.0:1788639098.851828:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788639098.851835:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788639098.851838:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788639098.851866:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639098.851985:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754026240 00000100:00100000:0.0:1788639098.852002:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754026240 00000100:00100000:0.0:1788639098.852063:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 204 00000100:00100000:0.0:1788639098.852070:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2405:x1875523754026240:12345-192.168.206.18@tcp:400:kworker.0 00000100:00080000:2.0:1788639098.852125:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788639098.853517:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36e14aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2405:x1875523754025984:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 2425us (3160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639098.853532:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 85 00000100:00100000:0.0:1788639098.857395:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2405:x1875523754026240:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 5314us (5522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639098.857779:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 204 00010000:00010000:3.0:1788639099.318601:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788639099.724334:0:13679:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000004:00080000:1.0:1788639100.085071:0:8828:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 358879451574ns, next at 359879448507ns, rc = 0 00000100:00100000:0.0:1788639100.085299:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f815500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772982912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788639100.085451:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639100.085606:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772982912 00000100:00100000:1.0:1788639100.085648:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772982912 00000100:00100000:1.0:1788639100.085724:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788639100.085735:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f7c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772982912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788639100.085771:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788639100.085911:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f7c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772982912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 177us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639100.085920:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:1.0:1788639100.085976:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae37f815500 x1875523772982912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639116 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639100.085980:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788639100.085998:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242ed5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772982784:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788639100.086005:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f815500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772982912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788639100.086232:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788639100.086259:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788639100.086561:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772982784 00000100:00100000:1.0:1788639100.086567:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772982784 00000100:00100000:1.0:1788639100.086679:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788639100.086688:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772982784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788639100.086707:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788639100.086756:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772982784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639100.086763:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:2.0:1788639100.086806:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae242ed5180 x1875523772982784/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639116 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639100.086827:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242ed5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772982784:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788639100.086928:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788639100.341066:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788639100.648331:0:13727:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe404b7aa0 20000000:00000080:2.0:1788639100.648348:0:13727:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ae3412ebc00 uarg=0000000000000000 20000000:01000000:2.0:1788639100.648386:0:13727:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788639100.648392:0:13727:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788639100.648396:0:13727:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1788639100.648985:0:13728:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1788639100.649381:0:13727:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1788639100.653980:0:13727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1788639100.658673:0:13727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1788639100.658727:0:13727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1788639100.658747:0:13727:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788639100.658768:0:13727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ae38217be00/0x25c454990262c3f0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639100.658787:0:13727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae38217ba00/0x25c454990262c27d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8542a expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639100.658804:0:13727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae242f22e00/0x25c454990262c284 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85431 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639100.658813:0:13727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae38217a400/0x25c454990262c292 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c28b expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639100.658820:0:13727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae38217a800/0x25c454990262c2a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c299 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639100.658827:0:13727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae242f23e00/0x25c454990262c2ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c2a7 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639100.658833:0:13727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae242f22800/0x25c454990262c2bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c2b5 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639100.658840:0:13727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ae38217be00/0x25c454990262c3f0 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639100.658881:0:13727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae242f22800/0x25c454990262c2bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262c2b5 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639100.658897:0:13727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ae242f22800/0x25c454990262c2bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262c2b5 expref: 23 pid: 6510 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639100.658911:0:13727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2433a5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13727:1875523772983040:0@lo:104: 00000100:00100000:3.0:1788639100.658979:0:13727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788639100.659657:0:13727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae242f23e00/0x25c454990262c2ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262c2a7 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639100.659680:0:13727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ae242f23e00/0x25c454990262c2ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262c2a7 expref: 23 pid: 6511 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639100.659690:0:13727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2433a5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13727:1875523772983168:0@lo:104: 00000004:00080000:0.0:1788639100.659699:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00010000:00010000:3.0:1788639100.659730:0:13727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae38217a800/0x25c454990262c2a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262c299 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788639100.659731:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00010000:00010000:3.0:1788639100.659738:0:13727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ae38217a800/0x25c454990262c2a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262c299 expref: 23 pid: 6511 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788639100.659740:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:3.0:1788639100.659746:0:13727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2433a7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13727:1875523772983296:0@lo:104: 00010000:00010000:3.0:1788639100.659768:0:13727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae38217a400/0x25c454990262c292 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262c28b expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639100.659776:0:13727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ae38217a400/0x25c454990262c292 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262c28b expref: 23 pid: 6511 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639100.659782:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031200/0x25c454990262c348 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639100.659783:0:13727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2433a6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13727:1875523772983424:0@lo:104: 00010000:00010000:0.0:1788639100.659790:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031200/0x25c454990262c348 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639100.659797:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031200/0x25c454990262c348 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639100.659803:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae340031200 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639100.659805:0:13727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae242f22e00/0x25c454990262c284 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85431 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639100.659807:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031200/0x25c454990262c348 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639100.659815:0:13727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae242f22e00/0x25c454990262c284 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85431 expref: 12 pid: 6510 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639100.659816:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031200/0x25c454990262c348 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639100.659824:0:13727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2433a5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13727:1875523772983552:192.168.206.18@tcp:104: 00010000:00010000:0.0:1788639100.659832:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xe19035d1 (ffff9ae375d62900) 00010000:00010000:0.0:1788639100.659835:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639100.659846:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031200/0x25c454990262c348 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639100.659852:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031200/0x25c454990262c348 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639100.659865:0:13727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae38217ba00/0x25c454990262c27d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8542a expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639100.659883:0:13727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae38217ba00/0x25c454990262c27d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8542a expref: 12 pid: 6508 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639100.659885:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c35d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639100.659892:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c35d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639100.659893:0:13727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2433a7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13727:1875523772983680:192.168.206.18@tcp:104: 00010000:00010000:0.0:1788639100.659898:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c35d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639100.659903:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fac00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639100.659906:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c35d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639100.659911:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c35d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639100.659920:0:13727:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2430ef480 going to sleep for 11 seconds 00010000:00010000:0.0:1788639100.659920:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9ae350c03c00) 00010000:00010000:0.0:1788639100.659922:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639100.659925:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c35d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639100.659930:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c35d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639100.659947:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c3c6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639100.660049:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788639100.660068:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242ed5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772983808:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788639100.660101:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639100.660135:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772983808 00000100:00100000:2.0:1788639100.660142:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772983808 00000100:00100000:2.0:1788639100.660186:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788639100.660194:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772983808:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788639100.660218:0:8829:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00010000:00010000:0.0:1788639100.660257:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c3c6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788639100.660259:0:8829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a9c7778, atime: 0x6a9c7778, ctime: 0x6a9c7778, blocks: 0x0 00010000:00010000:0.0:1788639100.660264:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c3c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639100.660265:0:8829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f1f1f62/0x25c454990262c3f7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639100.660278:0:8829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=359s v=(0 0) 00010000:00010000:2.0:1788639100.660283:0:8829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788639100.660288:0:8829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f1f1f62/0x25c454990262c3f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639100.660305:0:8829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f1f1f62/0x25c454990262c3f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639100.660313:0:8829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f1f1f62/0x25c454990262c3f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639100.660321:0:8829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f1f1f62/0x25c454990262c3f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639100.660333:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae38217b000 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639100.660337:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c3c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639100.660338:0:8829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788639100.660343:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c3c6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639100.660352:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xe19035d1 (ffff9ae375d62900) 00010000:00010000:0.0:1788639100.660354:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639100.660357:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c3c6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639100.660362:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c3c6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xe19035d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639100.660396:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031000/0x25c454990262c3e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639100.660402:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031000/0x25c454990262c3e2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639100.660407:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031000/0x25c454990262c3e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639100.660412:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae340031000 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639100.660421:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031000/0x25c454990262c3e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639100.660427:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031000/0x25c454990262c3e2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639100.660434:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ae375d62d00) 00010000:00010000:0.0:1788639100.660437:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639100.660439:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031000/0x25c454990262c3e2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639100.660445:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031000/0x25c454990262c3e2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639100.660481:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3643:x1875523772983808:12345-0@lo:6:osp-syn-0-0.0 Request processed in 287us (378us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788639100.660494:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:0.0:1788639100.660501:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ae242ed5180/2, rc 0, transno 4294967301 00000100:00100000:0.0:1788639100.660506:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242ed5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772983808:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788639100.660528:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788639100.660534:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f1f1f62/0x25c454990262c3f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639100.660555:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78b600 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:2.0:1788639100.660559:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f1f1f62/0x25c454990262c3f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639100.660571:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f1f1f62/0x25c454990262c3f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639100.660584:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f1f1f62/0x25c454990262c3f7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639100.660589:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f1f1f62/0x25c454990262c3f7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639100.660609:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639100.660611:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639100.660612:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639100.660978:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788639100.661002:0:6499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639100.661023:0:6499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639100.661033:0:6499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639100.661041:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772983040 00000100:00100000:1.0:1788639100.661046:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772983040 00000100:00100000:1.0:1788639100.661069:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772983168 00000100:00100000:1.0:1788639100.661072:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772983168 00000100:00100000:1.0:1788639100.661081:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772983296 00000100:00100000:1.0:1788639100.661083:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772983296 00000100:00100000:1.0:1788639100.661091:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772983424 00000100:00100000:1.0:1788639100.661094:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772983424 00000100:00100000:1.0:1788639100.661104:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788639100.661110:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f58850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+6:13727:x1875523772983040:12345-0@lo:104: 00010000:00010000:1.0:1788639100.661132:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae242f22200/0x25c454990262c2b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262c2bc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639100.661188:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788639100.661194:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f58850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+6:13727:x1875523772983040:12345-0@lo:104: Request processed in 84us (2216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639100.661201:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788639100.661236:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788639100.661312:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f815500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+5:13727:x1875523772983168:12345-0@lo:104: 00010000:00010000:1.0:1788639100.661321:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae242f22400/0x25c454990262c2a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262c2ae expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639100.661359:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788639100.661363:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f815500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+5:13727:x1875523772983168:12345-0@lo:104: Request processed in 123us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639100.661369:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788639100.661381:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788639100.661386:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f817800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+4:13727:x1875523772983296:12345-0@lo:104: 00010000:00010000:1.0:1788639100.661393:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae38217a600/0x25c454990262c299 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262c2a0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639100.661423:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788639100.661428:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f817800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+4:13727:x1875523772983296:12345-0@lo:104: Request processed in 42us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639100.661433:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788639100.661443:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788639100.661449:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f816680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+3:13727:x1875523772983424:12345-0@lo:104: 00010000:00010000:1.0:1788639100.661463:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa600/0x25c454990262c28b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262c292 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639100.661792:0:9520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788639100.661799:0:9520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae242f22200/0x25c454990262c2b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262c2bc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639100.661806:0:9520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f22200 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:2.0:1788639100.661809:0:9520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae242f22200/0x25c454990262c2b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262c2bc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639100.661824:0:9520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae242f22200/0x25c454990262c2b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262c2bc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788639100.661831:0:9520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae242f22200/0x25c454990262c2b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262c2bc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788639100.661837:0:9520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788639100.661868:0:9520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae242f22200/0x25c454990262c2b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c2bc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639100.661875:0:9520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788639100.661893:0:9520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae242f22200/0x25c454990262c2b5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c2bc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639100.661900:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae242f22200/0x25c454990262c2b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c2bc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639100.661910:0:9520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788639100.661913:0:9520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae242f22400/0x25c454990262c2a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262c2ae expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639100.661919:0:9520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f22400 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:2.0:1788639100.661921:0:9520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae242f22400/0x25c454990262c2a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262c2ae expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639100.661927:0:9520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae242f22400/0x25c454990262c2a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262c2ae expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788639100.661933:0:9520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae242f22400/0x25c454990262c2a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262c2ae expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788639100.661945:0:9520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788639100.661960:0:9520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae242f22400/0x25c454990262c2a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c2ae expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639100.661966:0:9520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788639100.661973:0:9520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae242f22400/0x25c454990262c2a7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c2ae expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639100.661980:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae242f22400/0x25c454990262c2a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c2ae expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639100.661989:0:9520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788639100.661992:0:9520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae38217a600/0x25c454990262c299 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262c2a0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639100.661998:0:9520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae38217a600 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:2.0:1788639100.662000:0:9520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae38217a600/0x25c454990262c299 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262c2a0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639100.662006:0:9520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae38217a600/0x25c454990262c299 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262c2a0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788639100.662011:0:9520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae38217a600/0x25c454990262c299 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262c2a0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788639100.662016:0:9520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788639100.662028:0:9520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae38217a600/0x25c454990262c299 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c2a0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639100.662033:0:9520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788639100.662050:0:9520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae38217a600/0x25c454990262c299 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c2a0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639100.662057:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae38217a600/0x25c454990262c299 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c2a0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639100.662067:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639100.662068:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639100.662070:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639100.662115:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242ed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772983936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788639100.662152:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639100.662186:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788639100.662191:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242ed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772984064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788639100.662212:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639100.662237:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772983936 00000100:00100000:2.0:1788639100.662242:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772983936 00010000:00010000:2.0:1788639100.662281:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae242f22800/0x25c454990262c2bc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262c2b5 expref: 24 pid: 6510 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639100.662301:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772984064 00000100:00100000:2.0:1788639100.662304:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772984064 00010000:00010000:2.0:1788639100.662317:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae242f23e00/0x25c454990262c2ae lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262c2a7 expref: 25 pid: 6511 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639100.662329:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788639100.662335:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+25:3641:x1875523772983936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788639100.662345:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788639100.662350:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae242f22800/0x25c454990262c2bc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262c2b5 expref: 25 pid: 6510 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639100.662371:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae242f22800/0x25c454990262c2bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262c2b5 expref: 25 pid: 6510 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639100.662422:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788639100.662454:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+25:3641:x1875523772983936:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639100.662461:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788639100.662477:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788639100.662482:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+24:3641:x1875523772984064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788639100.662490:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788639100.662506:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae242f23e00/0x25c454990262c2ae lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262c2a7 expref: 24 pid: 6511 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639100.662514:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae242f23e00/0x25c454990262c2ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262c2a7 expref: 24 pid: 6511 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639100.662523:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788639100.662555:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+24:3641:x1875523772984064:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639100.662561:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:0.0:1788639100.662582:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639100.662592:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242ed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772984064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788639100.662597:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242ed5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523772984192:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788639100.662600:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242ed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772983936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788639100.662638:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788639100.662648:0:13727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae242f22800/0x25c454990262c2bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262c2b5 expref: 23 pid: 6510 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639100.662658:0:13727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2433a5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13727:1875523772983040:0@lo:104: 00000100:00100000:0.0:1788639100.662670:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772984192 00000100:00100000:0.0:1788639100.662672:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772984192 00010000:00010000:2.0:1788639100.662676:0:13727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae242f23e00/0x25c454990262c2ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262c2a7 expref: 23 pid: 6511 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639100.662685:0:13727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2433a5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13727:1875523772983168:0@lo:104: 00010000:00010000:0.0:1788639100.662685:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae38217a800/0x25c454990262c2a0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262c299 expref: 22 pid: 6511 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639100.662693:0:13727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2433a7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13727:1875523772983296:0@lo:104: 00000100:00100000:0.0:1788639100.662698:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788639100.662700:0:13727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2433a6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13727:1875523772983424:0@lo:104: 00000100:00100000:0.0:1788639100.662703:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f7c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+22:3643:x1875523772984192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788639100.662710:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788639100.662713:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae38217a800/0x25c454990262c2a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262c299 expref: 22 pid: 6511 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639100.662731:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae38217a800/0x25c454990262c2a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262c299 expref: 22 pid: 6511 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639100.662742:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae38217a800/0x25c454990262c2a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262c299 expref: 22 pid: 6511 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639100.662750:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788639100.662768:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788639100.662775:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f816680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01f1eef9-e690-4065-bf99-bf821af7b626+3:13727:x1875523772983424:12345-0@lo:104: Request processed in 1326us (1740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639100.662777:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f7c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+21:3643:x1875523772984192:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639100.662782:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788639100.662783:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788639100.662806:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242ed5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523772984192:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788639100.662905:0:9519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788639100.662909:0:9519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa600/0x25c454990262c28b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262c292 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639100.662916:0:9519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fa600 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:1.0:1788639100.662931:0:9519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa600/0x25c454990262c28b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262c292 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639100.662940:0:9519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa600/0x25c454990262c28b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262c292 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788639100.662947:0:9519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa600/0x25c454990262c28b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262c292 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788639100.662951:0:9519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788639100.662976:0:9519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa600/0x25c454990262c28b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c292 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639100.662982:0:9519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788639100.662991:0:9519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa600/0x25c454990262c28b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c292 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639100.662997:0:9519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae3750fa600/0x25c454990262c28b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262c292 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639100.663016:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639100.663017:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639100.663019:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639100.663159:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01f1eef9-e690-4065-bf99-bf821af7b626:3644:1875523772984320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788639100.663188:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639100.663228:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772984320 00000100:00100000:3.0:1788639100.663232:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772984320 00010000:00010000:3.0:1788639100.663247:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae38217a400/0x25c454990262c292 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262c28b expref: 21 pid: 6511 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639100.663267:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788639100.663273:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2433a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01f1eef9-e690-4065-bf99-bf821af7b626+21:3644:x1875523772984320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788639100.663281:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639100.663284:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae38217a400/0x25c454990262c292 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262c28b expref: 21 pid: 6511 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639100.663294:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae38217a400/0x25c454990262c292 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262c28b expref: 21 pid: 6511 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639100.663307:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae38217a400/0x25c454990262c292 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262c28b expref: 21 pid: 6511 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639100.663317:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639100.663344:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2433a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01f1eef9-e690-4065-bf99-bf821af7b626+20:3644:x1875523772984320:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639100.663360:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788639100.663388:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01f1eef9-e690-4065-bf99-bf821af7b626:3644:1875523772984320:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788639100.664122:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639100.665501:0:13727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2433a5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13727:1875523772983552:192.168.206.18@tcp:104: 00000100:00100000:3.0:1788639100.665515:0:13727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2433a7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13727:1875523772983680:192.168.206.18@tcp:104: 00010000:00010000:3.0:1788639100.665556:0:13727:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ae38217be00/0x25c454990262c3f0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639100.684506:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639100.684827:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754026368 00000100:00100000:3.0:1788639100.684837:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754026368 00010000:00010000:3.0:1788639100.684873:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae242f22e00/0x25c454990262c284 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85431 expref: 13 pid: 6510 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639100.684919:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 50 00000100:00100000:3.0:1788639100.684928:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f817480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1343f14-ed5c-4943-b596-61180b04fa87+13:2408:x1875523754026368:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788639100.684943:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639100.684949:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae242f22e00/0x25c454990262c284 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85431 expref: 13 pid: 6510 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639100.684964:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae242f22e00/0x25c454990262c284 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85431 expref: 13 pid: 6510 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639100.684982:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae242f22e00/0x25c454990262c284 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85431 expref: 13 pid: 6510 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639100.684997:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639100.685138:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f817480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d1343f14-ed5c-4943-b596-61180b04fa87+12:2408:x1875523754026368:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 210us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639100.685168:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 50 00000100:00100000:1.0:1788639100.685389:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639100.685515:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754026496 00000100:00100000:0.0:1788639100.685521:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754026496 00010000:00010000:0.0:1788639100.685551:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae38217ba00/0x25c454990262c27d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8542a expref: 12 pid: 6508 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639100.685584:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 51 00000100:00100000:0.0:1788639100.685593:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f814380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1343f14-ed5c-4943-b596-61180b04fa87+12:2408:x1875523754026496:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788639100.685603:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788639100.685608:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae38217ba00/0x25c454990262c27d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8542a expref: 12 pid: 6508 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639100.685641:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae38217ba00/0x25c454990262c27d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8542a expref: 12 pid: 6508 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639100.685654:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae38217ba00/0x25c454990262c27d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8542a expref: 12 pid: 6508 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639100.685680:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ae38217be00/0x25c454990262c3f0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639100.685691:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae38217be00/0x25c454990262c3f0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639100.685705:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae38217be00/0x25c454990262c3f0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639100.685712:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae38217be00/0x25c454990262c3f0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639100.685719:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ae38217be00/0x25c454990262c3f0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639100.685725:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ae38217be00/0x25c454990262c3f0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639100.685731:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae38217be00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639100.685735:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ae38217be00/0x25c454990262c3f0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639100.685743:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ae38217be00/0x25c454990262c3f0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639100.685767:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ae38217be00/0x25c454990262c3f0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639100.685777:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788639100.685823:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f814380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1343f14-ed5c-4943-b596-61180b04fa87+11:2408:x1875523754026496:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 228us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639100.685837:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 51 00010000:00010000:2.0:1788639100.686043:0:13727:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ae38217be00/0x25c454990262c3f0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639100.686052:0:13727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ae38217be00/0x25c454990262c3f0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639100.686058:0:13727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae38217be00/0x25c454990262c3f0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639101.368048:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788639101.567253:0:13776:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdd3bbafc0 20000000:00000080:0.0:1788639101.567341:0:13776:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ae37f792c00 uarg=0000000000000000 20000000:01000000:0.0:1788639101.567587:0:13776:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1788639101.567594:0:13776:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1788639101.567599:0:13776:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:3.0:1788639101.568158:0:13777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:0.0:1788639101.568578:0:13776:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:0.0:1788639101.568748:0:13776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:0.0:1788639101.568783:0:13776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:0.0:1788639101.568799:0:13776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:0.0:1788639101.568811:0:13776:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788639101.568833:0:13776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ae340030400/0x25c454990262c3fe lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639101.568848:0:13776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae340030400/0x25c454990262c3fe lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639101.568859:0:13776:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae340030400/0x25c454990262c3fe lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639101.568866:0:13776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae340030400/0x25c454990262c3fe lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639101.568873:0:13776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ae340030400/0x25c454990262c3fe lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639101.568880:0:13776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ae340030400/0x25c454990262c3fe lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639101.568886:0:13776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae340030400 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639101.568900:0:13776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ae340030400/0x25c454990262c3fe lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639101.568908:0:13776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ae340030400/0x25c454990262c3fe lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639101.568922:0:13776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ae340030400/0x25c454990262c3fe lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639101.568931:0:13776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ae340030400/0x25c454990262c3fe lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639101.568937:0:13776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae340030400/0x25c454990262c3fe lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639101.791928:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639101.792026:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754026624 00000100:00100000:3.0:1788639101.792038:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754026624 00000100:00100000:3.0:1788639101.792100:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 335 00000100:00100000:3.0:1788639101.792112:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+11:6177:x1875523754026624:12345-192.168.206.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788639101.792129:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639101.792148:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae38217a400/0x25c454990262c405 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e8547e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639101.792178:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae38217a400/0x25c454990262c405 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8547e expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639101.792189:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae38217a400/0x25c454990262c405 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8547e expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639101.792197:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae38217a400, rc 0) 00000100:00100000:3.0:1788639101.792271:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+12:6177:x1875523754026624:12345-192.168.206.18@tcp:101:ll_cfg_requeue.0 Request processed in 161us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639101.792279:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 335 00000100:00100000:1.0:1788639101.795211:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639101.795347:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754026752 00000100:00100000:3.0:1788639101.795357:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754026752 00000100:00100000:3.0:1788639101.795415:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 336 00000100:00100000:3.0:1788639101.795426:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+12:6177:x1875523754026752:12345-192.168.206.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788639101.795599:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+12:6177:x1875523754026752:12345-192.168.206.18@tcp:501:ll_cfg_requeue.0 Request processed in 174us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639101.795647:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 336 00000100:00100000:1.0:1788639101.799425:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639101.799500:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754026880 00000100:00100000:0.0:1788639101.799509:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754026880 00000100:00100000:0.0:1788639101.799564:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 337 00000100:00100000:0.0:1788639101.799573:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+12:6177:x1875523754026880:12345-192.168.206.18@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788639101.799714:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+12:6177:x1875523754026880:12345-192.168.206.18@tcp:503:ll_cfg_requeue.0 Request processed in 141us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639101.799721:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 337 00000100:00100000:1.0:1788639101.808312:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639101.808463:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754027008 00000100:00100000:0.0:1788639101.808474:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754027008 00000100:00100000:0.0:1788639101.808544:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 338 00000100:00100000:0.0:1788639101.808555:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+12:10810:x1875523754027008:12345-192.168.206.18@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788639101.808739:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+12:10810:x1875523754027008:12345-192.168.206.18@tcp:502:llog_process_th.0 Request processed in 185us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639101.808757:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 338 00000100:00100000:1.0:1788639101.828707:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639101.831879:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754027136 00000100:00100000:3.0:1788639101.831894:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754027136 00000100:00100000:2.0:1788639101.834653:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 339 00000100:00100000:2.0:1788639101.834667:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+12:10810:x1875523754027136:12345-192.168.206.18@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788639101.834814:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+12:10810:x1875523754027136:12345-192.168.206.18@tcp:502:llog_process_th.0 Request processed in 150us (6113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639101.834822:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 339 00000100:00100000:1.0:1788639101.854501:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639101.855655:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754027264 00000100:00100000:3.0:1788639101.855667:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754027264 00000100:00100000:3.0:1788639101.855726:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 340 00000100:00100000:3.0:1788639101.855736:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+12:6177:x1875523754027264:12345-192.168.206.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788639101.855753:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639101.855771:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae38217aa00/0x25c454990262c40c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85485 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639101.855799:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae38217aa00/0x25c454990262c40c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85485 expref: 13 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639101.855812:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae38217aa00/0x25c454990262c40c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85485 expref: 13 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639101.855821:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae38217aa00, rc 0) 00000100:00100000:3.0:1788639101.855889:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+13:6177:x1875523754027264:12345-192.168.206.18@tcp:101:ll_cfg_requeue.0 Request processed in 154us (1396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639101.855896:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 340 00000100:00100000:1.0:1788639101.859232:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639101.859371:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754027392 00000100:00100000:0.0:1788639101.859381:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754027392 00000100:00100000:0.0:1788639101.859472:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 341 00000100:00100000:0.0:1788639101.859483:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+13:6177:x1875523754027392:12345-192.168.206.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788639101.859652:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+13:6177:x1875523754027392:12345-192.168.206.18@tcp:501:ll_cfg_requeue.0 Request processed in 171us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639101.859659:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 341 00000100:00100000:1.0:1788639101.863214:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639101.864729:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754027520 00000100:00100000:0.0:1788639101.864743:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754027520 00000100:00100000:0.0:1788639101.864808:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 342 00000100:00100000:0.0:1788639101.864819:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+13:6177:x1875523754027520:12345-192.168.206.18@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788639101.864953:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+13:6177:x1875523754027520:12345-192.168.206.18@tcp:503:ll_cfg_requeue.0 Request processed in 135us (1747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639101.864962:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 342 00000100:00100000:1.0:1788639101.872519:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639101.872586:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754027648 00000100:00100000:0.0:1788639101.872597:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754027648 00000100:00100000:0.0:1788639101.872695:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 343 00000100:00100000:0.0:1788639101.872706:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b678850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+13:10814:x1875523754027648:12345-192.168.206.18@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788639101.873171:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b678850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+13:10814:x1875523754027648:12345-192.168.206.18@tcp:502:llog_process_th.0 Request processed in 464us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639101.873180:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 343 00000100:00100000:1.0:1788639101.880438:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639101.880507:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754027776 00000100:00100000:3.0:1788639101.880517:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754027776 00000100:00100000:3.0:1788639101.880586:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 344 00000100:00100000:3.0:1788639101.880597:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b678450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+13:10814:x1875523754027776:12345-192.168.206.18@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788639101.880839:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b678450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+13:10814:x1875523754027776:12345-192.168.206.18@tcp:502:llog_process_th.0 Request processed in 242us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639101.881111:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 344 10000000:01000000:0.0:1788639101.940683:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788639101.940691:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae375f89000 from 7 10000000:01000000:0.0:1788639101.940696:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788639101.940770:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae340030c00/0x25c454990262c413 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639101.940782:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae340030c00/0x25c454990262c413 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639101.940793:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae340030c00/0x25c454990262c413 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639101.940817:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f7c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772984448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788639101.940892:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639101.940961:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788639101.941049:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772984448 00000100:00100000:3.0:1788639101.941058:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772984448 00000100:00100000:3.0:1788639101.941117:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1788639101.941126:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b679850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+20:6513:x1875523772984448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788639101.941141:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639101.941156:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae38217ba00/0x25c454990262c41a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262c413 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639101.941178:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae38217ba00/0x25c454990262c41a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262c413 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639101.941190:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae38217ba00/0x25c454990262c41a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c413 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639101.941199:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae38217ba00, rc 0) 00000100:00100000:3.0:1788639101.941251:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b679850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+21:6513:x1875523772984448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639101.941268:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1788639101.941670:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f7c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772984448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788639101.941686:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae340030c00/0x25c454990262c413 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c41a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639101.941695:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae340030c00/0x25c454990262c413 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262c41a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639101.941754:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f815880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772984576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788639101.941783:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639101.941808:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36a011180 going to sleep for 11 seconds 00000100:00100000:2.0:1788639101.942285:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772984576 00000100:00100000:2.0:1788639101.942291:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772984576 00000100:00100000:2.0:1788639101.942324:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1788639101.942332:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+21:6513:x1875523772984576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788639101.942458:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+21:6513:x1875523772984576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 127us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639101.942478:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1788639101.942862:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f815880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772984576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788639101.942896:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f815880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772984704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788639101.942944:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639101.942975:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36a011180 going to sleep for 11 seconds 00000100:00100000:0.0:1788639101.943073:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772984704 00000100:00100000:0.0:1788639101.943079:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772984704 00000100:00100000:0.0:1788639101.943113:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1788639101.943120:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+21:6513:x1875523772984704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788639101.943213:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+21:6513:x1875523772984704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639101.943220:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1788639101.944808:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f815880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772984704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788639101.945496:0:13790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f815880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:13790:1875523772984832:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788639101.945576:0:13790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639101.945645:0:13790:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36a011e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788639101.945667:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772984832 00000100:00100000:3.0:1788639101.945674:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772984832 00000100:00100000:3.0:1788639101.945777:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1788639101.945788:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b678c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+21:13790:x1875523772984832:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788639101.945899:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b678c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+21:13790:x1875523772984832:12345-0@lo:502:llog_process_th.0 Request processed in 112us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639101.945907:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1788639101.945955:0:13790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f815880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:13790:1875523772984832:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788639101.945978:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788639101.945987:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788639101.945989:0:13790:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788639101.945996:0:13790:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ae375f89000 00000020:00000080:1.0:1788639101.945999:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788639101.946826:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788639101.946843:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788639101.946845:0:13790:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788639101.946856:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788639101.946860:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788639101.946862:0:13790:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788639101.946866:0:13790:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ae375f89000 00000020:00000080:1.0:1788639101.946868:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788639101.955429:0:13790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f815880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:13790:1875523772984960:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788639101.955510:0:13790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639101.955696:0:13790:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36a011e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788639101.956944:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772984960 00000100:00100000:3.0:1788639101.956962:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772984960 00000100:00100000:3.0:1788639101.957024:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1788639101.957035:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b679c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+21:13790:x1875523772984960:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788639101.957180:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b679c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+21:13790:x1875523772984960:12345-0@lo:502:llog_process_th.0 Request processed in 147us (1670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639101.957189:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1788639101.957522:0:13790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f815880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:13790:1875523772984960:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788639101.957567:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788639101.957575:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788639101.957577:0:13790:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788639101.957587:0:13790:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788639101.958648:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1788639101.958683:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788639101.958693:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae340030c00/0x25c454990262c413 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c41a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639101.958703:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae340030c00/0x25c454990262c413 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c41a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639101.958713:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788639101.958715:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae375ea2800 from 7 10000000:01000000:3.0:1788639101.958718:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788639101.958748:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae38217be00/0x25c454990262c421 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639101.958756:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae38217be00/0x25c454990262c421 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639101.958765:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae38217be00/0x25c454990262c421 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639101.958784:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2433a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772985088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788639101.958845:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639101.958890:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2430ef6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788639101.959482:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772985088 00000100:00100000:1.0:1788639101.959490:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772985088 00000100:00100000:1.0:1788639101.959551:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1788639101.959562:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+21:6513:x1875523772985088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788639101.959575:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639101.959590:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae3750fa400/0x25c454990262c428 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262c421 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639101.959632:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae3750fa400/0x25c454990262c428 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262c421 expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639101.959644:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae3750fa400/0x25c454990262c428 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c421 expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639101.959653:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fa400, rc 0) 00000100:00100000:1.0:1788639101.959708:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+22:6513:x1875523772985088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639101.959714:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1788639101.959840:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2433a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772985088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788639101.959864:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae38217be00/0x25c454990262c421 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c428 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639101.959874:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae38217be00/0x25c454990262c421 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262c428 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639101.959934:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f7c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772985216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788639101.959963:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639101.960052:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788639101.963811:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772985216 00000100:00100000:3.0:1788639101.964059:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772985216 00000100:00100000:3.0:1788639101.964154:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1788639101.964166:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+22:6513:x1875523772985216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788639101.964327:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+22:6513:x1875523772985216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 164us (4363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639101.964335:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1788639101.964425:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f7c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772985216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788639101.964474:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f7c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772985344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788639101.964519:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639101.964639:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788639101.964964:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772985344 00000100:00100000:1.0:1788639101.964970:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772985344 00000100:00100000:1.0:1788639101.964997:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1788639101.965005:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b679450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+22:6513:x1875523772985344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788639101.965097:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b679450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+22:6513:x1875523772985344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639101.965104:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1788639101.965191:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f7c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772985344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788639101.965510:0:13793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f7c2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:13793:1875523772985472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788639101.965563:0:13793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639101.965647:0:13793:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788639101.965700:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772985472 00000100:00100000:3.0:1788639101.965704:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772985472 00000100:00100000:1.0:1788639101.965805:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1788639101.965815:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b679050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+22:13793:x1875523772985472:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788639101.966220:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b679050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+22:13793:x1875523772985472:12345-0@lo:502:llog_process_th.0 Request processed in 405us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639101.966228:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1788639101.966369:0:13793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f7c2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:13793:1875523772985472:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788639101.966394:0:13793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788639101.966403:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788639101.966405:0:13793:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788639101.966414:0:13793:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ae375ea2800 00000020:00000080:0.0:1788639101.966416:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788639101.966507:0:13793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788639101.966511:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788639101.966513:0:13793:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788639101.966516:0:13793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788639101.966518:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788639101.966520:0:13793:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788639101.966523:0:13793:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ae375ea2800 00000020:00000080:0.0:1788639101.966526:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000040:00080000:2.0:1788639101.969276:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788639101.972047:0:13793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f7c2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:13793:1875523772985600:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788639101.972123:0:13793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639101.972168:0:13793:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788639101.972241:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772985600 00000100:00100000:3.0:1788639101.972249:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772985600 00000100:00100000:3.0:1788639101.972302:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1788639101.972312:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+22:13793:x1875523772985600:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788639101.972420:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+22:13793:x1875523772985600:12345-0@lo:502:llog_process_th.0 Request processed in 108us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639101.972427:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1788639101.972971:0:13793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f7c2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:13793:1875523772985600:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788639101.973005:0:13793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788639101.973013:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788639101.973015:0:13793:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788639101.973022:0:13793:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788639101.973189:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1788639101.973211:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788639101.973221:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae38217be00/0x25c454990262c421 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c428 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639101.973231:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae38217be00/0x25c454990262c421 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c428 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639101.973241:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788639101.973243:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae3506e9000 from 7 10000000:01000000:3.0:1788639101.973245:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788639101.973271:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae38217a800/0x25c454990262c42f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639101.973288:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae38217a800/0x25c454990262c42f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639101.973298:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae38217a800/0x25c454990262c42f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639101.973312:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2433a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772985728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788639101.973345:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639101.973377:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2430efcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788639101.975939:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772985728 00000100:00100000:0.0:1788639101.975952:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772985728 00000100:00100000:0.0:1788639101.976012:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1788639101.976023:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+22:6513:x1875523772985728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788639101.976038:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639101.976055:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae340031800/0x25c454990262c436 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262c42f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639101.976083:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae340031800/0x25c454990262c436 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262c42f expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639101.976095:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae340031800/0x25c454990262c436 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c42f expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639101.976104:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae340031800, rc 0) 00000100:00100000:0.0:1788639101.976180:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+23:6513:x1875523772985728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (2833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639101.976187:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1788639101.976235:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2433a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772985728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788639101.976252:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae38217a800/0x25c454990262c42f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c436 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639101.976262:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae38217a800/0x25c454990262c42f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262c436 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639101.976343:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f7c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772985856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788639101.976374:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639101.976402:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235a480 going to sleep for 11 seconds 00000100:00100000:0.0:1788639101.976416:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772985856 00000100:00100000:0.0:1788639101.976419:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772985856 00000100:00100000:0.0:1788639101.976441:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1788639101.976447:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+23:6513:x1875523772985856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788639101.976562:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+23:6513:x1875523772985856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639101.976570:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1788639101.976599:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f7c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772985856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788639101.976649:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f7c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772985984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788639101.976686:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639101.976700:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235a480 going to sleep for 11 seconds 00000100:00100000:0.0:1788639101.976712:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772985984 00000100:00100000:0.0:1788639101.976715:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772985984 00000100:00100000:0.0:1788639101.976733:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1788639101.976738:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+23:6513:x1875523772985984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788639101.976816:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+23:6513:x1875523772985984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639101.976823:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1788639101.976859:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f7c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772985984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788639101.977016:0:13796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f7c2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:13796:1875523772986112:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788639101.977053:0:13796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639101.977075:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772986112 00000100:00100000:0.0:1788639101.977078:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772986112 00000100:00100000:0.0:1788639101.977098:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1788639101.977103:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b678050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+23:13796:x1875523772986112:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788639101.977169:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b678050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+23:13796:x1875523772986112:12345-0@lo:502:llog_process_th.0 Request processed in 65us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639101.977176:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1788639101.977204:0:13796:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788639101.977215:0:13796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f7c2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:13796:1875523772986112:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788639101.977235:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788639101.977243:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788639101.977245:0:13796:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788639101.977255:0:13796:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ae3506e9000 00000020:00000080:0.0:1788639101.977257:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788639101.977299:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788639101.977302:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788639101.977304:0:13796:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788639101.977307:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788639101.977309:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788639101.977311:0:13796:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788639101.977314:0:13796:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ae3506e9000 00000020:00000080:0.0:1788639101.977316:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788639101.977346:0:13796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f7c2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:13796:1875523772986240:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788639101.977378:0:13796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639101.977398:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772986240 00000100:00100000:0.0:1788639101.977402:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772986240 00000100:00100000:0.0:1788639101.977422:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1788639101.977434:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+23:13796:x1875523772986240:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788639101.977489:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+23:13796:x1875523772986240:12345-0@lo:502:llog_process_th.0 Request processed in 56us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639101.977496:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1788639101.977523:0:13796:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3490bbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788639101.977551:0:13796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f7c2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:13796:1875523772986240:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788639101.977568:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788639101.977573:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788639101.977575:0:13796:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788639101.977579:0:13796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788639101.977640:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788639101.977667:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788639101.977676:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae38217a800/0x25c454990262c42f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c436 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639101.977685:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae38217a800/0x25c454990262c42f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c436 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639101.977695:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788639101.977697:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae3461e3800 from 7 10000000:01000000:0.0:1788639101.977700:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788639101.977720:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae340031c00/0x25c454990262c43d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639101.977728:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae340031c00/0x25c454990262c43d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639101.977738:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae340031c00/0x25c454990262c43d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639101.977762:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f7c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772986368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788639101.977788:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639101.977802:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3490bbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788639101.977813:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772986368 00000100:00100000:0.0:1788639101.977817:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772986368 00000100:00100000:0.0:1788639101.977837:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1788639101.977843:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+23:6513:x1875523772986368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788639101.977850:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639101.977861:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae340031200/0x25c454990262c444 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262c43d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639101.977876:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae340031200/0x25c454990262c444 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262c43d expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639101.977886:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae340031200/0x25c454990262c444 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262c43d expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639101.977892:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae340031200, rc 0) 00000100:00100000:0.0:1788639101.977920:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+24:6513:x1875523772986368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 77us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639101.977926:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1788639101.977955:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f7c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772986368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788639101.977965:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae340031c00/0x25c454990262c43d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c444 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639101.977974:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae340031c00/0x25c454990262c43d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262c444 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639101.978019:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f7c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772986496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788639101.978041:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639101.978056:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3490bbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788639101.978066:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772986496 00000100:00100000:0.0:1788639101.978069:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772986496 00000100:00100000:0.0:1788639101.978089:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1788639101.978094:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+24:6513:x1875523772986496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788639101.978168:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+24:6513:x1875523772986496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 72us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639101.978175:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1788639101.978204:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f7c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772986496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788639101.978228:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f7c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772986624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788639101.978261:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639101.978275:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243817900 going to sleep for 11 seconds 00000100:00100000:0.0:1788639101.978286:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772986624 00000100:00100000:0.0:1788639101.978289:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772986624 00000100:00100000:0.0:1788639101.978308:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1788639101.978313:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+24:6513:x1875523772986624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788639101.978377:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+24:6513:x1875523772986624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 62us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639101.978383:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1788639101.978418:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f7c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01f1eef9-e690-4065-bf99-bf821af7b626:6513:1875523772986624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788639101.978607:0:13797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f7c2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:13797:1875523772986752:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788639101.978665:0:13797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639101.978685:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772986752 00000100:00100000:0.0:1788639101.978688:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772986752 00000100:00100000:0.0:1788639101.978709:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1788639101.978716:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+24:13797:x1875523772986752:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788639101.983936:0:13797:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2438176c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788639101.986855:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+24:13797:x1875523772986752:12345-0@lo:502:llog_process_th.0 Request processed in 8130us (8181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639101.986869:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1788639101.986999:0:13797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f7c2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:13797:1875523772986752:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788639101.987034:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788639101.987043:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639101.987046:0:13797:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788639101.987052:0:13797:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ae3461e3800 00000020:00000080:2.0:1788639101.987054:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788639101.987116:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788639101.987120:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639101.987121:0:13797:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788639101.987123:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788639101.987126:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639101.987127:0:13797:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788639101.987130:0:13797:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ae3461e3800 00000020:00000080:2.0:1788639101.987132:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788639101.987179:0:13797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242ed4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:13797:1875523772986880:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788639101.987229:0:13797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639101.987270:0:13797:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243115780 going to sleep for 11 seconds 00000100:00100000:0.0:1788639101.989336:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772986880 00000100:00100000:0.0:1788639101.989348:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772986880 00000100:00100000:0.0:1788639101.989398:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1788639101.989407:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+24:13797:x1875523772986880:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788639101.989568:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+24:13797:x1875523772986880:12345-0@lo:502:llog_process_th.0 Request processed in 162us (2339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639101.989575:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1788639101.989649:0:13797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242ed4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01f1eef9-e690-4065-bf99-bf821af7b626:13797:1875523772986880:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788639101.989681:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788639101.989689:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788639101.989691:0:13797:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788639101.989698:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788639101.989759:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788639101.989791:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788639101.989800:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae340031c00/0x25c454990262c43d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c444 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639101.989810:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae340031c00/0x25c454990262c43d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c444 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788639101.995386:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788639102.390642:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639102.645078:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772987392:0@lo:400:kworker.0 00000100:00100000:1.0:1788639102.645168:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639102.645235:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f817100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875523772987904:0@lo:400:kworker.0 00000100:00100000:1.0:1788639102.645276:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639102.645295:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f814e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875523772988416:0@lo:400:kworker.0 00000100:00100000:1.0:1788639102.645315:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639102.645342:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788639102.645348:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875523772987264:0@lo:400:kworker.0 00000100:00100000:1.0:1788639102.645370:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639102.645398:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f817b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875523772987776:0@lo:400:kworker.0 00000100:00100000:1.0:1788639102.645418:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639102.645432:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f816300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875523772988288:0@lo:400:kworker.0 00000100:00100000:1.0:1788639102.645452:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639102.645478:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772987904 00000100:00100000:1.0:1788639102.645485:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772987904 00000100:00100000:1.0:1788639102.645539:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772988416 00000100:00100000:1.0:1788639102.645542:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772988416 00000100:00100000:1.0:1788639102.645558:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772987264 00000100:00100000:1.0:1788639102.645561:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772987264 00000100:00100000:1.0:1788639102.645570:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772987776 00000100:00100000:1.0:1788639102.645572:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772987776 00000100:00100000:1.0:1788639102.645583:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772988288 00000100:00100000:1.0:1788639102.645585:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772988288 00000100:00100000:1.0:1788639102.645598:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788639102.645642:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f784a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875523772987904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639102.645692:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f784a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875523772987904:12345-0@lo:400:kworker.0 Request processed in 79us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639102.645698:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788639102.645714:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788639102.645720:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f786d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875523772988416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639102.645745:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f786d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875523772988416:12345-0@lo:400:kworker.0 Request processed in 26us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639102.645749:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788639102.645759:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788639102.645765:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f787b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875523772987264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639102.645789:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f787b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875523772987264:12345-0@lo:400:kworker.0 Request processed in 25us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639102.645795:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788639102.645805:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788639102.645810:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f787100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875523772987776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639102.645835:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f787100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875523772987776:12345-0@lo:400:kworker.0 Request processed in 25us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639102.645841:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788639102.645852:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788639102.645858:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f785180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875523772988288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639102.645885:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f785180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875523772988288:12345-0@lo:400:kworker.0 Request processed in 28us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639102.645890:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788639102.645923:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875523772987264:0@lo:400:kworker.0 00000100:00100000:1.0:1788639102.645943:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f817b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875523772987776:0@lo:400:kworker.0 00000100:00100000:1.0:1788639102.645952:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f816300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875523772988288:0@lo:400:kworker.0 00010000:00080000:1.0:1788639102.645962:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae37f817100 x1875523772987904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639102.645972:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f817100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875523772987904:0@lo:400:kworker.0 00010000:00080000:1.0:1788639102.645988:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae37f814e00 x1875523772988416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639102.645999:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f814e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875523772988416:0@lo:400:kworker.0 00000100:00100000:2.0:1788639102.646293:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2433a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772987008:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788639102.646325:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639102.646354:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875523772987520:0@lo:400:kworker.0 00000100:00100000:2.0:1788639102.646385:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639102.646408:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772988032:0@lo:400:kworker.0 00000100:00100000:2.0:1788639102.646430:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639102.646457:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772988544:0@lo:400:kworker.0 00000100:00100000:2.0:1788639102.646478:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639102.646496:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1788639102.646502:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f815880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772987136:0@lo:400:kworker.0 00000100:00100000:2.0:1788639102.646543:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639102.646565:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772987648:0@lo:400:kworker.0 00000100:00100000:2.0:1788639102.646586:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639102.646603:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f816a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772988160:0@lo:400:kworker.0 00000100:00100000:2.0:1788639102.646655:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639102.646672:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3691ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772988672:0@lo:400:kworker.0 00000100:00100000:2.0:1788639102.646694:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639102.646721:0:12414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772987392 00000100:00100000:2.0:1788639102.646726:0:12414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772987392 00000100:00100000:2.0:1788639102.646757:0:12414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772987648 00000100:00100000:2.0:1788639102.646760:0:12414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772987648 00000100:00100000:2.0:1788639102.646775:0:12414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788639102.646781:0:12414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f784700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772987392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639102.646818:0:12414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f784700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772987392:12345-0@lo:400:kworker.0 Request processed in 37us (1651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639102.646824:0:12414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788639102.646839:0:12414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788639102.646845:0:12414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772987648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639102.646877:0:12414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772987648:12345-0@lo:400:kworker.0 Request processed in 31us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639102.646882:0:12414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788639102.646899:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772987520 00000100:00100000:2.0:1788639102.646908:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772987520 00000100:00100000:2.0:1788639102.646928:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788639102.646933:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875523772987520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639102.646962:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875523772987520:12345-0@lo:400:kworker.0 Request processed in 29us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639102.646968:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788639102.646989:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772988032 00000100:00100000:2.0:1788639102.646992:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772988032 00000100:00100000:2.0:1788639102.647010:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772988544 00000100:00100000:2.0:1788639102.647013:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772988544 00000100:00100000:2.0:1788639102.647023:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772988160 00000100:00100000:2.0:1788639102.647025:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772988160 00000100:00100000:2.0:1788639102.647039:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772988672 00000100:00100000:2.0:1788639102.647041:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772988672 00000100:00100000:2.0:1788639102.647054:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788639102.647076:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772988032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639102.647120:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772988032:12345-0@lo:400:kworker.0 Request processed in 60us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639102.647127:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788639102.647141:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788639102.647147:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772988544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639102.647172:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772988544:12345-0@lo:400:kworker.0 Request processed in 27us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639102.647178:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788639102.647188:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788639102.647194:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36e294c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1875523772988160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639102.647217:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36e294c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1875523772988160:12345-0@lo:400:kworker.0 Request processed in 24us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639102.647233:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788639102.647465:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788639102.647471:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772988672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639102.647498:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772988672:12345-0@lo:400:kworker.0 Request processed in 28us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639102.647504:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788639102.647567:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772987648:0@lo:400:kworker.0 00000100:00100000:2.0:1788639102.647578:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f816a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772988160:0@lo:400:kworker.0 00010000:00080000:2.0:1788639102.647588:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae3691ab100 x1875523772988672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639102.647598:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3691ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772988672:0@lo:400:kworker.0 00000100:00100000:2.0:1788639102.647607:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875523772987520:0@lo:400:kworker.0 00000100:00100000:2.0:1788639102.647638:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772988032:0@lo:400:kworker.0 00010000:00080000:2.0:1788639102.647648:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae37f815c00 x1875523772988544/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639102.647656:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772988544:0@lo:400:kworker.0 00000100:00100000:1.0:1788639102.648010:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772987008 00000100:00100000:1.0:1788639102.648016:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772987008 00000100:00100000:1.0:1788639102.648053:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788639102.648313:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772987008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788639102.648337:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788639102.648486:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772987008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 178us (2159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639102.648493:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788639102.648525:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772987392:0@lo:400:kworker.0 00000100:00080000:0.0:1788639102.648850:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788639102.648856:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788639102.648860:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788639102.648864:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788639102.648880:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772987136 00000100:00100000:0.0:1788639102.648885:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772987136 00000100:00100000:0.0:1788639102.648930:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1788639102.648937:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+24:3641:x1875523772987136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639102.648982:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+24:3641:x1875523772987136:12345-0@lo:400:kworker.0 Request processed in 46us (2438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639102.648989:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00010000:00080000:3.0:1788639102.650489:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2433a6680 x1875523772987008/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639118 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639102.650511:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2433a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772987008:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788639102.650547:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f815880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772987136:0@lo:400:kworker.0 00000040:00080000:2.0:1788639103.029416:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788639103.030415:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788639103.156967:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788639103.156992:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2433a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772988800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788639103.157089:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639103.157662:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772988800 00000100:00100000:3.0:1788639103.157672:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772988800 00000100:00100000:3.0:1788639103.157730:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788639103.157739:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772988800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788639103.157762:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788639103.157821:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772988800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639103.157828:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:0.0:1788639103.157983:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2433a6680 x1875523772988800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639119 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639103.158004:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2433a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772988800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788639103.159396:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f786a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772988928:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788639103.159450:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639103.159572:0:12414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772988928 00000100:00100000:2.0:1788639103.159580:0:12414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772988928 00000100:00100000:2.0:1788639103.159665:0:12414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788639103.159673:0:12414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f7c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772988928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788639103.159704:0:12414:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788639103.159756:0:12414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f7c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772988928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639103.159763:0:12414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788639103.160420:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f786a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772988928:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788639103.412758:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639103.668861:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788639103.668885:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f7c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772989056:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788639103.668954:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639103.669206:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772989056 00000100:00100000:2.0:1788639103.669214:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772989056 00000100:00100000:2.0:1788639103.669367:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788639103.669377:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f786300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772989056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788639103.669409:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788639103.669462:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f786300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772989056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639103.669469:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788639103.669560:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f7c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772989056:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788639103.977438:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639103.977572:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639103.977703:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639103.977742:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639103.977801:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639103.978758:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754028160 00000100:00100000:2.0:1788639103.978790:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754028160 00000100:00100000:2.0:1788639103.978894:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754028032 00000100:00100000:2.0:1788639103.978898:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754028032 00000100:00100000:2.0:1788639103.978922:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754028544 00000100:00100000:2.0:1788639103.978925:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754028544 00000100:00100000:2.0:1788639103.978950:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 211 00000100:00100000:2.0:1788639103.978961:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f784e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2405:x1875523754028160:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639103.980298:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754027904 00000100:00100000:0.0:1788639103.980404:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754027904 00000100:00100000:3.0:1788639103.980409:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 212 00000100:00100000:3.0:1788639103.980430:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f785f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2406:x1875523754028032:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639103.980475:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 366 00000100:00100000:0.0:1788639103.980482:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+13:2405:x1875523754027904:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639103.980601:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f785f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2406:x1875523754028032:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 174us (2896us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639103.980609:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 212 00000100:00100000:3.0:1788639103.980686:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 213 00000100:00100000:3.0:1788639103.980695:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f787800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2406:x1875523754028544:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639103.980722:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f787800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2406:x1875523754028544:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 29us (2921us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639103.980728:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 213 00000100:00100000:0.0:1788639103.980732:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+13:2405:x1875523754027904:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 250us (3307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639103.980748:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 366 00000100:00100000:0.0:1788639103.980833:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754028288 00000100:00100000:0.0:1788639103.980838:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754028288 00000100:00100000:0.0:1788639103.980884:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 90 00000100:00100000:0.0:1788639103.980892:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f785500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2406:x1875523754028288:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639103.980919:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f785500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2406:x1875523754028288:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 29us (3177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639103.980926:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 90 00000100:00100000:2.0:1788639103.981240:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f784e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2405:x1875523754028160:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 2270us (3658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639103.981256:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 211 00000100:00100000:1.0:1788639103.982940:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639103.983094:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754028416 00000100:00100000:3.0:1788639103.983107:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754028416 00000100:00100000:3.0:1788639103.983186:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 214 00000100:00100000:3.0:1788639103.983197:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f786680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2405:x1875523754028416:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639103.983273:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f786680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2405:x1875523754028416:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 78us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639103.983280:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 214 00000100:00080000:3.0:1788639103.983324:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788639103.983407:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788639103.983409:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788639104.441601:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639105.204967:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788639105.204991:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772989184:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788639105.205061:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639105.205372:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772989184 00000100:00100000:1.0:1788639105.205381:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772989184 00000100:00080000:3.0:1788639105.205648:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788639105.205721:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788639105.205734:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2433a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772989184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788639105.205764:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788639105.205822:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2433a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772989184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639105.205902:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788639105.205912:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242ed4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772989312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788639105.205957:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639105.206603:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772989184:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788639105.211724:0:8434:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1788639105.211742:0:8434:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1788639105.212060:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772989312 00000100:00100000:0.0:1788639105.212071:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772989312 00000100:00080000:2.0:1788639105.212160:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788639105.212269:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788639105.212281:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875523772989312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788639105.212319:0:13805:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788639105.212412:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875523772989312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (6453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639105.212420:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788639105.212730:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242ed4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772989312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788639105.212957:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00010000:2.0:1788639105.460850:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788639106.242396:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00010000:00010000:2.0:1788639106.485054:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639107.509100:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639107.764803:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788639107.764829:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f784380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772989824:0@lo:400:kworker.0 00000100:00100000:3.0:1788639107.764901:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639107.764977:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f785c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523772989440:0@lo:400:kworker.0 00000100:00100000:3.0:1788639107.765006:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639107.765036:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f815880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875523772990336:0@lo:400:kworker.0 00000100:00100000:3.0:1788639107.765060:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639107.765078:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875523772990848:0@lo:400:kworker.0 00000100:00100000:3.0:1788639107.765098:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639107.765116:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788639107.765122:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f785880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875523772989952:0@lo:400:kworker.0 00000100:00100000:3.0:1788639107.765141:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639107.765155:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772990464:0@lo:400:kworker.0 00000100:00100000:3.0:1788639107.765176:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639107.765194:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f816a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772990976:0@lo:400:kworker.0 00000100:00100000:3.0:1788639107.765213:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639107.765246:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772989440 00000100:00100000:3.0:1788639107.765254:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772989440 00000100:00100000:3.0:1788639107.765298:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1788639107.765307:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+24:3643:x1875523772989440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639107.765373:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+24:3643:x1875523772989440:12345-0@lo:400:kworker.0 Request processed in 67us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639107.765393:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1788639107.765426:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772990336 00000100:00100000:3.0:1788639107.765430:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772990336 00000100:00100000:3.0:1788639107.765461:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772990848 00000100:00100000:3.0:1788639107.765464:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772990848 00000100:00100000:3.0:1788639107.765481:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772989952 00000100:00100000:3.0:1788639107.765484:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772989952 00000100:00100000:3.0:1788639107.765497:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788639107.765515:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2433a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875523772990336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639107.765548:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2433a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875523772990336:12345-0@lo:400:kworker.0 Request processed in 45us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639107.765555:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788639107.765567:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788639107.765572:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2433a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875523772990848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639107.765598:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2433a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875523772990848:12345-0@lo:400:kworker.0 Request processed in 26us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639107.765604:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788639107.765614:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788639107.765646:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2433a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875523772989952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639107.765674:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2433a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875523772989952:12345-0@lo:400:kworker.0 Request processed in 29us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639107.765680:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788639107.765699:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772990464 00000100:00100000:3.0:1788639107.765702:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772990464 00000100:00100000:3.0:1788639107.765725:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772990976 00000100:00100000:3.0:1788639107.765728:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772990976 00000100:00100000:3.0:1788639107.765750:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788639107.765763:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2433a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772990464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639107.765791:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2433a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772989568:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788639107.765794:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2433a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772990464:12345-0@lo:400:kworker.0 Request processed in 33us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639107.765800:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788639107.765811:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788639107.765816:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2433a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772990976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639107.765833:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639107.765841:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2433a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772990976:12345-0@lo:400:kworker.0 Request processed in 25us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639107.765846:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788639107.765860:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f784000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772990080:0@lo:400:kworker.0 00000100:00080000:3.0:1788639107.765861:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788639107.765865:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788639107.765867:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788639107.765882:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639107.765896:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772990592:0@lo:400:kworker.0 00000100:00100000:3.0:1788639107.765897:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f785880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875523772989952:0@lo:400:kworker.0 00000100:00100000:3.0:1788639107.765906:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772990464:0@lo:400:kworker.0 00000100:00100000:2.0:1788639107.765914:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788639107.765917:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae37f816a00 x1875523772990976/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639107.765927:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f816a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772990976:0@lo:400:kworker.0 00000100:00100000:2.0:1788639107.765928:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772991104:0@lo:400:kworker.0 00010000:00080000:3.0:1788639107.765936:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae37f815880 x1875523772990336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639107.765945:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f815880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875523772990336:0@lo:400:kworker.0 00000100:00100000:2.0:1788639107.765945:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788639107.765954:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae37f814a80 x1875523772990848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639107.765963:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875523772990848:0@lo:400:kworker.0 00000100:00100000:3.0:1788639107.765972:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f785c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523772989440:0@lo:400:kworker.0 00000100:00100000:3.0:1788639107.766035:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772990592 00000100:00100000:3.0:1788639107.766039:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772990592 00000100:00100000:3.0:1788639107.766062:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772991104 00000100:00100000:3.0:1788639107.766065:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772991104 00000100:00100000:3.0:1788639107.766078:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788639107.766084:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772990592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639107.766116:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772990592:12345-0@lo:400:kworker.0 Request processed in 32us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639107.766121:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788639107.766132:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788639107.766138:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772991104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639107.766163:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772991104:12345-0@lo:400:kworker.0 Request processed in 27us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639107.766169:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:3.0:1788639107.766184:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788639107.766187:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788639107.766290:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:2.0:1788639107.766295:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ae242ed5180, transno 4294967301 00000100:00100000:2.0:1788639107.766312:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772990592:0@lo:400:kworker.0 00010000:00080000:2.0:1788639107.766332:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae37f816d80 x1875523772991104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639107.766340:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772991104:0@lo:400:kworker.0 00000100:00100000:2.0:1788639107.766350:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788639107.766358:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f787480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875523772989696:0@lo:400:kworker.0 00000100:00100000:2.0:1788639107.766394:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639107.766460:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772989696 00000100:00100000:0.0:1788639107.766465:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772989696 00000100:00100000:0.0:1788639107.766496:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788639107.766513:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875523772989696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639107.766601:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772989824 00000100:00100000:1.0:1788639107.766606:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772989824 00000100:00100000:1.0:1788639107.766654:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772990080 00000100:00100000:1.0:1788639107.766657:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772990080 00000100:00100000:1.0:1788639107.766670:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788639107.766676:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2433a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772989824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639107.766715:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2433a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772989824:12345-0@lo:400:kworker.0 Request processed in 38us (1814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639107.766721:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788639107.766725:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f784380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772989824:0@lo:400:kworker.0 00000100:00100000:1.0:1788639107.766734:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788639107.766740:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772990080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639107.766768:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772989568 00000100:00100000:1.0:1788639107.766768:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772990080:12345-0@lo:400:kworker.0 Request processed in 28us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639107.766772:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772989568 00000100:00100000:1.0:1788639107.766774:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788639107.766796:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788639107.766802:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772989568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788639107.766822:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788639107.766858:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772989568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639107.766864:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788639107.769720:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875523772989696:12345-0@lo:400:kworker.0 Request processed in 3210us (3317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639107.769734:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788639107.771084:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f787480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875523772989696:0@lo:400:kworker.0 00000100:00100000:2.0:1788639107.771116:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f786a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875523772990208:0@lo:400:kworker.0 00000100:00100000:2.0:1788639107.771181:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639107.771586:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875523772990720:0@lo:400:kworker.0 00000100:00100000:2.0:1788639107.771610:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788639107.775905:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2433a5500 x1875523772989568/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639123 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639107.775935:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2433a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772989568:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788639107.775950:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f784000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772990080:0@lo:400:kworker.0 00000100:00100000:3.0:1788639107.776601:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772990208 00000100:00100000:3.0:1788639107.776642:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772990208 00000100:00100000:3.0:1788639107.776760:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772990720 00000100:00100000:3.0:1788639107.776765:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772990720 00000100:00080000:2.0:1788639107.776823:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788639107.776887:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788639107.776899:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875523772990208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639107.777019:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875523772990208:12345-0@lo:400:kworker.0 Request processed in 123us (5837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639107.777026:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788639107.777043:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788639107.777057:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875523772990720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639107.777091:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875523772990720:12345-0@lo:400:kworker.0 Request processed in 35us (5480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639107.777097:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788639107.777243:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f786a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875523772990208:0@lo:400:kworker.0 00000100:00100000:2.0:1788639107.777256:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875523772990720:0@lo:400:kworker.0 00000100:00100000:2.0:1788639108.276895:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788639108.276917:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2433a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772991232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788639108.276991:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639108.277252:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772991232 00000100:00100000:3.0:1788639108.277259:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772991232 00000100:00100000:3.0:1788639108.277312:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788639108.277328:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772991232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788639108.277350:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788639108.277401:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772991232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639108.277409:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:2.0:1788639108.277531:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2433a7480 x1875523772991232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639124 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639108.277550:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2433a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772991232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788639108.277714:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788639108.277725:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f814e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772991360:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788639108.277757:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639108.277839:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772991360 00000100:00100000:1.0:1788639108.277844:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772991360 00000100:00100000:1.0:1788639108.277881:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788639108.277889:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772991360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788639108.277914:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788639108.277973:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772991360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639108.277980:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788639108.278051:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f814e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772991360:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788639108.532824:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639108.788984:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788639108.789007:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f7c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772991488:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788639108.789083:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639108.789290:0:12414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772991488 00000100:00100000:0.0:1788639108.789297:0:12414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772991488 00000100:00100000:0.0:1788639108.789340:0:12414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788639108.789348:0:12414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f7c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772991488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788639108.789377:0:12414:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788639108.789424:0:12414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f7c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772991488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639108.789430:0:12414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788639108.789476:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f7c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772991488:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788639109.087570:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639109.087692:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639109.087724:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639109.087785:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754029056 00000100:00100000:1.0:1788639109.087834:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639109.087859:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639109.087888:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754029056 00000100:00100000:3.0:1788639109.087974:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 95 00000100:00100000:3.0:1788639109.087987:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f816300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2406:x1875523754029056:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639109.088080:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f816300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2406:x1875523754029056:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 96us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639109.088089:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 95 00000100:00080000:3.0:1788639109.088136:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788639109.088297:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754028672 00000100:00100000:3.0:1788639109.088302:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754028672 00000100:00100000:3.0:1788639109.088335:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 368 00000100:00100000:3.0:1788639109.088342:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+13:2406:x1875523754028672:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639109.088379:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+13:2406:x1875523754028672:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 37us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639109.088387:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 368 00000100:00100000:0.0:1788639109.093738:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754028800 00000100:00100000:0.0:1788639109.093761:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754028800 00000100:00100000:1.0:1788639109.093846:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639109.093889:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754029312 00000100:00100000:1.0:1788639109.093894:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754029312 00000100:00100000:1.0:1788639109.093922:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754028928 00000100:00100000:1.0:1788639109.093925:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754028928 00000100:00100000:1.0:1788639109.093942:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754029184 00000100:00100000:1.0:1788639109.093945:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754029184 00000100:00100000:1.0:1788639109.093962:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 221 00000100:00100000:1.0:1788639109.093973:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f817100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2406:x1875523754028800:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639109.093978:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 222 00000100:00100000:0.0:1788639109.093986:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2406:x1875523754029312:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:1.0:1788639109.094069:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f817100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2406:x1875523754028800:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 97us (6526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639109.094078:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 221 00000100:00100000:1.0:1788639109.094099:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 223 00000100:00100000:1.0:1788639109.094106:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2406:x1875523754028928:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639109.095263:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 224 00000100:00100000:2.0:1788639109.095286:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2406:x1875523754029184:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639109.096391:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2406:x1875523754029312:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 2396us (8657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639109.096406:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 222 00000100:00080000:0.0:1788639109.096461:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788639109.096467:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788639109.100547:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2406:x1875523754028928:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 6421us (12667us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639109.100570:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 223 00000100:00100000:2.0:1788639109.108786:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2406:x1875523754029184:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 13491us (14926us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639109.108931:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 224 00010000:00010000:1.0:1788639109.556909:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639110.326080:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242efb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772991616:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788639110.326175:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639110.326329:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772991616 00000100:00100000:2.0:1788639110.326338:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772991616 00000100:00100000:2.0:1788639110.326403:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788639110.326414:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f7c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772991616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788639110.326444:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788639110.326500:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f7c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772991616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639110.326508:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:0.0:1788639110.326631:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788639110.326748:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242efb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772991616:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788639110.326951:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788639110.326961:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2433a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772991744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788639110.326994:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639110.329799:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772991744 00000100:00100000:2.0:1788639110.329814:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772991744 00000100:00100000:2.0:1788639110.329965:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788639110.329976:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f815180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772991744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788639110.330003:0:13805:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788639110.330087:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f815180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772991744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (3091us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639110.330094:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788639110.331101:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2433a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772991744:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788639110.332801:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788639110.580925:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639111.604960:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639112.628869:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639112.886843:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788639112.886868:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242ef8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772991872:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788639112.886943:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639112.887249:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772991872 00000100:00100000:2.0:1788639112.887257:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772991872 00000100:00100000:2.0:1788639112.887333:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788639112.887346:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f816d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772991872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788639112.887375:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788639112.887442:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f816d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772991872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639112.887449:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:1.0:1788639112.887639:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788639112.887669:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae242ef8e00 x1875523772991872/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639128 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639112.887687:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242ef8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772991872:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788639112.887916:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2433a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772992256:0@lo:400:kworker.0 00000100:00100000:0.0:1788639112.888146:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639112.888199:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f784000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875523772992768:0@lo:400:kworker.0 00000100:00100000:0.0:1788639112.888242:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639112.888261:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f785880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875523772993280:0@lo:400:kworker.0 00000100:00100000:0.0:1788639112.888282:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639112.888306:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788639112.888312:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2433a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875523772992128:0@lo:400:kworker.0 00000100:00100000:0.0:1788639112.888348:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639112.888367:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f786a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875523772992640:0@lo:400:kworker.0 00000100:00100000:0.0:1788639112.888388:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639112.888410:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f785c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875523772993152:0@lo:400:kworker.0 00000100:00100000:0.0:1788639112.888430:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639112.888460:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772992768 00000100:00100000:0.0:1788639112.888465:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772992768 00000100:00100000:0.0:1788639112.888513:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772993280 00000100:00100000:0.0:1788639112.888517:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772993280 00000100:00100000:0.0:1788639112.888532:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772992128 00000100:00100000:0.0:1788639112.888534:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772992128 00000100:00100000:0.0:1788639112.888544:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772992640 00000100:00100000:0.0:1788639112.888554:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772992640 00000100:00100000:0.0:1788639112.888572:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772993152 00000100:00100000:0.0:1788639112.888574:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772993152 00000100:00100000:0.0:1788639112.888588:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788639112.888595:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f7c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875523772992768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639112.888677:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f7c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875523772992768:12345-0@lo:400:kworker.0 Request processed in 82us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639112.888684:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788639112.888701:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788639112.888708:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f7c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875523772993280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639112.888738:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f7c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875523772993280:12345-0@lo:400:kworker.0 Request processed in 31us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639112.888744:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788639112.888756:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788639112.888761:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f7c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875523772992128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639112.888790:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f7c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875523772992128:12345-0@lo:400:kworker.0 Request processed in 28us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639112.888795:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788639112.888808:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788639112.888813:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f7c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875523772992640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639112.888840:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f7c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875523772992640:12345-0@lo:400:kworker.0 Request processed in 26us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639112.888846:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788639112.888856:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788639112.888861:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f7c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875523772993152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639112.888888:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f7c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875523772993152:12345-0@lo:400:kworker.0 Request processed in 27us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639112.888901:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788639112.888929:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2433a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875523772992384:0@lo:400:kworker.0 00000100:00100000:0.0:1788639112.888971:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639112.888997:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f787480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772992896:0@lo:400:kworker.0 00000100:00100000:0.0:1788639112.889022:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639112.889041:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae360685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772993408:0@lo:400:kworker.0 00000100:00100000:0.0:1788639112.889063:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639112.889082:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788639112.889089:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2433a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523772992000:0@lo:400:kworker.0 00000100:00100000:0.0:1788639112.889115:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639112.889136:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2433a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772992512:0@lo:400:kworker.0 00000100:00100000:0.0:1788639112.889157:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639112.889175:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f784380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772993024:0@lo:400:kworker.0 00000100:00100000:0.0:1788639112.889195:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639112.889223:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772992896 00000100:00100000:0.0:1788639112.889228:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772992896 00000100:00100000:0.0:1788639112.889254:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772993408 00000100:00100000:0.0:1788639112.889258:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772993408 00000100:00100000:0.0:1788639112.889270:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772993024 00000100:00100000:0.0:1788639112.889272:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772993024 00000100:00100000:0.0:1788639112.889285:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788639112.889290:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772992896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639112.889327:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772992896:12345-0@lo:400:kworker.0 Request processed in 36us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639112.889332:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788639112.889352:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788639112.889358:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772993408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639112.889398:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772993408:12345-0@lo:400:kworker.0 Request processed in 40us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639112.889404:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788639112.889415:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788639112.889421:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772993024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639112.889449:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772993024:12345-0@lo:400:kworker.0 Request processed in 29us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639112.889455:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788639112.889485:0:12414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772992256 00000100:00100000:0.0:1788639112.889489:0:12414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772992256 00000100:00100000:0.0:1788639112.889515:0:12414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772992512 00000100:00100000:0.0:1788639112.889518:0:12414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772992512 00000100:00100000:0.0:1788639112.889531:0:12414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788639112.889537:0:12414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f7c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772992256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639112.889571:0:12414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f7c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772992256:12345-0@lo:400:kworker.0 Request processed in 33us (1425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639112.889576:0:12414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788639112.889588:0:12414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788639112.889594:0:12414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772992512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639112.889646:0:12414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772992512:12345-0@lo:400:kworker.0 Request processed in 53us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639112.889651:0:12414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:0.0:1788639112.889671:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788639112.889674:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788639112.889677:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788639112.889686:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788639112.889713:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2433a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772992512:0@lo:400:kworker.0 00000100:00100000:0.0:1788639112.889725:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f784380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772993024:0@lo:400:kworker.0 00000100:00100000:0.0:1788639112.889734:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f787480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772992896:0@lo:400:kworker.0 00010000:00080000:0.0:1788639112.889745:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae360685500 x1875523772993408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639112.889755:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae360685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772993408:0@lo:400:kworker.0 00000100:00100000:0.0:1788639112.889807:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2433a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875523772992128:0@lo:400:kworker.0 00000100:00100000:0.0:1788639112.889816:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f786a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875523772992640:0@lo:400:kworker.0 00000100:00100000:0.0:1788639112.889825:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f785c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875523772993152:0@lo:400:kworker.0 00000100:00100000:0.0:1788639112.889834:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2433a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772992256:0@lo:400:kworker.0 00010000:00080000:0.0:1788639112.889845:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae37f784000 x1875523772992768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639112.889854:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f784000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875523772992768:0@lo:400:kworker.0 00010000:00080000:0.0:1788639112.889864:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae37f785880 x1875523772993280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639112.889873:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f785880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875523772993280:0@lo:400:kworker.0 00000100:00100000:0.0:1788639112.889917:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772992384 00000100:00100000:0.0:1788639112.889922:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772992384 00000100:00100000:0.0:1788639112.889944:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788639112.889950:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f7c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875523772992384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639112.889994:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f7c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875523772992384:12345-0@lo:400:kworker.0 Request processed in 44us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639112.890001:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788639112.890025:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2433a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875523772992384:0@lo:400:kworker.0 00000100:00100000:1.0:1788639112.890277:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772992000 00000100:00100000:1.0:1788639112.890282:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772992000 00000100:00100000:1.0:1788639112.890320:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1788639112.890337:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+24:3643:x1875523772992000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639112.890376:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+24:3643:x1875523772992000:12345-0@lo:400:kworker.0 Request processed in 40us (1260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639112.890383:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1788639112.890418:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2433a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523772992000:0@lo:400:kworker.0 00000040:00080000:0.0:1788639113.269259:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788639113.270681:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788639113.396912:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788639113.397041:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae360686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772993664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788639113.397109:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639113.397194:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772993664 00000100:00100000:3.0:1788639113.397207:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772993664 00000100:00100000:3.0:1788639113.397266:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788639113.397276:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772993664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788639113.397297:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788639113.402848:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772993536:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788639113.402924:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639113.407401:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772993664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 10117us (10282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639113.407417:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788639113.409081:0:12414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772993536 00000100:00100000:1.0:1788639113.409111:0:12414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772993536 00000100:00100000:1.0:1788639113.409919:0:12414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788639113.409935:0:12414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f785880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772993536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788639113.409970:0:12414:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788639113.410070:0:12414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f785880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772993536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 141us (7146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639113.410077:0:12414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788639113.410170:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772993536:0@lo:41:osp-pre-0-1.0 00010000:00080000:2.0:1788639113.412395:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae360686d80 x1875523772993664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639129 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639113.412423:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae360686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772993664:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788639113.652801:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639113.908864:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f784000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772993792:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788639113.908941:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639113.909138:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772993792 00000100:00100000:3.0:1788639113.909147:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772993792 00000100:00100000:3.0:1788639113.909201:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788639113.909209:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772993792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788639113.909240:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788639113.909298:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772993792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639113.909305:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788639113.909565:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f784000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772993792:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788639114.208767:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639114.208940:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639114.208972:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639114.209021:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754029824 00000100:00100000:1.0:1788639114.209031:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754029824 00000100:00100000:1.0:1788639114.209107:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 99 00000100:00100000:1.0:1788639114.209117:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae360687b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2407:x1875523754029824:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:1.0:1788639114.209184:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae360687b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2407:x1875523754029824:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 68us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639114.209191:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 99 00000100:00080000:2.0:1788639114.210428:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788639114.212482:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639114.212520:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639114.212569:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754029440 00000100:00100000:2.0:1788639114.212580:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754029440 00000100:00100000:2.0:1788639114.212645:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 370 00000100:00100000:2.0:1788639114.212656:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+13:2407:x1875523754029440:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639114.212730:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+13:2407:x1875523754029440:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 76us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639114.212738:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 370 00000100:00100000:0.0:1788639114.213185:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754029568 00000100:00100000:0.0:1788639114.213191:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754029568 00000100:00080000:2.0:1788639114.213266:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788639114.213776:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754030080 00000100:00100000:1.0:1788639114.213782:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754030080 00000100:00100000:1.0:1788639114.213835:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 231 00000100:00100000:1.0:1788639114.213845:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae360684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2407:x1875523754029568:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:1.0:1788639114.213894:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae360684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2407:x1875523754029568:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 51us (5136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639114.213901:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 231 00000100:00100000:1.0:1788639114.213916:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 232 00000100:00100000:1.0:1788639114.213938:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae360687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2407:x1875523754030080:12345-192.168.206.18@tcp:400:kworker.0 00000100:00080000:2.0:1788639114.213954:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788639114.213967:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae360687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2407:x1875523754030080:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 31us (4993us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639114.213988:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 232 00000100:00100000:3.0:1788639114.215587:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639114.215753:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754029696 00000100:00100000:1.0:1788639114.215761:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754029696 00000100:00100000:1.0:1788639114.215913:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754029952 00000100:00100000:1.0:1788639114.215917:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754029952 00000100:00080000:2.0:1788639114.215941:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788639114.215945:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788639114.216039:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 233 00000100:00100000:0.0:1788639114.216051:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae360686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2407:x1875523754029696:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639114.216112:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae360686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2407:x1875523754029696:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 64us (3591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639114.216119:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 233 00000100:00100000:1.0:1788639114.217608:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 234 00000100:00100000:1.0:1788639114.217633:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae360685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2407:x1875523754029952:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:1.0:1788639114.217695:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae360685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2407:x1875523754029952:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 78us (2113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639114.217702:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 234 00010000:00010000:1.0:1788639114.677063:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639115.445562:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772993920:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788639115.445897:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639115.446015:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772993920 00000100:00100000:3.0:1788639115.446023:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772993920 00000100:00100000:3.0:1788639115.446079:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788639115.446091:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f785c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772993920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788639115.446121:0:13805:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788639115.446230:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788639115.446340:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242efb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772994048:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788639115.447828:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f785c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772993920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1735us (1926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639115.447840:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788639115.448182:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772993920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788639115.448306:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639115.448394:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772994048 00000100:00100000:3.0:1788639115.448401:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772994048 00000100:00100000:3.0:1788639115.448452:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788639115.448471:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f815880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772994048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788639115.448491:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788639115.448545:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f815880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772994048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639115.448551:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788639115.448675:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242efb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772994048:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788639115.448811:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788639115.701087:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639116.725194:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639117.749081:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639118.005045:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788639118.005069:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242efb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772994176:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788639118.005137:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639118.005196:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772994176 00000100:00100000:3.0:1788639118.005203:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772994176 00000100:00100000:3.0:1788639118.005308:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788639118.005318:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f786a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772994176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788639118.005343:0:13805:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788639118.005387:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f786a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772994176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639118.005394:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00080000:0.0:1788639118.005491:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae242efb480 x1875523772994176/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639134 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639118.005509:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242efb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772994176:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788639118.007388:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788639118.007803:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f78df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772994560:0@lo:400:kworker.0 00000100:00100000:2.0:1788639118.007866:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639118.007919:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f78ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875523772995072:0@lo:400:kworker.0 00000100:00100000:2.0:1788639118.007957:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639118.007972:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3691ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875523772995584:0@lo:400:kworker.0 00000100:00100000:2.0:1788639118.007991:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639118.008015:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788639118.008021:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f78d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875523772994432:0@lo:400:kworker.0 00000100:00100000:2.0:1788639118.008041:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639118.008055:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f78dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875523772994944:0@lo:400:kworker.0 00000100:00100000:2.0:1788639118.008072:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639118.008088:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342e3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875523772995456:0@lo:400:kworker.0 00000100:00100000:0.0:1788639118.008098:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772995072 00000100:00100000:0.0:1788639118.008106:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772995072 00000100:00100000:2.0:1788639118.008110:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639118.008138:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772995584 00000100:00100000:2.0:1788639118.008142:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772995584 00000100:00100000:0.0:1788639118.008155:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772994432 00000100:00100000:0.0:1788639118.008160:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772994432 00000100:00100000:2.0:1788639118.008170:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772994944 00000100:00100000:2.0:1788639118.008175:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772994944 00000100:00100000:0.0:1788639118.008201:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772995456 00000100:00100000:2.0:1788639118.008206:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788639118.008206:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772995456 00000100:00100000:2.0:1788639118.008219:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3691aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875523772995072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639118.008236:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788639118.008245:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36914c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875523772995584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639118.008273:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3691aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875523772995072:12345-0@lo:400:kworker.0 Request processed in 55us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639118.008281:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788639118.008301:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36914c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875523772995584:12345-0@lo:400:kworker.0 Request processed in 56us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639118.008302:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788639118.008316:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788639118.008318:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875523772994432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639118.008338:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788639118.008346:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242083480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875523772994944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639118.008368:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875523772994432:12345-0@lo:400:kworker.0 Request processed in 54us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639118.008376:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788639118.008389:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242083480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875523772994944:12345-0@lo:400:kworker.0 Request processed in 43us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639118.008396:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788639118.008457:0:12414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772994560 00000100:00100000:1.0:1788639118.008462:0:12414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772994560 00000100:00100000:1.0:1788639118.008488:0:12414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788639118.008494:0:12414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3691a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772994560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639118.008537:0:12414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3691a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523772994560:12345-0@lo:400:kworker.0 Request processed in 32us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639118.008544:0:12414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788639118.008565:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f78d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875523772994688:0@lo:400:kworker.0 00000100:00100000:1.0:1788639118.008595:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639118.008612:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f78fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772995200:0@lo:400:kworker.0 00000100:00100000:1.0:1788639118.008659:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639118.008674:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3691a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772995712:0@lo:400:kworker.0 00000100:00100000:1.0:1788639118.008691:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639118.008706:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788639118.008711:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242efb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772994304:0@lo:400:kworker.0 00000100:00100000:1.0:1788639118.008735:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639118.008757:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f78e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772994816:0@lo:400:kworker.0 00000100:00100000:1.0:1788639118.008780:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639118.008795:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342e3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772995328:0@lo:400:kworker.0 00000100:00100000:1.0:1788639118.008814:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639118.008839:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772994304 00000100:00100000:1.0:1788639118.008842:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772994304 00000100:00100000:1.0:1788639118.008868:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1788639118.008874:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+24:3641:x1875523772994304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639118.008907:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+24:3641:x1875523772994304:12345-0@lo:400:kworker.0 Request processed in 33us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639118.008913:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1788639118.008937:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772994816 00000100:00100000:1.0:1788639118.008940:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772994816 00000100:00100000:1.0:1788639118.008958:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788639118.008964:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772994816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639118.008993:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772994816:12345-0@lo:400:kworker.0 Request processed in 29us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639118.009009:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788639118.009027:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772995200 00000100:00100000:1.0:1788639118.009031:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772995200 00000100:00100000:1.0:1788639118.009054:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772995712 00000100:00100000:1.0:1788639118.009057:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772995712 00000100:00100000:1.0:1788639118.009070:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772995328 00000100:00100000:1.0:1788639118.009072:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772995328 00000100:00100000:1.0:1788639118.009085:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788639118.009091:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f814700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772995200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639118.009120:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f814700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772995200:12345-0@lo:400:kworker.0 Request processed in 29us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639118.009124:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788639118.009135:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788639118.009141:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f815c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772995712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639118.009165:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f815c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772995712:12345-0@lo:400:kworker.0 Request processed in 24us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639118.009170:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788639118.009180:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788639118.009186:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772995328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639118.009210:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772995328:12345-0@lo:400:kworker.0 Request processed in 25us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639118.009215:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788639118.009235:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772994688 00000100:00100000:1.0:1788639118.009239:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772994688 00000100:00100000:2.0:1788639118.009368:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875523772995456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639118.009406:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875523772995456:12345-0@lo:400:kworker.0 Request processed in 1004us (1298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639118.010762:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f78d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875523772994432:0@lo:400:kworker.0 00000100:00100000:3.0:1788639118.010777:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f78dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875523772994944:0@lo:400:kworker.0 00000100:00100000:3.0:1788639118.010786:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342e3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875523772995456:0@lo:400:kworker.0 00000100:00100000:3.0:1788639118.010796:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f78df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523772994560:0@lo:400:kworker.0 00010000:00080000:3.0:1788639118.010807:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae37f78ed80 x1875523772995072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639118.010833:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f78ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875523772995072:0@lo:400:kworker.0 00010000:00080000:3.0:1788639118.010845:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae3691ab100 x1875523772995584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639118.010852:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3691ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875523772995584:0@lo:400:kworker.0 00000100:00080000:3.0:1788639118.010913:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788639118.010917:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788639118.010920:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788639118.010933:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788639118.010955:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242efb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523772994304:0@lo:400:kworker.0 00000100:00100000:3.0:1788639118.010965:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f78e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772994816:0@lo:400:kworker.0 00000100:00100000:3.0:1788639118.010974:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342e3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772995328:0@lo:400:kworker.0 00000100:00100000:3.0:1788639118.010983:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f78fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772995200:0@lo:400:kworker.0 00010000:00080000:3.0:1788639118.010993:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae3691a8a80 x1875523772995712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639118.011000:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3691a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772995712:0@lo:400:kworker.0 00000100:00100000:0.0:1788639118.013684:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788639118.018121:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788639118.018144:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875523772994688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639118.018259:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875523772994688:12345-0@lo:400:kworker.0 Request processed in 128us (9663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639118.018266:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788639118.018518:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f78d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875523772994688:0@lo:400:kworker.0 00000100:00100000:2.0:1788639118.024596:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788639118.516911:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788639118.516962:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772995840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788639118.517058:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639118.517131:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772995840 00000100:00100000:1.0:1788639118.517140:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772995840 00000100:00100000:1.0:1788639118.517212:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788639118.517222:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f787480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772995840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788639118.517255:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788639118.517316:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f787480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772995840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639118.517324:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788639118.517384:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772995968:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788639118.517441:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788639118.517495:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2416e5f80 x1875523772995840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639134 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639118.517511:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772995968 00000100:00100000:1.0:1788639118.517517:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772995968 00000100:00100000:0.0:1788639118.517518:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772995840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788639118.517548:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788639118.517556:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2416e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772995968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788639118.517594:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788639118.522516:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2416e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772995968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4950us (5064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639118.522530:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788639118.522648:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772995968:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788639118.772769:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639119.030181:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788639119.030204:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f784380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772996096:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788639119.030267:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639119.030320:0:12414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772996096 00000100:00100000:2.0:1788639119.030328:0:12414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772996096 00000100:00100000:2.0:1788639119.030372:0:12414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788639119.030382:0:12414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772996096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788639119.030414:0:12414:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788639119.030469:0:12414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772996096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639119.030476:0:12414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788639119.031300:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f784380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772996096:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788639119.328702:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639119.328746:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639119.328790:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639119.328869:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754030464 00000100:00100000:1.0:1788639119.328879:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754030464 00000100:00100000:1.0:1788639119.328941:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754030336 00000100:00100000:1.0:1788639119.328955:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754030336 00000100:00100000:1.0:1788639119.328982:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 241 00000100:00100000:1.0:1788639119.328991:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2416e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2405:x1875523754030464:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:1.0:1788639119.329058:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2416e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2405:x1875523754030464:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 68us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639119.329066:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 241 00000100:00100000:1.0:1788639119.329083:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 242 00000100:00100000:1.0:1788639119.329090:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2416e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2405:x1875523754030336:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:1.0:1788639119.329114:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2416e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2405:x1875523754030336:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 25us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639119.329120:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 242 00000100:00080000:3.0:1788639119.329407:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788639119.329418:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788639119.329836:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754030208 00000100:00100000:2.0:1788639119.329843:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754030208 00000100:00100000:2.0:1788639119.329884:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 372 00000100:00100000:2.0:1788639119.329892:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+13:2405:x1875523754030208:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639119.329927:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+13:2405:x1875523754030208:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 36us (1233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639119.329934:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 372 00000100:00100000:1.0:1788639119.338510:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639119.338640:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639119.339041:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639119.339085:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754030592 00000100:00100000:2.0:1788639119.339094:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754030592 00000100:00100000:2.0:1788639119.339174:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 27 00000100:00100000:2.0:1788639119.339189:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2404:x1875523754030592:12345-192.168.206.18@tcp:9:kworker.0 00000020:00000080:2.0:1788639119.339262:0:8829:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262c36b 00000100:00080000:2.0:1788639119.339272:0:8829:0:(import.c:65:import_set_state_nolock()) ffff9ae2416ef000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788639119.339318:0:8829:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:2.0:1788639119.339495:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+2:2404:x1875523754030592:12345-192.168.206.18@tcp:9:kworker.0 Request processed in 308us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639119.339515:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 27 00010000:00010000:2.0:1788639119.339538:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788639119.340058:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788639119.341128:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754030720 00000100:00100000:3.0:1788639119.341139:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754030720 00000100:00080000:1.0:1788639119.342190:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788639119.343682:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754030848 00000100:00100000:3.0:1788639119.343693:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754030848 00000100:00080000:1.0:1788639119.343792:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788639119.344692:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 243 00000100:00100000:0.0:1788639119.344708:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2406:x1875523754030720:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639119.344787:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2406:x1875523754030720:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 85us (6146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639119.344794:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 243 00000100:00100000:0.0:1788639119.344814:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 244 00000100:00100000:0.0:1788639119.344822:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2405:x1875523754030848:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639119.344848:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2405:x1875523754030848:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 27us (5808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639119.344853:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 244 00010000:00010000:2.0:1788639119.799461:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639120.566335:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2416e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772996224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788639120.566482:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639120.566573:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772996352:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788639120.568882:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772996224 00000100:00100000:3.0:1788639120.568897:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772996224 00000100:00100000:3.0:1788639120.568977:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788639120.568990:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f784380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772996224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788639120.569023:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788639120.569319:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788639120.571225:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639120.571417:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772996352 00000100:00100000:2.0:1788639120.571426:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772996352 00000100:00100000:2.0:1788639120.571495:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788639120.571505:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772996352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788639120.571528:0:13805:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788639120.571579:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772996352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639120.571586:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788639120.573161:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f784380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772996224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4169us (6673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639120.573174:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788639120.573303:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2416e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772996224:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788639120.574380:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788639120.574424:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772996352:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788639120.820850:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639121.845694:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639122.868804:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639123.126837:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f784000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772996480:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788639123.126904:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639123.127343:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772996480 00000100:00100000:0.0:1788639123.127352:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772996480 00000100:00100000:0.0:1788639123.127412:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788639123.127433:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2416e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772996480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788639123.127462:0:13805:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788639123.127522:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2416e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772996480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639123.127530:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:1.0:1788639123.127584:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788639123.127649:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae37f784000 x1875523772996480/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639139 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639123.127672:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f784000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772996480:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788639123.129760:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788639123.129835:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242efb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523772996608:0@lo:400:kworker.0 00000100:00100000:2.0:1788639123.129891:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639123.130020:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875523772996736:0@lo:400:kworker.0 00000100:00100000:1.0:1788639123.130053:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639123.130075:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875523772996992:0@lo:400:kworker.0 00000100:00100000:1.0:1788639123.130075:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875523772997248:0@lo:400:kworker.0 00000100:00100000:2.0:1788639123.130098:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639123.130107:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772996864:0@lo:400:kworker.0 00000100:00100000:2.0:1788639123.130114:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772997504:0@lo:400:kworker.0 00000100:00100000:1.0:1788639123.130129:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639123.130132:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639123.130145:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772998016:0@lo:400:kworker.0 00000100:00100000:1.0:1788639123.130145:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875523772997376:0@lo:400:kworker.0 00000100:00100000:2.0:1788639123.130163:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639123.130164:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639123.130177:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875523772997888:0@lo:400:kworker.0 00000100:00100000:2.0:1788639123.130178:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788639123.130182:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772997120:0@lo:400:kworker.0 00000100:00100000:1.0:1788639123.130195:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639123.130198:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639123.130209:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772997632:0@lo:400:kworker.0 00000100:00100000:1.0:1788639123.130221:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772996736 00000100:00100000:1.0:1788639123.130227:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772996736 00000100:00100000:2.0:1788639123.130237:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639123.130259:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772996992 00000100:00100000:1.0:1788639123.130260:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772997376 00000100:00100000:2.0:1788639123.130262:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772996992 00000100:00100000:1.0:1788639123.130262:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772997376 00000100:00100000:1.0:1788639123.130278:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772997888 00000100:00100000:1.0:1788639123.130281:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772997888 00000100:00100000:2.0:1788639123.130283:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788639123.130291:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875523772996736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639123.130292:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788639123.130297:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36d1abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875523772996992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639123.130329:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875523772996736:12345-0@lo:400:kworker.0 Request processed in 38us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639123.130336:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788639123.130346:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36d1abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875523772996992:12345-0@lo:400:kworker.0 Request processed in 49us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639123.130351:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788639123.130357:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875523772997376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639123.130387:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875523772997376:12345-0@lo:400:kworker.0 Request processed in 31us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639123.131124:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772996608 00000100:00100000:3.0:1788639123.131130:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772996608 00000100:00100000:3.0:1788639123.131162:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1788639123.131169:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+24:3643:x1875523772996608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639123.131212:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+24:3643:x1875523772996608:12345-0@lo:400:kworker.0 Request processed in 44us (1321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639123.131218:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1788639123.131248:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772997504 00000100:00100000:3.0:1788639123.131258:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772997504 00000100:00100000:3.0:1788639123.131283:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772998016 00000100:00100000:3.0:1788639123.131286:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772998016 00000100:00100000:3.0:1788639123.131299:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772997632 00000100:00100000:3.0:1788639123.131301:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772997632 00000100:00100000:3.0:1788639123.131313:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788639123.131318:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36d1ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772997504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639123.131349:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36d1ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772997504:12345-0@lo:400:kworker.0 Request processed in 30us (1215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639123.131355:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788639123.131365:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788639123.131370:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772998016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639123.131393:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772998016:12345-0@lo:400:kworker.0 Request processed in 23us (1229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639123.131400:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788639123.131410:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788639123.131415:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772997632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639123.132268:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772997632:12345-0@lo:400:kworker.0 Request processed in 850us (2026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639123.132276:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788639123.133048:0:12414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772996864 00000100:00100000:3.0:1788639123.133057:0:12414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772996864 00000100:00100000:3.0:1788639123.133097:0:12414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772997120 00000100:00100000:3.0:1788639123.133100:0:12414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772997120 00000100:00100000:3.0:1788639123.133114:0:12414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788639123.133121:0:12414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772996864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639123.133176:0:12414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523772996864:12345-0@lo:400:kworker.0 Request processed in 55us (3045us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639123.133195:0:12414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788639123.133207:0:12414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788639123.133213:0:12414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772997120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639123.133243:0:12414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772997120:12345-0@lo:400:kworker.0 Request processed in 30us (3044us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639123.133248:0:12414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788639123.135440:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788639123.135483:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788639123.135500:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24319b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875523772997888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639123.135580:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24319b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875523772997888:12345-0@lo:400:kworker.0 Request processed in 89us (5384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639123.135587:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00080000:1.0:1788639123.135652:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788639123.135657:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788639123.135660:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788639123.135673:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639123.135718:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36d1ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875523772997760:0@lo:400:kworker.0 00000100:00100000:1.0:1788639123.135768:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639123.135807:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875523772996736:0@lo:400:kworker.0 00000100:00100000:1.0:1788639123.135840:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772997248 00000100:00100000:1.0:1788639123.135846:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772997248 00000100:00100000:1.0:1788639123.135876:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772997760 00000100:00100000:1.0:1788639123.135879:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772997760 00000100:00100000:1.0:1788639123.135894:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788639123.135899:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24319b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875523772997248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639123.135932:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24319b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875523772997248:12345-0@lo:400:kworker.0 Request processed in 32us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639123.135938:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788639123.135948:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788639123.135954:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36e14aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875523772997760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639123.135993:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36e14aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875523772997760:12345-0@lo:400:kworker.0 Request processed in 39us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639123.135999:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00080000:1.0:1788639123.136016:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788639123.136037:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523772996864:0@lo:400:kworker.0 00010000:00080000:1.0:1788639123.136050:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae24233e300 x1875523772997376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639123.136060:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875523772997376:0@lo:400:kworker.0 00010000:00080000:1.0:1788639123.136071:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae36d1aa680 x1875523772997888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639123.136079:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875523772997888:0@lo:400:kworker.0 00000100:00100000:1.0:1788639123.136129:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772997120:0@lo:400:kworker.0 00000100:00100000:1.0:1788639123.136141:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772997632:0@lo:400:kworker.0 00000100:00100000:1.0:1788639123.136151:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875523772996992:0@lo:400:kworker.0 00000100:00100000:1.0:1788639123.136162:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772997504:0@lo:400:kworker.0 00010000:00080000:1.0:1788639123.136174:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae36d1a9180 x1875523772998016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639123.136182:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772998016:0@lo:400:kworker.0 00000100:00100000:1.0:1788639123.136192:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242efb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523772996608:0@lo:400:kworker.0 00000100:00100000:1.0:1788639123.136238:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875523772997248:0@lo:400:kworker.0 00000100:00100000:1.0:1788639123.136247:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36d1ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875523772997760:0@lo:400:kworker.0 00000100:00100000:2.0:1788639123.138354:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000040:00080000:0.0:1788639123.509289:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788639123.510383:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788639123.636929:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788639123.636953:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772998144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788639123.637028:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639123.637127:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772998144 00000100:00100000:1.0:1788639123.637134:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772998144 00000100:00100000:1.0:1788639123.637184:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788639123.637203:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f828380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772998144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788639123.637223:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788639123.637270:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f828380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523772998144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639123.637277:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:1.0:1788639123.637314:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f36680 x1875523772998144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639139 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639123.637332:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523772998144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788639123.646032:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242efb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772998272:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788639123.646100:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639123.646169:0:12414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772998272 00000100:00100000:1.0:1788639123.646177:0:12414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772998272 00000100:00100000:1.0:1788639123.646236:0:12414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788639123.646245:0:12414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772998272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788639123.646279:0:12414:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788639123.646326:0:12414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523772998272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639123.646333:0:12414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788639123.646375:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242efb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523772998272:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788639123.892781:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639124.155009:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788639124.155031:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f829880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772998400:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788639124.155095:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639124.155159:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772998400 00000100:00100000:2.0:1788639124.155167:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772998400 00000100:00100000:2.0:1788639124.155229:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788639124.155238:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772998400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788639124.155269:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788639124.155361:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523772998400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639124.155379:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788639124.155440:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f829880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523772998400:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788639124.452061:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639124.452120:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639124.452146:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639124.452172:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639124.452202:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754030976 00000100:00100000:2.0:1788639124.452211:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754030976 00000100:00100000:3.0:1788639124.452257:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754031104 00000100:00100000:3.0:1788639124.452261:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754031104 00000100:00100000:2.0:1788639124.452266:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 374 00000100:00100000:2.0:1788639124.452274:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+13:2408:x1875523754030976:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639124.452295:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754031360 00000100:00100000:3.0:1788639124.452298:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754031360 00000100:00100000:3.0:1788639124.452315:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754031488 00000100:00100000:3.0:1788639124.452318:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754031488 00000100:00100000:3.0:1788639124.452331:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 251 00000100:00100000:3.0:1788639124.452337:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2407:x1875523754031104:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639124.452337:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+13:2408:x1875523754030976:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 64us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639124.452343:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 374 00000100:00100000:3.0:1788639124.452366:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2407:x1875523754031104:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 29us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639124.452373:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 251 00000100:00100000:2.0:1788639124.452377:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 252 00000100:00100000:3.0:1788639124.452383:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 253 00000100:00100000:2.0:1788639124.452383:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2407:x1875523754031360:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639124.452389:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2407:x1875523754031488:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639124.452406:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2407:x1875523754031488:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 18us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639124.452406:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2407:x1875523754031360:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 23us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639124.452424:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 253 00000100:00080000:3.0:1788639124.452443:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788639124.452447:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788639124.454000:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639124.454039:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754031232 00000100:00100000:3.0:1788639124.454052:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754031232 00000100:00080000:0.0:1788639124.454108:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788639124.454278:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 252 00000100:00100000:3.0:1788639124.456862:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 254 00000100:00100000:3.0:1788639124.456881:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242efb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2408:x1875523754031232:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639124.457216:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242efb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2408:x1875523754031232:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 341us (3220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639124.457226:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 254 00010000:00010000:2.0:1788639124.918285:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788639125.185228:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5deb128c-4fe3-4f51-b21e-f30846e08445 00000020:00000080:1.0:1788639125.185238:0:8425:0:(genops.c:885:class_export_put()) final put ffff9ae2431aa800/5deb128c-4fe3-4f51-b21e-f30846e08445 00000020:00000080:3.0:1788639125.185365:0:13809:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae2431aa800/5deb128c-4fe3-4f51-b21e-f30846e08445 for lustre-OST0000 00000020:00000080:3.0:1788639125.185422:0:13809:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae2416ef000 for lustre-OST0000 00000100:00100000:1.0:1788639125.685810:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f82ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772998528:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788639125.685874:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639125.686001:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772998528 00000100:00100000:2.0:1788639125.686009:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772998528 00000100:00100000:2.0:1788639125.686077:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00080000:0.0:1788639125.686079:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788639125.686089:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772998528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788639125.686117:0:13805:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788639125.686172:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772998528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639125.686191:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788639125.686372:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f82ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772998528:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788639125.686537:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3691a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772998656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788639125.686568:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639125.686681:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772998656 00000100:00100000:2.0:1788639125.686686:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772998656 00000100:00100000:2.0:1788639125.686772:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788639125.686779:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f784000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772998656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788639125.686791:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788639125.686831:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f784000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523772998656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639125.686837:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788639125.687162:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3691a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523772998656:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788639125.689135:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788639125.940932:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788639126.806553:0:14060:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 16:12:06 (1788639126) 00010000:00010000:3.0:1788639126.964989:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639127.990168:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639128.227717:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639128.229092:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754031616 00000100:00100000:1.0:1788639128.229106:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754031616 00000100:00100000:1.0:1788639128.229194:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 40 00000100:00100000:1.0:1788639128.229217:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3691ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+5:11102:x1875523754031616:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00000100:00080000:0.0:1788639128.229217:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788639128.229236:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639128.229310:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c44b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e8548c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639128.229403:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262c452 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639128.229417:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262c452 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639128.229431:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262c452 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788639128.229480:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788639128.229484:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788639128.229521:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262c452 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639128.229543:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c44b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8548c expref: 7 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639128.229565:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262c452 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8548c expref: 6 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639128.229574:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae34af01600) 00010000:00010000:1.0:1788639128.229577:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788639128.229580:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fb000, rc 0) 00000100:00100000:1.0:1788639128.229879:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3691ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+6:11102:x1875523754031616:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 673us (2168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639128.229886:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 40 00000100:00100000:0.0:1788639128.242490:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639128.242585:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754031744 00000100:00100000:2.0:1788639128.242594:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754031744 00000100:00100000:2.0:1788639128.242689:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 41 00000100:00100000:2.0:1788639128.242699:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2433a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+6:11103:x1875523754031744:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788639128.242717:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639128.242737:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a400/0x25c454990262c459 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85493 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639128.242795:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262c460 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639128.242809:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262c460 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639128.242820:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262c460 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639128.242833:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c467 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639128.242854:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c467 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639128.242862:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c467 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639128.243063:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ba00/0x25c454990262c46e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639128.243072:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ba00/0x25c454990262c46e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639128.243079:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ba00/0x25c454990262c46e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788639128.243118:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788639128.243122:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788639128.243142:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ba00/0x25c454990262c46e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639128.243152:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262c460 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639128.243159:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262c460 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639128.243166:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262c460 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639128.243172:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78b000 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639128.243176:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262c460 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639128.243191:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262c460 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639128.243202:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae34af01600) 00010000:00010000:2.0:1788639128.243205:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639128.243210:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262c460 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639128.243216:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262c460 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639128.243234:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c467 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639128.243240:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c467 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639128.243246:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c467 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639128.243251:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78b600 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639128.243254:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c467 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639128.243259:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c467 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639128.243266:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9ae242359e00) 00010000:00010000:2.0:1788639128.243268:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639128.243271:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c467 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639128.243287:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c467 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639128.243322:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a400/0x25c454990262c459 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85493 expref: 8 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639128.243336:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ba00/0x25c454990262c46e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85493 expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639128.243343:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ae242359200) 00010000:00010000:2.0:1788639128.243345:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788639128.243347:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78ba00, rc 0) 00000100:00100000:2.0:1788639128.243458:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2433a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+7:11103:x1875523754031744:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 760us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639128.243466:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 41 00000100:00100000:1.0:1788639128.245597:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f82b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875523772998912:0@lo:400:kworker.0 00000100:00100000:1.0:1788639128.245690:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639128.245757:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f828e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875523772999424:0@lo:400:kworker.0 00000100:00100000:1.0:1788639128.245782:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639128.245808:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f82a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875523772999936:0@lo:400:kworker.0 00000100:00100000:1.0:1788639128.245830:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639128.245853:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1788639128.245859:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f82bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01f1eef9-e690-4065-bf99-bf821af7b626:3642:1875523772998784:0@lo:400:kworker.0 00000100:00100000:1.0:1788639128.245899:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639128.245922:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f82a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772999296:0@lo:400:kworker.0 00000100:00100000:1.0:1788639128.245945:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639128.245962:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f82b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772999808:0@lo:400:kworker.0 00000100:00100000:1.0:1788639128.245985:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639128.246002:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f82ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773000320:0@lo:400:kworker.0 00000100:00100000:1.0:1788639128.246037:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639128.246064:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772999040:0@lo:400:kworker.0 00000100:00100000:1.0:1788639128.246087:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639128.246103:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f829f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875523772999552:0@lo:400:kworker.0 00000100:00100000:1.0:1788639128.246123:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639128.246139:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875523773000064:0@lo:400:kworker.0 00000100:00100000:1.0:1788639128.246157:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639128.246171:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788639128.246177:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f82aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875523772999168:0@lo:400:kworker.0 00000100:00100000:1.0:1788639128.246210:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639128.246226:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772999680:0@lo:400:kworker.0 00000100:00100000:1.0:1788639128.246248:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639128.246274:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f82b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773000192:0@lo:400:kworker.0 00000100:00100000:1.0:1788639128.246295:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639128.246327:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772998784 00000100:00100000:1.0:1788639128.246333:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772998784 00000100:00100000:1.0:1788639128.246374:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1788639128.246383:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+24:3642:x1875523772998784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639128.246441:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ff9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+24:3642:x1875523772998784:12345-0@lo:400:kworker.0 Request processed in 59us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639128.246448:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1788639128.246478:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772999296 00000100:00100000:1.0:1788639128.246482:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772999296 00000100:00100000:1.0:1788639128.246501:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772999040 00000100:00100000:1.0:1788639128.246503:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772999040 00000100:00100000:1.0:1788639128.246515:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788639128.246520:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36d1aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772999296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639128.246554:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36d1aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772999296:12345-0@lo:400:kworker.0 Request processed in 32us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639128.246560:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788639128.246572:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788639128.246578:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772999040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639128.246611:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772999040:12345-0@lo:400:kworker.0 Request processed in 33us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639128.246638:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788639128.246658:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772999808 00000100:00100000:1.0:1788639128.246661:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772999808 00000100:00100000:1.0:1788639128.246686:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773000320 00000100:00100000:1.0:1788639128.246689:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773000320 00000100:00100000:1.0:1788639128.246699:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772999680 00000100:00100000:1.0:1788639128.246709:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772999680 00000100:00100000:1.0:1788639128.246726:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773000192 00000100:00100000:1.0:1788639128.246728:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773000192 00000100:00100000:1.0:1788639128.246742:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788639128.246747:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772999808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639128.246780:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523772999808:12345-0@lo:400:kworker.0 Request processed in 33us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639128.246785:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788639128.246796:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788639128.246802:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773000320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639128.246829:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773000320:12345-0@lo:400:kworker.0 Request processed in 27us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639128.246834:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788639128.246845:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788639128.246851:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3461b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772999680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639128.246878:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3461b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523772999680:12345-0@lo:400:kworker.0 Request processed in 27us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639128.246883:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788639128.246894:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788639128.246899:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3461b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773000192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639128.246925:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3461b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773000192:12345-0@lo:400:kworker.0 Request processed in 26us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639128.246931:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788639128.246961:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772998912 00000100:00100000:1.0:1788639128.246965:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772998912 00000100:00100000:1.0:1788639128.246982:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772999424 00000100:00100000:1.0:1788639128.246984:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772999424 00000100:00100000:1.0:1788639128.247006:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772999936 00000100:00100000:1.0:1788639128.247009:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772999936 00000100:00100000:1.0:1788639128.247018:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772999552 00000100:00100000:1.0:1788639128.247021:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772999552 00000100:00100000:1.0:1788639128.247029:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773000064 00000100:00100000:1.0:1788639128.247032:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773000064 00000100:00100000:1.0:1788639128.247042:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523772999168 00000100:00100000:1.0:1788639128.247045:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523772999168 00000100:00100000:1.0:1788639128.247057:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788639128.247062:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36d1ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875523772998912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639128.247093:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36d1ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875523772998912:12345-0@lo:400:kworker.0 Request processed in 30us (1404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639128.247100:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788639128.247113:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788639128.247119:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36d1a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875523772999424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639128.247144:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36d1a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875523772999424:12345-0@lo:400:kworker.0 Request processed in 26us (1361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639128.247150:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788639128.247161:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788639128.247166:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36d1aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875523772999936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639128.247191:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36d1aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875523772999936:12345-0@lo:400:kworker.0 Request processed in 26us (1361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639128.247197:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788639128.247207:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788639128.247213:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875523772999552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639128.247239:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875523772999552:12345-0@lo:400:kworker.0 Request processed in 27us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639128.247254:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788639128.247266:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788639128.247271:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875523773000064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639128.247300:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875523773000064:12345-0@lo:400:kworker.0 Request processed in 29us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639128.247305:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788639128.247316:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788639128.247322:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3461b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875523772999168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639128.247348:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3461b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875523772999168:12345-0@lo:400:kworker.0 Request processed in 26us (1137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639128.247353:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788639128.247402:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f82aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875523772999168:0@lo:400:kworker.0 00000100:00100000:1.0:1788639128.247416:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772999680:0@lo:400:kworker.0 00010000:00080000:1.0:1788639128.247427:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae37f82b480 x1875523773000192/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639128.247437:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f82b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773000192:0@lo:400:kworker.0 00000100:00100000:1.0:1788639128.247447:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523772999040:0@lo:400:kworker.0 00010000:00080000:1.0:1788639128.247457:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae37f829f80 x1875523772999552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639128.247464:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f829f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875523772999552:0@lo:400:kworker.0 00010000:00080000:1.0:1788639128.247474:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae37f829c00 x1875523773000064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639128.247495:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875523773000064:0@lo:400:kworker.0 00000100:00100000:1.0:1788639128.247535:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f82bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01f1eef9-e690-4065-bf99-bf821af7b626:3642:1875523772998784:0@lo:400:kworker.0 00000100:00100000:1.0:1788639128.247545:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f82a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772999296:0@lo:400:kworker.0 00000100:00100000:1.0:1788639128.247553:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f82b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523772999808:0@lo:400:kworker.0 00010000:00080000:1.0:1788639128.247562:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae37f82ad80 x1875523773000320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788639144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639128.247569:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f82ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773000320:0@lo:400:kworker.0 00000100:00100000:1.0:1788639128.247577:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f82b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875523772998912:0@lo:400:kworker.0 00000100:00100000:1.0:1788639128.247587:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f828e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875523772999424:0@lo:400:kworker.0 00000100:00100000:1.0:1788639128.247596:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f82a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875523772999936:0@lo:400:kworker.0 00000100:00080000:0.0:1788639128.249133:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788639128.249141:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788639128.249145:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788639128.249148:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788639128.252968:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788639128.252992:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f82a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773000448:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788639128.253069:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639128.253192:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773000448 00000100:00100000:3.0:1788639128.253201:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773000448 00000100:00100000:3.0:1788639128.253252:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788639128.253262:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2433a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773000448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788639128.253289:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788639128.253344:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2433a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773000448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639128.253353:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:0.0:1788639128.253382:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae37f82a680 x1875523773000448/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639144 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639128.253413:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f82a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773000448:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788639128.257714:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639128.257981:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754031872 00000100:00100000:0.0:1788639128.257991:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754031872 00000100:00100000:0.0:1788639128.258072:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 7 00000100:00100000:0.0:1788639128.258083:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5deb128c-4fe3-4f51-b21e-f30846e08445+7:11103:x1875523754031872:12345-192.168.206.18@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788639128.258171:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5deb128c-4fe3-4f51-b21e-f30846e08445+7:11103:x1875523754031872:12345-192.168.206.18@tcp:900:lhsmtool_posix.0 Request processed in 90us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639128.258179:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 7 00000100:00100000:3.0:1788639128.261027:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639128.261099:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754032128 00000100:00100000:1.0:1788639128.261109:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754032128 00000100:00100000:1.0:1788639128.261178:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 42 00000100:00100000:1.0:1788639128.261188:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3691a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+7:11103:x1875523754032128:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788639128.261208:0:10169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639128.261228:0:10169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c475 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e8549a expref: -99 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639128.261296:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262c47c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639128.261310:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262c47c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639128.261340:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262c47c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639128.261413:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c483 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639128.261421:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c483 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639128.261428:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c483 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639128.261526:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750faa00/0x25c454990262c48a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639128.261534:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750faa00/0x25c454990262c48a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639128.261540:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750faa00/0x25c454990262c48a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788639128.261548:0:10169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788639128.261662:0:10169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262c47c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639128.261670:0:10169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262c47c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639128.261677:0:10169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262c47c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639128.261682:0:10169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fae00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639128.261694:0:10169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262c47c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639128.261702:0:10169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262c47c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639128.261714:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ae242359200) 00010000:00010000:1.0:1788639128.261717:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639128.261721:0:10169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262c47c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639128.261727:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262c47c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639128.261742:0:10169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c483 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639128.261748:0:10169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c483 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639128.261754:0:10169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c483 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639128.261759:0:10169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fac00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639128.261762:0:10169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c483 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639128.261768:0:10169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c483 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639128.261774:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9ae34af01f00) 00010000:00010000:1.0:1788639128.261776:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639128.261786:0:10169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c483 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639128.261793:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c483 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639128.262080:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c475 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8549a expref: 10 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639128.262096:0:10169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750faa00/0x25c454990262c48a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8549a expref: 9 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639128.262103:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ae34af01b00) 00010000:00010000:1.0:1788639128.262106:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639128.262108:0:10169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750faa00, rc 0) 00000100:00100000:1.0:1788639128.262174:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3691a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+9:11103:x1875523754032128:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 987us (1157us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788639128.262182:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 42 00000100:00100000:1.0:1788639128.265063:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639128.265195:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754032256 00000100:00100000:3.0:1788639128.265204:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754032256 00000100:00100000:3.0:1788639128.265267:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 43 00000100:00100000:3.0:1788639128.265277:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3461b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+9:11103:x1875523754032256:12345-192.168.206.18@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788639128.265553:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3461b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+9:11103:x1875523754032256:12345-192.168.206.18@tcp:59:lhsmtool_posix.0 Request processed in 276us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639128.265574:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 43 00000100:00100000:3.0:1788639128.270787:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639128.270877:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754032384 00000100:00100000:2.0:1788639128.270886:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754032384 00000100:00100000:2.0:1788639128.270969:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 44 00000100:00100000:2.0:1788639128.270979:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae342e3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+5:11103:x1875523754032384:12345-192.168.206.18@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1788639128.271095:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:2.0:1788639128.274436:0:6516:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3413us 00000100:00100000:2.0:1788639128.298181:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae342e3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+5:11103:x1875523754032384:12345-192.168.206.18@tcp:59:lhsmtool_posix.0 Request processed in 27194us (27396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639128.298196:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 44 00000040:00080000:2.0:1788639128.629829:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788639128.630229:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788639128.757058:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3461b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773000576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788639128.757174:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639128.757279:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773000576 00000100:00100000:0.0:1788639128.757290:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773000576 00000100:00100000:0.0:1788639128.757360:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788639128.757371:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3461b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523773000576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788639128.757415:0:13805:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788639128.757485:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3461b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523773000576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639128.757493:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00080000:1.0:1788639128.758183:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae3461b5180 x1875523773000576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639144 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639128.758208:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3461b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773000576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788639128.758436:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae342e3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773000704:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788639128.758485:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639128.758576:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773000704 00000100:00100000:0.0:1788639128.758583:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773000704 00000100:00100000:0.0:1788639128.758640:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788639128.758649:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3461b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773000704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788639128.758685:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788639128.759409:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3461b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773000704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 758us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639128.759417:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788639128.759524:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae342e3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773000704:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788639129.013241:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639129.268927:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f82b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773000832:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788639129.269023:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639129.269687:0:12414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773000832 00000100:00100000:2.0:1788639129.269698:0:12414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773000832 00000100:00100000:2.0:1788639129.269770:0:12414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788639129.269781:0:12414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae342e3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773000832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788639129.269826:0:12414:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788639129.270487:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f82b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773000832:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788639129.270844:0:12414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae342e3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773000832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1062us (1819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639129.271046:0:12414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788639129.570282:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639129.570337:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639129.570372:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639129.570407:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639129.571686:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754032512 00000100:00100000:2.0:1788639129.571699:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754032512 00000100:00100000:2.0:1788639129.571750:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 376 00000100:00100000:2.0:1788639129.571761:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+13:2405:x1875523754032512:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639129.571831:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+13:2405:x1875523754032512:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 71us (1457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639129.571838:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 376 00000100:00100000:1.0:1788639129.578474:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754032640 00000100:00100000:1.0:1788639129.578488:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754032640 00000100:00100000:1.0:1788639129.578559:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754032896 00000100:00100000:1.0:1788639129.578564:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754032896 00000100:00100000:1.0:1788639129.578594:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754032768 00000100:00100000:1.0:1788639129.578597:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754032768 00000100:00100000:1.0:1788639129.578632:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 261 00000100:00100000:1.0:1788639129.578643:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2433a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+9:2405:x1875523754032640:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:1.0:1788639129.578717:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2433a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+9:2405:x1875523754032640:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 77us (8444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639129.578725:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 261 00000100:00100000:1.0:1788639129.578744:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 262 00000100:00100000:1.0:1788639129.578750:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2433a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2405:x1875523754032896:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:1.0:1788639129.578776:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2433a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2405:x1875523754032896:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 26us (8440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639129.578782:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 262 00000100:00100000:1.0:1788639129.578794:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 263 00000100:00100000:1.0:1788639129.578800:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2433a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2405:x1875523754032768:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:1.0:1788639129.578822:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2433a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2405:x1875523754032768:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 22us (8416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639129.578828:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 263 00000100:00080000:1.0:1788639129.578843:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788639129.582739:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639129.586039:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754033024 00000100:00100000:1.0:1788639129.586060:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754033024 00000100:00100000:1.0:1788639129.586172:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 264 00000100:00100000:1.0:1788639129.586184:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243950380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2405:x1875523754033024:12345-192.168.206.18@tcp:400:kworker.0 00000100:00080000:3.0:1788639129.586279:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788639129.586781:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243950380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2405:x1875523754033024:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 598us (4050us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639129.586789:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 264 00010000:00010000:1.0:1788639130.037224:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639130.067360:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639130.067402:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754033152 00000100:00100000:2.0:1788639130.067411:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754033152 00000100:00100000:2.0:1788639130.067468:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 45 00000100:00100000:2.0:1788639130.067478:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f82ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+9:11145:x1875523754033152:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:2.0:1788639130.067496:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639130.067515:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c498 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e854a1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.067572:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a400/0x25c454990262c49f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.067586:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a400/0x25c454990262c49f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.067607:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a400/0x25c454990262c49f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788639130.067635:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788639130.067641:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262c4a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.067648:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262c4a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.067655:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262c4a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.067694:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a400/0x25c454990262c49f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.067701:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a400/0x25c454990262c49f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.067707:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a400/0x25c454990262c49f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.067712:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78a400 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639130.067717:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a400/0x25c454990262c49f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.067725:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a400/0x25c454990262c49f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.067736:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae34af01600) 00010000:00010000:2.0:1788639130.067739:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639130.067743:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a400/0x25c454990262c49f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.067756:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a400/0x25c454990262c49f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.067772:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262c4a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.067778:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262c4a6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.067783:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262c4a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.067788:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78be00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639130.067791:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262c4a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.067798:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262c4a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.067805:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ae242358900) 00010000:00010000:2.0:1788639130.067807:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639130.067810:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262c4a6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.067815:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262c4a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.067849:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c498 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854a1 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.067871:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae34af01600) 00010000:00010000:2.0:1788639130.067873:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639130.067878:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c498 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854a1 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.068299:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78b600, rc 0) 00000100:00100000:2.0:1788639130.068365:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f82ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+9:11145:x1875523754033152:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 888us (1011us total) trans 0 rc 301/301 00000100:00100000:2.0:1788639130.068372:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 45 00000100:00100000:2.0:1788639130.073174:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639130.073207:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754033408 00000100:00100000:2.0:1788639130.073215:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754033408 00000100:00100000:2.0:1788639130.073278:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 46 00000100:00100000:2.0:1788639130.073289:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f82b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+9:11145:x1875523754033408:12345-192.168.206.18@tcp:36:lfs.0 00010000:00010000:2.0:1788639130.073341:0:11314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788639130.073366:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262c452 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8548c expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.073398:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae34af01600) 00010000:00010000:2.0:1788639130.073409:0:11314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788639130.073461:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ae00/0x25c454990262c4ad lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.073474:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ae00/0x25c454990262c4ad lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.073484:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ae00/0x25c454990262c4ad lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.073504:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262c4b4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.073512:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262c4b4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.073519:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262c4b4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.074279:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ac00/0x25c454990262c4bb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.074292:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ac00/0x25c454990262c4bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.074300:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ac00/0x25c454990262c4bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788639130.074318:0:11314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c0af6fbc reply state 00000000c9e32364 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ac00/0x25c454990262c4bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.074329:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ac00/0x25c454990262c4bb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.074335:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ae242358d00) 00010000:00010000:2.0:1788639130.074338:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788639130.074342:0:11314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788639130.074347:0:11314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788639130.074353:0:11314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ae00/0x25c454990262c4ad lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.074360:0:11314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ae00/0x25c454990262c4ad lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.074374:0:11314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ae00/0x25c454990262c4ad lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.074380:0:11314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78ae00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639130.074396:0:11314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ae00/0x25c454990262c4ad lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.074405:0:11314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ae00/0x25c454990262c4ad lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.074416:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae242358a00) 00010000:00010000:2.0:1788639130.074419:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639130.074422:0:11314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ae00/0x25c454990262c4ad lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.074429:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ae00/0x25c454990262c4ad lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788639130.074452:0:11314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c0af6fbc reply state 00000000c9e32364 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262c4b4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.074461:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262c4b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.074469:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ae242358400) 00010000:00010000:2.0:1788639130.074472:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788639130.074474:0:11314:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788639130.074565:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f82b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+10:11145:x1875523754033408:12345-192.168.206.18@tcp:36:lfs.0 Request processed in 1277us (1398us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788639130.074572:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 46 00000100:00100000:0.0:1788639130.117607:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639130.117840:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754033536 00000100:00100000:1.0:1788639130.117850:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754033536 00000100:00100000:1.0:1788639130.117991:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 47 00000100:00100000:1.0:1788639130.118001:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243951880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+10:11153:x1875523754033536:12345-192.168.206.18@tcp:101:lctl.0 00010000:00010000:1.0:1788639130.118025:0:10169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639130.118047:0:10169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c4c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e854a8 expref: -99 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.118111:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262c4c9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.118125:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262c4c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.118137:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262c4c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788639130.118180:0:10169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788639130.118184:0:10169:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788639130.118223:0:10169:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262c4c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.118247:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c4c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854a8 expref: 12 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.118280:0:10169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262c4c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854a8 expref: 11 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.118288:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae362514000) 00010000:00010000:1.0:1788639130.118291:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788639130.118295:0:10169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fb600, rc 0) 00000100:00100000:1.0:1788639130.118351:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243951880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+11:11153:x1875523754033536:12345-192.168.206.18@tcp:101:lctl.0 Request processed in 348us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639130.118359:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 47 00000100:00100000:2.0:1788639130.170311:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639130.170401:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754033664 00000100:00100000:0.0:1788639130.170411:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754033664 00000100:00100000:0.0:1788639130.170476:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 48 00000100:00100000:0.0:1788639130.170486:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f82a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+11:11159:x1875523754033664:12345-192.168.206.18@tcp:101:bash.0 00010000:00010000:0.0:1788639130.170504:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639130.170535:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030800/0x25c454990262c4d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e854af expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639130.170592:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031600/0x25c454990262c4d7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639130.170605:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031600/0x25c454990262c4d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639130.170711:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031600/0x25c454990262c4d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.171502:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c4de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.171515:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c4de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.171524:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c4de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.171604:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fba00/0x25c454990262c4e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.171612:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fba00/0x25c454990262c4e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.171643:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fba00/0x25c454990262c4e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788639130.171679:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788639130.171683:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788639130.171732:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fba00/0x25c454990262c4e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.171744:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031600/0x25c454990262c4d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.171750:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031600/0x25c454990262c4d7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.171757:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031600/0x25c454990262c4d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.171762:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae340031600 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639130.171766:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031600/0x25c454990262c4d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.171774:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031600/0x25c454990262c4d7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.171786:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae362514000) 00010000:00010000:1.0:1788639130.171789:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639130.171793:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031600/0x25c454990262c4d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.171798:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031600/0x25c454990262c4d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.171812:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c4de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.171818:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c4de lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.171823:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c4de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.171912:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fb400 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639130.171915:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c4de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.171921:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c4de lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.171929:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ae242358400) 00010000:00010000:1.0:1788639130.171931:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639130.171934:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c4de lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.171940:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c4de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.172098:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030800/0x25c454990262c4d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854af expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.172115:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fba00/0x25c454990262c4e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854af expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.172123:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ae242358d00) 00010000:00010000:1.0:1788639130.172125:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788639130.172128:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fba00, rc 0) 00000100:00100000:1.0:1788639130.172446:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f82a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+12:11159:x1875523754033664:12345-192.168.206.18@tcp:101:bash.0 Request processed in 1960us (2142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639130.172455:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 48 00000100:00100000:2.0:1788639130.176240:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639130.176339:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754033920 00000100:00100000:0.0:1788639130.176349:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754033920 00000100:00100000:0.0:1788639130.176418:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 49 00000100:00100000:0.0:1788639130.176428:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f82bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+12:11159:x1875523754033920:12345-192.168.206.18@tcp:101:bash.0 00010000:00010000:0.0:1788639130.176448:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639130.176467:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031000/0x25c454990262c4ec lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e854b6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639130.176568:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030400/0x25c454990262c4f3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639130.176583:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030400/0x25c454990262c4f3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639130.176594:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030400/0x25c454990262c4f3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639130.177679:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030e00/0x25c454990262c4fa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639130.177714:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030e00/0x25c454990262c4fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639130.177725:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030e00/0x25c454990262c4fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788639130.178320:0:6516:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:0.0:1788639130.178583:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262c501 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639130.178594:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262c501 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639130.178609:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262c501 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639130.178682:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030400/0x25c454990262c4f3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639130.178691:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030400/0x25c454990262c4f3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639130.178698:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030400/0x25c454990262c4f3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639130.178705:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae340030400 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639130.178710:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030400/0x25c454990262c4f3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639130.178718:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030400/0x25c454990262c4f3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639130.178743:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ae242358d00) 00010000:00010000:0.0:1788639130.178747:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639130.178752:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030400/0x25c454990262c4f3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639130.178759:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030400/0x25c454990262c4f3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788639130.178914:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006b9c3713 reply state 0000000017d51bd6 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030e00/0x25c454990262c4fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639130.178926:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030e00/0x25c454990262c4fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639130.178933:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ae2430f5600) 00010000:00010000:0.0:1788639130.178935:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788639130.178939:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788639130.178986:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031000/0x25c454990262c4ec lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854b6 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639130.179002:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262c501 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854b6 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639130.179009:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae2430f5800) 00010000:00010000:0.0:1788639130.179012:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788639130.179014:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375ef5e00, rc 0) 00000100:00100000:0.0:1788639130.179090:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f82bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+15:11159:x1875523754033920:12345-192.168.206.18@tcp:101:bash.0 Request processed in 2662us (2859us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788639130.179098:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 49 00000100:00100000:0.0:1788639130.196841:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639130.197081:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754034048 00000100:00100000:1.0:1788639130.197340:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754034048 00000100:00100000:1.0:1788639130.197449:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 28 00000100:00100000:1.0:1788639130.197457:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243950000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2404:x1875523754034048:12345-192.168.206.18@tcp:8:bash.0 00010000:00080000:1.0:1788639130.197495:0:8432:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 5deb128c-4fe3-4f51-b21e-f30846e08445@192.168.206.18@tcp t0 exp 0000000000000000 cur 388 last 0 00000020:00000080:1.0:1788639130.197527:0:8432:0:(genops.c:1385:class_connect()) connect: client 5deb128c-4fe3-4f51-b21e-f30846e08445, cookie 0x25c454990262c50f 00002000:00100000:1.0:1788639130.197538:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5deb128c-4fe3-4f51-b21e-f30846e08445/ffff9ae37f753000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788639130.197549:0:8432:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788639130.197647:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788639130.197690:0:8432:0:(import.c:65:import_set_state_nolock()) ffff9ae37f755000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788639130.197759:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243950000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2404:x1875523754034048:12345-192.168.206.18@tcp:8:bash.0 Request processed in 300us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639130.197766:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 28 00000100:00100000:3.0:1788639130.200823:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639130.200978:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754034176 00000100:00100000:1.0:1788639130.200987:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754034176 00000100:00100000:1.0:1788639130.201103:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 29 00000100:00100000:1.0:1788639130.201124:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f78d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+6:0:x1875523754034176:12345-192.168.206.18@tcp:101:bash.0 00010000:00010000:1.0:1788639130.201141:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639130.201162:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aafee9b0/0x25c454990262c516 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e854bd expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788639130.201188:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788639130.201207:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=388s v=(0 0) 00010000:00010000:1.0:1788639130.201212:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639130.201222:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aafee9b0/0x25c454990262c516 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854bd expref: 7 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.201262:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000aafee9b0/0x25c454990262c516 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854bd expref: 7 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.201275:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fb400, rc 0) 00000100:00100000:1.0:1788639130.201331:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f78d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+7:0:x1875523754034176:12345-192.168.206.18@tcp:101:bash.0 Request processed in 210us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639130.201338:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 29 00000100:00080000:3.0:1788639130.202756:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788639130.208532:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639130.209042:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754034304 00000100:00100000:3.0:1788639130.209053:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754034304 00000100:00100000:3.0:1788639130.209255:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 30 00000100:00100000:3.0:1788639130.209267:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f829c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+7:11159:x1875523754034304:12345-192.168.206.18@tcp:101:bash.0 00010000:00010000:3.0:1788639130.209284:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639130.209303:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1b946ca/0x25c454990262c51d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e854c4 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.209332:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000aafee9b0/0x25c454990262c516 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854bd expref: 8 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.209341:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788639130.209345:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639130.209350:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1b946ca/0x25c454990262c51d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854c4 expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.209394:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000aafee9b0/0x25c454990262c516 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854bd expref: 8 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.209419:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000aafee9b0/0x25c454990262c516 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854bd expref: 8 pid: 8430 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639130.209433:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f78fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8431:1875523773000960:192.168.206.18@tcp:104: 00000100:00100000:3.0:1788639130.209525:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae35058acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788639130.215166:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639130.215402:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f78fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8431:1875523773000960:192.168.206.18@tcp:104: 00010000:00010000:3.0:1788639130.215437:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d1b946ca/0x25c454990262c51d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854c4 expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.215458:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae38217b000, rc 0) 00000100:00100000:3.0:1788639130.215520:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f829c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+8:11159:x1875523754034304:12345-192.168.206.18@tcp:101:bash.0 Request processed in 6254us (6995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639130.215530:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 30 00000100:00100000:1.0:1788639130.216801:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754034432 00000100:00100000:1.0:1788639130.216813:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754034432 00010000:00010000:1.0:1788639130.216852:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000aafee9b0/0x25c454990262c516 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854bd expref: 8 pid: 8430 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639130.217311:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 52 00000100:00100000:1.0:1788639130.217323:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ffa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+8:2407:x1875523754034432:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788639130.217339:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788639130.217360:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000aafee9b0/0x25c454990262c516 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854bd expref: 8 pid: 8430 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.217374:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000aafee9b0/0x25c454990262c516 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854bd expref: 8 pid: 8430 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.217409:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aafee9b0/0x25c454990262c516 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854bd expref: 8 pid: 8430 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.217444:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639130.217448:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639130.217457:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d1b946ca/0x25c454990262c51d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854c4 expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.217466:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1b946ca/0x25c454990262c51d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854c4 expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.217503:0:6500:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d1b946ca/0x25c454990262c51d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854c4 expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639130.217517:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3461b6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6500:1875523773001088:192.168.206.18@tcp:105: 00000100:00100000:1.0:1788639130.217597:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2420b3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788639130.229956:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639130.230065:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3461b6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6500:1875523773001088:192.168.206.18@tcp:105: 00010000:00010000:1.0:1788639130.230087:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788639130.230144:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ffa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+7:2407:x1875523754034432:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 12823us (14987us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639130.230154:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 52 00000100:00100000:3.0:1788639130.230376:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754034688 00000100:00100000:3.0:1788639130.230392:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754034688 00000100:00100000:3.0:1788639130.230437:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 6 00000100:00100000:3.0:1788639130.230447:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243950700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+15:11159:x1875523754034688:12345-192.168.206.18@tcp:35:bash.0 00000001:00080000:3.0:1788639130.230688:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967314 00000100:00100000:3.0:1788639130.230779:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243950700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+17:11159:x1875523754034688:12345-192.168.206.18@tcp:35:bash.0 Request processed in 333us (831us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788639130.230787:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 6 00000020:00080000:3.0:1788639130.230790:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788639130.344513:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639130.344732:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754034944 00000100:00100000:1.0:1788639130.344746:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754034944 00000100:00100000:1.0:1788639130.344824:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 50 00000100:00100000:1.0:1788639130.344836:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243950a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+17:11169:x1875523754034944:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:1.0:1788639130.344877:0:10169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639130.344906:0:10169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c524 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e854cb expref: -99 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788639130.345081:0:10169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788639130.345239:0:10169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c524 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854cb expref: 19 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.345257:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae362514000) 00010000:00010000:1.0:1788639130.345260:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788639130.345278:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c524 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854cb expref: 19 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.345295:0:10169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fb400, rc 0) 00000100:00100000:1.0:1788639130.345368:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243950a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+18:11169:x1875523754034944:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 534us (869us total) trans 4294967316 rc 301/301 00000100:00100000:1.0:1788639130.345377:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 50 00000100:00100000:0.0:1788639130.352529:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639130.352677:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754035200 00000100:00100000:3.0:1788639130.352691:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754035200 00000100:00100000:3.0:1788639130.352788:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 7 00000100:00100000:3.0:1788639130.352800:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243952d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+18:11169:x1875523754035200:12345-192.168.206.18@tcp:35:lfs.0 00000100:00100000:3.0:1788639130.353915:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243952d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+19:11169:x1875523754035200:12345-192.168.206.18@tcp:35:lfs.0 Request processed in 1108us (1394us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788639130.353927:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 7 00000100:00100000:2.0:1788639130.413763:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639130.413871:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754035328 00000100:00100000:1.0:1788639130.413881:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754035328 00000100:00100000:1.0:1788639130.413984:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 51 00000100:00100000:1.0:1788639130.413995:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+19:11175:x1875523754035328:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:1.0:1788639130.414017:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639130.414039:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c532 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e854d2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.414108:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c539 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.414123:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c539 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.414153:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c539 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788639130.414193:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788639130.414197:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788639130.414214:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c539 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.414238:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c532 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854d2 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.414256:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c539 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854d2 expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.414264:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ae242358d00) 00010000:00010000:1.0:1788639130.414267:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788639130.414271:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fbe00, rc 0) 00000100:00100000:1.0:1788639130.414335:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+20:11175:x1875523754035328:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 343us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639130.414342:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 51 00000100:00100000:0.0:1788639130.422093:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639130.422320:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754035584 00000100:00100000:2.0:1788639130.422330:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754035584 00000100:00100000:2.0:1788639130.422397:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 52 00000100:00100000:2.0:1788639130.422408:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+20:11175:x1875523754035584:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:2.0:1788639130.422425:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639130.422445:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262c540 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e854d9 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.422547:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b800/0x25c454990262c547 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.422562:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b800/0x25c454990262c547 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.422574:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b800/0x25c454990262c547 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788639130.422584:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788639130.422700:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262c540 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854d9 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.422721:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b800/0x25c454990262c547 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854d9 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.422730:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae2430f5800) 00010000:00010000:2.0:1788639130.422745:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788639130.422749:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78b800, rc 0) 00000100:00100000:2.0:1788639130.422814:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+22:11175:x1875523754035584:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 407us (728us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788639130.422821:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 52 00000100:00100000:0.0:1788639130.427257:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639130.427553:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754035968 00000100:00100000:3.0:1788639130.427563:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754035968 00000100:00100000:3.0:1788639130.427669:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 3 00000100:00100000:3.0:1788639130.427680:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243953100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+22:2408:x1875523754035968:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788639130.427696:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639130.427719:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b800/0x25c454990262c547 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854d9 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.427756:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae2430f5800) 00000100:00100000:0.0:1788639130.427826:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639130.428159:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754035840 00000100:00100000:2.0:1788639130.428164:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754035840 00000100:00100000:2.0:1788639130.428265:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 53 00000100:00100000:2.0:1788639130.428274:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243951180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+22:11175:x1875523754035840:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:2.0:1788639130.428294:0:10169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639130.428310:0:10169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262c555 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e854e0 expref: -99 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.428405:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788639130.428469:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262c55c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.428484:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262c55c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.428544:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262c55c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788639130.428557:0:10169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788639130.428679:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262c555 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854e0 expref: 25 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.428699:0:10169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262c55c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854e0 expref: 24 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.428725:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae2430f5800) 00010000:00010000:2.0:1788639130.428728:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788639130.428730:0:10169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78a800, rc 0) 00000100:00100000:2.0:1788639130.429088:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243951180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+24:11175:x1875523754035840:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 813us (1260us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1788639130.429096:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 53 00000100:00100000:3.0:1788639130.429452:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243953100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+23:2408:x1875523754035968:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 1431us (1860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639130.429531:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 3 00000100:00100000:0.0:1788639130.438968:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639130.439090:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754036096 00000100:00100000:1.0:1788639130.439100:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754036096 00000100:00100000:1.0:1788639130.439160:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 31 00000100:00100000:1.0:1788639130.439171:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243952a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+7:2405:x1875523754036096:12345-192.168.206.18@tcp:1:lfs.0 00010000:00010000:1.0:1788639130.439219:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aafee9b0/0x25c454990262c56a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.439241:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d1b946ca/0x25c454990262c51d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854c4 expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.439263:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639130.439268:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788639130.439273:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aafee9b0/0x25c454990262c56a lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.439890:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d1b946ca/0x25c454990262c51d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854c4 expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.439907:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d1b946ca/0x25c454990262c51d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854c4 expref: 7 pid: 8431 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639130.439935:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3461b6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1875523773001216:192.168.206.18@tcp:104: 00000100:00100000:1.0:1788639130.440036:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2420b3180 going to sleep for 11 seconds 00000100:00100000:0.0:1788639130.446278:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639130.446527:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3461b6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1875523773001216:192.168.206.18@tcp:104: 00010000:00010000:1.0:1788639130.446554:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000aafee9b0/0x25c454990262c56a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639130.446612:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754036224 00000100:00100000:3.0:1788639130.446646:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754036224 00002000:00100000:3.0:1788639130.446692:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9ae243952300 x1875523754036224/t0(0) o4->5deb128c-4fe3-4f51-b21e-f30846e08445@192.168.206.18@tcp:351/0 lens 504/0 e 0 to 0 dl 1788639141 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788639130.446703:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae243952300 with x1875523754036224 ext(0->12) 00010000:00010000:3.0:1788639130.446710:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d1b946ca/0x25c454990262c51d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854c4 expref: 8 pid: 8431 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.446740:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d1b946ca/0x25c454990262c51d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854c4 expref: 8 pid: 8431 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788639130.446748:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ae243952300 00000100:00100000:3.0:1788639130.446772:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 0 00000100:00100000:3.0:1788639130.446782:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243952300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+8:2408:x1875523754036224:12345-192.168.206.18@tcp:4:lfs.0 00000001:00100000:2.0:1788639130.451150:0:9509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5deb128c-4fe3-4f51-b21e-f30846e08445 00000100:00100000:3.0:1788639130.452018:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243952300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+9:2408:x1875523754036224:12345-192.168.206.18@tcp:4:lfs.0 Request processed in 5231us (5742us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788639130.452030:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 0 00002000:00100000:3.0:1788639130.452041:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9ae243952300 x1875523754036224/t4294967300(0) o4->5deb128c-4fe3-4f51-b21e-f30846e08445@192.168.206.18@tcp:351/0 lens 504/448 e 0 to 0 dl 1788639141 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788639130.452051:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae243952300 with x1875523754036224 ext(0->12) 00010000:00010000:3.0:1788639130.452060:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d1b946ca/0x25c454990262c51d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854c4 expref: 9 pid: 8431 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.452077:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d1b946ca/0x25c454990262c51d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854c4 expref: 9 pid: 8431 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788639130.452084:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ae243952300 00000100:00100000:0.0:1788639130.457658:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639130.457735:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754036352 00000100:00100000:1.0:1788639130.457745:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754036352 00010000:00010000:1.0:1788639130.457782:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d1b946ca/0x25c454990262c51d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854c4 expref: 9 pid: 8431 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639130.457878:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 53 00000100:00100000:1.0:1788639130.457899:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243950e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+9:2408:x1875523754036352:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788639130.457928:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788639130.457943:0:6500:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788639130.457946:0:6500:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788639131 00002000:00010000:1.0:1788639130.457948:0:6500:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788639131 00002000:00010000:1.0:1788639130.457950:0:6500:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788639131 00002000:00010000:1.0:1788639130.457952:0:6500:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788639130.457959:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d1b946ca/0x25c454990262c51d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854c4 expref: 9 pid: 8431 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.457973:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d1b946ca/0x25c454990262c51d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854c4 expref: 9 pid: 8431 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.457996:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1b946ca/0x25c454990262c51d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854c4 expref: 9 pid: 8431 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.458013:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788639130.458017:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788639130.458023:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000aafee9b0/0x25c454990262c56a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.458033:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aafee9b0/0x25c454990262c56a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.458071:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788639130.458126:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243950e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+8:2408:x1875523754036352:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 239us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639130.458133:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 53 00010000:00010000:2.0:1788639130.458197:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000aafee9b0/0x25c454990262c56a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.458207:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aafee9b0/0x25c454990262c56a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.458227:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aafee9b0/0x25c454990262c56a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.458235:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aafee9b0/0x25c454990262c56a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.458243:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aafee9b0/0x25c454990262c56a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.458248:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fb400 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:2.0:1788639130.458252:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aafee9b0/0x25c454990262c56a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.458271:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aafee9b0/0x25c454990262c56a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.458285:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aafee9b0/0x25c454990262c56a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.458293:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aafee9b0/0x25c454990262c56a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639130.458340:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243952a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+7:2405:x1875523754036096:12345-192.168.206.18@tcp:1:lfs.0 Request processed in 19171us (19381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639130.458348:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 31 00000100:00100000:0.0:1788639130.462511:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639130.462654:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754036608 00000100:00100000:3.0:1788639130.462664:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754036608 00000100:00100000:3.0:1788639130.462718:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 8 00000100:00100000:3.0:1788639130.462728:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243951f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+23:11175:x1875523754036608:12345-192.168.206.18@tcp:35:lfs.0 00000004:00010000:3.0:1788639130.462815:0:6520:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262c55c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854e0 expref: 23 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788639130.463243:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1788639130.463282:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000001:00080000:3.0:1788639130.463596:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00010000:00010000:3.0:1788639130.463713:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a600/0x25c454990262c571 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.463729:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262c501 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854b6 expref: 27 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.463739:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a600/0x25c454990262c571 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.463773:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262c501 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854b6 expref: 27 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.463789:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262c501 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854b6 expref: 27 pid: 6516 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639130.463803:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f78fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6520:1875523773001344:192.168.206.18@tcp:104: 00000100:00100000:3.0:1788639130.463941:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae35058a000 going to sleep for 11 seconds 00000100:00100000:3.0:1788639130.466017:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f78fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6520:1875523773001344:192.168.206.18@tcp:104: 00010000:00010000:3.0:1788639130.466044:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a600/0x25c454990262c571 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639130.468358:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639130.469075:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754036736 00000100:00100000:3.0:1788639130.469095:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754036736 00010000:00010000:3.0:1788639130.469134:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262c501 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854b6 expref: 28 pid: 6516 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639130.469206:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 54 00000100:00100000:3.0:1788639130.469216:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243951500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+28:2407:x1875523754036736:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788639130.469295:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639130.469303:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262c501 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854b6 expref: 28 pid: 6516 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.469317:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262c501 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854b6 expref: 28 pid: 6516 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.469339:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262c501 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854b6 expref: 28 pid: 6516 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.469357:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae2430f5800) 00010000:00010000:3.0:1788639130.469362:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a600/0x25c454990262c571 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.469371:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a600/0x25c454990262c571 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.469389:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a600/0x25c454990262c571 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.469422:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639130.469520:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243951500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+27:2407:x1875523754036736:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 305us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639130.469537:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 54 00010000:00010000:0.0:1788639130.469662:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a600/0x25c454990262c571 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639130.469670:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a600/0x25c454990262c571 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788639130.469769:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000001:00080000:0.0:1788639130.469922:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:0.0:1788639130.470007:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243953800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6520:1875523773001472:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788639130.470058:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639130.470090:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3801ec780 going to sleep for 11 seconds 00000100:00100000:1.0:1788639130.470236:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773001472 00000100:00100000:1.0:1788639130.470242:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773001472 00000100:00100000:1.0:1788639130.470295:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00080000:0.0:1788639130.470299:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788639130.470305:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6520:x1875523773001472:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788639130.470399:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6520:x1875523773001472:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 97us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639130.470406:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788639130.470450:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243953800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6520:1875523773001472:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788639130.470587:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00000100:00100000:0.0:1788639130.470647:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243953800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6520:1875523773001600:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788639130.470684:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639130.470709:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3801ecc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788639130.470824:0:12414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773001600 00000100:00100000:2.0:1788639130.470829:0:12414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773001600 00000100:00100000:2.0:1788639130.470864:0:12414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788639130.470871:0:12414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243951c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6520:x1875523773001600:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788639130.471152:0:12414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243951c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6520:x1875523773001600:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 281us (467us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788639130.471160:0:12414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788639130.471669:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243953800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6520:1875523773001600:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788639130.471720:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:1.0:1788639130.471753:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a600/0x25c454990262c571 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.471763:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a600/0x25c454990262c571 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.471770:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a600/0x25c454990262c571 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.471776:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae38217a600 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639130.471781:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a600/0x25c454990262c571 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.471797:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a600/0x25c454990262c571 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.471812:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae2430f5800) 00010000:00010000:1.0:1788639130.471815:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788639130.471819:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a600/0x25c454990262c571 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.471825:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a600/0x25c454990262c571 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788639130.472025:0:6520:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788639130.472073:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1788639130.472082:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 389266465692ns, next at 390266463679ns, rc = 0 00000001:00080000:1.0:1788639130.472087:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967327 00010000:00010000:1.0:1788639130.472107:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae2430f5800) 00010000:00010000:1.0:1788639130.472110:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788639130.472116:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262c55c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854e0 expref: 31 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639130.472209:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243951f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+30:11175:x1875523754036608:12345-192.168.206.18@tcp:35:lfs.0 Request processed in 9482us (9705us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1788639130.472221:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 8 00000020:00080000:1.0:1788639130.472289:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788639130.474720:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639130.474761:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754036864 00000100:00100000:1.0:1788639130.474770:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754036864 00000100:00100000:3.0:1788639130.474935:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 54 00000100:00100000:3.0:1788639130.474948:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+30:11175:x1875523754036864:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:3.0:1788639130.474968:0:11314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639130.474989:0:11314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b600/0x25c454990262c578 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e854e7 expref: -99 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.475043:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b600/0x25c454990262c578 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854e7 expref: 31 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.475058:0:11314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b600/0x25c454990262c578 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854e7 expref: 31 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.475075:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae242381f00) 00010000:00010000:3.0:1788639130.475079:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788639130.475083:0:11314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae38217b600, rc 0) 00000100:00100000:3.0:1788639130.475230:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+31:11175:x1875523754036864:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 286us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639130.475238:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 54 00000100:00100000:0.0:1788639130.478748:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639130.478886:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754037120 00000100:00100000:2.0:1788639130.478896:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754037120 00000100:00100000:2.0:1788639130.478981:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 9 00000100:00100000:2.0:1788639130.478992:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ef5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+31:11175:x1875523754037120:12345-192.168.206.18@tcp:35:lfs.0 00000100:00100000:2.0:1788639130.479205:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ef5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+32:11175:x1875523754037120:12345-192.168.206.18@tcp:35:lfs.0 Request processed in 215us (466us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1788639130.479234:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 9 00000100:00100000:2.0:1788639130.541904:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639130.541964:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754037376 00000100:00100000:0.0:1788639130.541975:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754037376 00000100:00100000:0.0:1788639130.542039:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 55 00000100:00100000:0.0:1788639130.542051:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+32:11185:x1875523754037376:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:0.0:1788639130.542079:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639130.542100:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262c57f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e854ee expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788639130.542204:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788639130.542304:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262c57f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854ee expref: 34 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639130.542318:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae362514000) 00010000:00010000:0.0:1788639130.542321:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788639130.542326:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262c57f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854ee expref: 34 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639130.542339:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375ef4000, rc 0) 00000100:00100000:0.0:1788639130.542407:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+33:11185:x1875523754037376:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 358us (510us total) trans 4294967330 rc 301/301 00000100:00100000:0.0:1788639130.542414:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 55 00000100:00100000:0.0:1788639130.546080:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639130.546167:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754037504 00000100:00100000:2.0:1788639130.546176:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754037504 00000100:00100000:2.0:1788639130.546245:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 56 00000100:00100000:2.0:1788639130.546255:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243950700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+33:11185:x1875523754037504:12345-192.168.206.18@tcp:34:lfs.0 00010000:00010000:2.0:1788639130.546324:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262c58d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.546341:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262c58d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.546352:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262c58d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.546365:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c594 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.546372:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c594 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.546391:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c594 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.546460:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ae00/0x25c454990262c59b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.546469:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ae00/0x25c454990262c59b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.546476:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ae00/0x25c454990262c59b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788639130.546542:0:10169:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ae00/0x25c454990262c59b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.546554:0:10169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262c58d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.546560:0:10169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262c58d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.546566:0:10169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262c58d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.546571:0:10169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78be00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639130.546576:0:10169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262c58d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.546582:0:10169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262c58d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.546594:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ae242358d00) 00010000:00010000:2.0:1788639130.546596:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639130.546601:0:10169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262c58d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.546607:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262c58d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.546667:0:10169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c594 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.546674:0:10169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c594 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.546687:0:10169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c594 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.546692:0:10169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78b600 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639130.546695:0:10169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c594 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.546700:0:10169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c594 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.546709:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ae2430f5600) 00010000:00010000:2.0:1788639130.546711:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639130.546714:0:10169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c594 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.546720:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c594 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.546732:0:10169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ae00/0x25c454990262c59b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.546738:0:10169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ae00/0x25c454990262c59b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.546743:0:10169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ae00/0x25c454990262c59b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.546747:0:10169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78ae00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639130.546750:0:10169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ae00/0x25c454990262c59b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.546777:0:10169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ae00/0x25c454990262c59b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.546785:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae242381f00) 00010000:00010000:2.0:1788639130.546787:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639130.546791:0:10169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ae00/0x25c454990262c59b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.546796:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ae00/0x25c454990262c59b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639130.546863:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243950700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+33:11185:x1875523754037504:12345-192.168.206.18@tcp:34:lfs.0 Request processed in 608us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639130.546872:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 56 00000100:00100000:2.0:1788639130.550063:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639130.550124:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754037760 00000100:00100000:1.0:1788639130.550133:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754037760 00000100:00100000:1.0:1788639130.550185:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 10 00000100:00100000:1.0:1788639130.550209:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f82b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+33:11185:x1875523754037760:12345-192.168.206.18@tcp:35:lfs.0 00000100:00100000:1.0:1788639130.550426:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f82b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+34:11185:x1875523754037760:12345-192.168.206.18@tcp:35:lfs.0 Request processed in 218us (369us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1788639130.550435:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 10 00000100:00100000:0.0:1788639130.588370:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639130.588487:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754038016 00000100:00100000:3.0:1788639130.588497:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754038016 00000100:00100000:3.0:1788639130.588564:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 57 00000100:00100000:3.0:1788639130.588574:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243952d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+34:11188:x1875523754038016:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:3.0:1788639130.588596:0:11314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639130.588653:0:11314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a200/0x25c454990262c5a2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e854f5 expref: -99 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.588744:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c5a9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.588759:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c5a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.588771:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c5a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.588784:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a600/0x25c454990262c5b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.588792:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a600/0x25c454990262c5b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.588798:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a600/0x25c454990262c5b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.588969:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c5b7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.588978:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c5b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.588985:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c5b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788639130.588996:0:11314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788639130.589071:0:11314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c5a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.589087:0:11314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c5a9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.589093:0:11314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c5a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.589099:0:11314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae38217b800 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639130.589103:0:11314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c5a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.589110:0:11314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c5a9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.589122:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ae242358d00) 00010000:00010000:3.0:1788639130.589125:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639130.589129:0:11314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c5a9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.589135:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c5a9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.589151:0:11314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a600/0x25c454990262c5b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.589156:0:11314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a600/0x25c454990262c5b0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.589161:0:11314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a600/0x25c454990262c5b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.589167:0:11314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae38217a600 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639130.589175:0:11314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a600/0x25c454990262c5b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.589181:0:11314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a600/0x25c454990262c5b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.589189:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ae2430f5600) 00010000:00010000:3.0:1788639130.589192:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639130.589195:0:11314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a600/0x25c454990262c5b0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.589201:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a600/0x25c454990262c5b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.589249:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a200/0x25c454990262c5a2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854f5 expref: 37 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.589264:0:11314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c5b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854f5 expref: 36 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.589271:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae242381f00) 00010000:00010000:3.0:1788639130.589273:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788639130.589275:0:11314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae38217b000, rc 0) 00000100:00100000:3.0:1788639130.589346:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243952d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+36:11188:x1875523754038016:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 774us (985us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1788639130.589354:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 57 00000100:00100000:0.0:1788639130.593664:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639130.594078:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754038144 00000100:00100000:1.0:1788639130.594089:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754038144 00000100:00100000:1.0:1788639130.594151:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 58 00000100:00100000:1.0:1788639130.594162:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243951f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+36:11188:x1875523754038144:12345-192.168.206.18@tcp:54:lfs.0 00010000:00010000:1.0:1788639130.594252:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262c5c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.594270:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262c5c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.594282:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262c5c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.594321:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262c5c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.594328:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262c5c5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.594335:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262c5c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.594340:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fb000 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639130.594344:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262c5c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.594352:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262c5c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.594363:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae242381f00) 00010000:00010000:1.0:1788639130.594366:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788639130.594371:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262c5c5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.594377:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262c5c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639130.594470:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243951f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+36:11188:x1875523754038144:12345-192.168.206.18@tcp:54:lfs.0 Request processed in 309us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639130.594478:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 58 00000100:00100000:2.0:1788639130.601556:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639130.601675:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754038400 00000100:00100000:1.0:1788639130.601686:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754038400 00000100:00100000:1.0:1788639130.601740:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 11 00000100:00100000:1.0:1788639130.601751:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+36:11188:x1875523754038400:12345-192.168.206.18@tcp:35:lfs.0 00000100:00100000:1.0:1788639130.601995:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+37:11188:x1875523754038400:12345-192.168.206.18@tcp:35:lfs.0 Request processed in 245us (447us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1788639130.602004:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 11 00000100:00100000:2.0:1788639130.805586:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788639130.805609:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f78fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773001728:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788639130.805703:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639130.805845:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773001728 00000100:00100000:3.0:1788639130.805853:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773001728 00000100:00100000:3.0:1788639130.805913:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788639130.805925:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f82aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773001728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788639130.805960:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788639130.806007:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f82aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773001728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639130.806014:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788639130.806055:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f78fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773001728:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788639130.806464:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788639130.806628:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788639130.806648:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f82b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773001856:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788639130.806694:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639130.806821:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773001856 00000100:00100000:1.0:1788639130.806826:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773001856 00000100:00100000:1.0:1788639130.806872:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788639130.806880:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773001856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788639130.806894:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788639130.806931:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773001856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639130.806937:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:0.0:1788639130.807637:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788639130.807685:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f82b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773001856:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788639130.812271:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639130.812355:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754038656 00000100:00100000:1.0:1788639130.812364:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754038656 00000100:00100000:1.0:1788639130.812469:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 59 00000100:00100000:1.0:1788639130.812479:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f83aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+37:11219:x1875523754038656:12345-192.168.206.18@tcp:101:cat.0 00010000:00010000:1.0:1788639130.812499:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639130.812518:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262c5cc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e854fc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.812687:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262c5d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.812701:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262c5d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.812712:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262c5d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788639130.812723:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788639130.812850:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262c5cc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854fc expref: 40 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.812869:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262c5d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854fc expref: 39 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.812878:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae242381f00) 00010000:00010000:1.0:1788639130.812881:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788639130.812885:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fa200, rc 0) 00000100:00100000:1.0:1788639130.812937:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f83aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+39:11219:x1875523754038656:12345-192.168.206.18@tcp:101:cat.0 Request processed in 459us (673us total) trans 4294967334 rc 0/0 00000100:00100000:1.0:1788639130.812944:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 59 00000100:00100000:0.0:1788639130.817870:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639130.817918:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639130.818205:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754038784 00000100:00100000:1.0:1788639130.818214:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754038784 00000100:00100000:1.0:1788639130.818279:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 4 00000100:00100000:1.0:1788639130.818289:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f83a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+39:2408:x1875523754038784:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788639130.818304:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788639130.818353:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262c5d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854fc expref: 39 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.818370:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae242381f00) 00010000:00010000:1.0:1788639130.818375:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788639130.818433:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f83a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+38:2408:x1875523754038784:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 145us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639130.818442:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 4 00000100:00100000:2.0:1788639130.818504:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754039040 00000100:00100000:2.0:1788639130.818509:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754039040 00000100:00100000:2.0:1788639130.818543:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 12 00000100:00100000:2.0:1788639130.818551:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+38:11219:x1875523754039040:12345-192.168.206.18@tcp:35:cat.0 00000100:00100000:2.0:1788639130.818760:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+39:11219:x1875523754039040:12345-192.168.206.18@tcp:35:cat.0 Request processed in 209us (840us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1788639130.818772:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 12 00000100:00100000:0.0:1788639130.859997:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639130.860122:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754039296 00000100:00100000:2.0:1788639130.860143:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754039296 00000100:00100000:2.0:1788639130.860204:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 60 00000100:00100000:2.0:1788639130.860214:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+39:11225:x1875523754039296:12345-192.168.206.18@tcp:101:dd.0 00010000:00010000:2.0:1788639130.860248:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639130.860251:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788639130.860283:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c539 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854d2 expref: 39 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.860303:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ae242358d00) 00010000:00010000:2.0:1788639130.860307:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788639130.860320:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262c5e1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85503 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.860431:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262c5e8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.860446:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c5b7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854f5 expref: 39 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.860454:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262c5e8 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.860486:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c5b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854f5 expref: 39 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.860499:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c5b7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854f5 expref: 39 pid: 11314 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639130.860512:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f82a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1875523773001984:192.168.206.18@tcp:104: 00000100:00100000:2.0:1788639130.860679:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2430666c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788639130.864372:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639130.864477:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754039424 00000100:00100000:3.0:1788639130.864486:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754039424 00010000:00010000:3.0:1788639130.864528:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c5b7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854f5 expref: 40 pid: 11314 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639130.864574:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 55 00000100:00100000:3.0:1788639130.864584:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f839500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+40:2407:x1875523754039424:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788639130.864597:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639130.864604:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c5b7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854f5 expref: 40 pid: 11314 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.864652:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c5b7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854f5 expref: 40 pid: 11314 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.864673:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae242381f00) 00010000:00010000:3.0:1788639130.864679:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262c5e8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.864688:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262c5e8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.864696:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262c5e8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639130.864730:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639130.864773:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f839500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+40:2407:x1875523754039424:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 191us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639130.864781:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 55 00010000:00010000:2.0:1788639130.865542:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c5b7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854f5 expref: 39 pid: 11314 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639130.865559:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f82a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1875523773001984:192.168.206.18@tcp:104: 00010000:00010000:2.0:1788639130.865579:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262c5e8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.865586:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262c5e8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.865591:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262c5e8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788639130.865608:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788639130.865768:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262c5e1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85503 expref: 40 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.865789:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262c5e8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85503 expref: 39 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639130.865797:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae242381f00) 00010000:00010000:2.0:1788639130.865800:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788639130.865803:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78b200, rc 0) 00000100:00100000:2.0:1788639130.865849:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+39:11225:x1875523754039296:12345-192.168.206.18@tcp:101:dd.0 Request processed in 5636us (5860us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1788639130.865856:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 60 00000100:00100000:0.0:1788639130.869798:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639130.871143:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754039552 00000100:00100000:1.0:1788639130.871156:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754039552 00000100:00100000:1.0:1788639130.871360:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 61 00000100:00100000:1.0:1788639130.871370:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f83b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+39:11225:x1875523754039552:12345-192.168.206.18@tcp:101:dd.0 00010000:00010000:1.0:1788639130.871406:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639130.871427:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262c5f6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e8550a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.871462:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262c5fd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.871478:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262c5fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.871490:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262c5fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.871609:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262c5f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8550a expref: 41 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.872268:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262c5fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8550a expref: 40 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.872286:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae242381f00) 00010000:00010000:1.0:1788639130.872289:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788639130.872293:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fb000, rc 0) 00000100:00100000:1.0:1788639130.872404:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f83b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+40:11225:x1875523754039552:12345-192.168.206.18@tcp:101:dd.0 Request processed in 1034us (2614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639130.872412:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 61 00000100:00100000:0.0:1788639130.876299:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639130.876443:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754039808 00000100:00100000:1.0:1788639130.876453:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754039808 00000100:00100000:1.0:1788639130.876510:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 62 00000100:00100000:1.0:1788639130.876520:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f83a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+40:11225:x1875523754039808:12345-192.168.206.18@tcp:36:dd.0 00010000:00010000:1.0:1788639130.876890:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262c604 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.876907:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262c604 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.876917:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262c604 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788639130.876966:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1788639130.876988:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005f81023c reply state 0000000034b91ac5 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262c604 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.877000:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262c604 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639130.877007:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae242381f00) 00010000:00010000:1.0:1788639130.877010:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788639130.877032:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788639130.877119:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f83a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+43:11225:x1875523754039808:12345-192.168.206.18@tcp:36:dd.0 Request processed in 600us (828us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1788639130.877131:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 62 00000020:00080000:1.0:1788639130.877136:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788639131.061015:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639131.123677:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639131.123770:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754039936 00000100:00100000:2.0:1788639131.123791:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754039936 00000100:00100000:2.0:1788639131.123851:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 63 00000100:00100000:2.0:1788639131.123861:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+43:11239:x1875523754039936:12345-192.168.206.18@tcp:101:stat.0 00010000:00010000:2.0:1788639131.123884:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639131.123904:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262c60b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85511 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.123966:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262c612 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.123981:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262c612 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.123994:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262c612 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.124004:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c619 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.124012:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c619 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.124018:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c619 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.124082:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262c620 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.124094:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262c5e8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85503 expref: 44 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.124102:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262c620 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.124141:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262c5e8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85503 expref: 44 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.124155:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262c5e8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85503 expref: 44 pid: 6516 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639131.124168:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f82a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1875523773002112:192.168.206.18@tcp:104: 00000100:00100000:2.0:1788639131.124262:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2430666c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788639131.129190:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f82a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1875523773002112:192.168.206.18@tcp:104: 00010000:00010000:2.0:1788639131.129218:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262c620 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639131.130226:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639131.130313:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754040192 00000100:00100000:2.0:1788639131.130325:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754040192 00000100:00100000:2.0:1788639131.130388:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 13 00000100:00100000:2.0:1788639131.130398:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f83b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+45:6175:x1875523754040192:12345-192.168.206.18@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788639131.130955:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f83b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+46:6175:x1875523754040192:12345-192.168.206.18@tcp:35:ldlm_bl.0 Request processed in 555us (729us total) trans 4294967339 rc 0/0 00000100:00100000:2.0:1788639131.130964:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 13 00000100:00100000:0.0:1788639131.143769:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639131.143855:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754040320 00000100:00100000:1.0:1788639131.143865:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754040320 00010000:00010000:1.0:1788639131.143913:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262c5e8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85503 expref: 46 pid: 6516 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639131.143951:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 56 00000100:00100000:1.0:1788639131.143961:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f838380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+46:2407:x1875523754040320:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788639131.143976:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788639131.143983:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262c5e8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85503 expref: 46 pid: 6516 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.143997:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262c5e8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85503 expref: 46 pid: 6516 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.144017:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262c5e8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85503 expref: 46 pid: 6516 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.144040:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae242381f00) 00010000:00010000:1.0:1788639131.144045:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262c620 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.144054:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262c620 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.144077:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262c620 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.144111:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788639131.144163:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f838380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+45:2407:x1875523754040320:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 203us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639131.144171:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 56 00010000:00010000:2.0:1788639131.144570:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262c620 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.144578:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262c620 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788639131.144662:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788639131.144673:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788639131.144713:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262c620 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.144726:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262c620 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.144734:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262c612 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.144740:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262c612 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.144747:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262c612 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.144752:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78b000 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639131.144756:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262c612 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.144763:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262c612 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.144773:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ae242358d00) 00010000:00010000:2.0:1788639131.144776:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639131.144780:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262c612 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.144785:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262c612 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.144798:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c619 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.144814:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c619 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.144820:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c619 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.144825:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78a000 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639131.144828:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c619 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.144834:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c619 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.144843:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ae2430f5600) 00010000:00010000:2.0:1788639131.144845:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639131.144847:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c619 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.144853:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c619 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.144896:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262c60b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85511 expref: 45 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.144910:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262c620 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85511 expref: 44 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.144916:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae242381f00) 00010000:00010000:2.0:1788639131.144918:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788639131.144927:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78aa00, rc 0) 00000100:00100000:2.0:1788639131.145005:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+44:11239:x1875523754039936:12345-192.168.206.18@tcp:101:stat.0 Request processed in 21145us (21337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639131.145013:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 63 00000100:00100000:0.0:1788639131.222323:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639131.222581:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754040576 00000100:00100000:2.0:1788639131.222590:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754040576 00000100:00100000:2.0:1788639131.223791:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 64 00000100:00100000:2.0:1788639131.223807:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+44:11245:x1875523754040576:12345-192.168.206.18@tcp:36:truncate.0 00010000:00010000:2.0:1788639131.223859:0:11314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788639131.223885:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262c620 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85511 expref: 44 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.223907:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae242381f00) 00010000:00010000:2.0:1788639131.223912:0:11314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788639131.224265:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262c627 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.224280:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262c627 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.224290:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262c627 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788639131.224343:0:11314:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967340 00000004:00010000:2.0:1788639131.224365:0:11314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000019fe0c9c reply state 000000004723e6df transno 4294967341 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262c627 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.224493:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262c627 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.224518:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae242381f00) 00010000:00010000:2.0:1788639131.224521:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788639131.224524:0:11314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788639131.224708:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+46:11245:x1875523754040576:12345-192.168.206.18@tcp:36:truncate.0 Request processed in 905us (2393us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1788639131.224716:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 64 00000020:00080000:2.0:1788639131.224721:0:11314:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788639131.340714:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639131.340828:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754040704 00000100:00100000:1.0:1788639131.340840:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754040704 00000100:00100000:1.0:1788639131.341035:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 65 00000100:00100000:1.0:1788639131.341046:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+46:11259:x1875523754040704:12345-192.168.206.18@tcp:101:stat.0 00010000:00010000:1.0:1788639131.341076:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639131.341101:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262c62e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85518 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.341180:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c635 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.341197:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c635 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.341210:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c635 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.341222:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c63c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.341230:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c63c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.341258:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c63c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.341347:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c643 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.341358:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c643 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.341365:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c643 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788639131.341427:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1788639131.341433:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788639131.341458:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c643 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.341473:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c643 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.341483:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c635 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.341491:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c635 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.341498:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c635 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.341505:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fac00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639131.341510:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c635 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.341528:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c635 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.341543:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ae242358d00) 00010000:00010000:1.0:1788639131.341546:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639131.341551:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c635 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.341558:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c635 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.341576:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c63c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.341582:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c63c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.341588:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c63c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.341593:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fa600 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639131.341595:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c63c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.341600:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c63c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.341607:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ae2430f5600) 00010000:00010000:1.0:1788639131.341609:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639131.341612:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c63c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.341681:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c63c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.341715:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262c62e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85518 expref: 48 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.341730:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c643 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85518 expref: 47 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.341738:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae242381f00) 00010000:00010000:1.0:1788639131.341741:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788639131.341744:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fa000, rc 0) 00000100:00100000:1.0:1788639131.341823:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+47:11259:x1875523754040704:12345-192.168.206.18@tcp:101:stat.0 Request processed in 779us (1123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639131.341830:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 65 00000100:00100000:0.0:1788639131.392758:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639131.393192:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754040960 00000100:00100000:2.0:1788639131.393206:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754040960 00000100:00100000:2.0:1788639131.393301:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 66 00000100:00100000:2.0:1788639131.393314:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+47:11269:x1875523754040960:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:2.0:1788639131.393339:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639131.393369:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262c64a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e8551f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788639131.393557:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788639131.393732:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262c64a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8551f expref: 49 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.393751:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae362514000) 00010000:00010000:2.0:1788639131.393754:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788639131.393761:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262c64a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8551f expref: 49 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.393782:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78aa00, rc 0) 00000100:00100000:2.0:1788639131.394098:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+48:11269:x1875523754040960:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 785us (1352us total) trans 4294967342 rc 301/301 00000100:00100000:2.0:1788639131.394118:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 66 00000100:00100000:0.0:1788639131.396885:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639131.396985:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754041216 00000100:00100000:1.0:1788639131.396995:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754041216 00000100:00100000:1.0:1788639131.397134:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 14 00000100:00100000:1.0:1788639131.397147:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+48:11269:x1875523754041216:12345-192.168.206.18@tcp:35:lfs.0 00000100:00100000:1.0:1788639131.397444:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+49:11269:x1875523754041216:12345-192.168.206.18@tcp:35:lfs.0 Request processed in 299us (571us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1788639131.397452:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 14 00000100:00100000:0.0:1788639131.440814:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639131.441482:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754041472 00000100:00100000:2.0:1788639131.441496:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754041472 00000100:00100000:2.0:1788639131.441650:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 67 00000100:00100000:2.0:1788639131.441663:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f83ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+49:11275:x1875523754041472:12345-192.168.206.18@tcp:101:bash.0 00010000:00010000:2.0:1788639131.441692:0:11314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639131.441717:0:11314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262c658 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85526 expref: -99 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.441854:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c65f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.441872:0:11314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c643 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85518 expref: 50 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.441882:0:11314:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c65f lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.441922:0:11314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c643 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85518 expref: 50 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.441937:0:11314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c643 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85518 expref: 50 pid: 6517 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639131.441951:0:11314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f82a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11314:1875523773002240:192.168.206.18@tcp:104: 00000100:00100000:2.0:1788639131.442175:0:11314:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243066e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788639131.445396:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639131.445494:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754041600 00000100:00100000:1.0:1788639131.445508:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754041600 00010000:00010000:1.0:1788639131.445569:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c643 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85518 expref: 51 pid: 6517 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639131.445709:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 57 00000100:00100000:1.0:1788639131.445722:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ffb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+51:2407:x1875523754041600:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788639131.445742:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788639131.445750:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c643 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85518 expref: 51 pid: 6517 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.445770:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c643 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85518 expref: 51 pid: 6517 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.445797:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae242381f00) 00010000:00010000:1.0:1788639131.445807:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c65f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.445819:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c65f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.445828:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c65f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.445852:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788639131.445923:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ffb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+51:2407:x1875523754041600:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 203us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639131.445931:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 57 00010000:00010000:2.0:1788639131.446774:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c643 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85518 expref: 50 pid: 6517 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639131.446808:0:11314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f82a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11314:1875523773002240:192.168.206.18@tcp:104: 00010000:00010000:2.0:1788639131.446832:0:11314:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c65f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.446842:0:11314:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c65f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.447121:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c65f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788639131.447146:0:11314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1788639131.447510:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262c658 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85526 expref: 51 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.447538:0:11314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c65f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85526 expref: 50 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.447548:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae242381f00) 00010000:00010000:2.0:1788639131.447552:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788639131.447557:0:11314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78a000, rc 0) 00000100:00100000:2.0:1788639131.447717:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f83ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+50:11275:x1875523754041472:12345-192.168.206.18@tcp:101:bash.0 Request processed in 6055us (6916us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1788639131.447726:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 67 00000100:00100000:0.0:1788639131.450270:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639131.451812:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754041856 00000100:00100000:1.0:1788639131.451831:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754041856 00000100:00100000:1.0:1788639131.451978:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 68 00000100:00100000:1.0:1788639131.451991:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f83bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+50:11275:x1875523754041856:12345-192.168.206.18@tcp:36:bash.0 00010000:00010000:1.0:1788639131.452305:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262c66d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.452326:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262c66d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.452340:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262c66d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788639131.452415:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967345 00000004:00010000:1.0:1788639131.452441:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000985bb1af reply state 00000000d33d1963 transno 4294967346 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262c66d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.452455:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262c66d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.452464:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae242381f00) 00010000:00010000:1.0:1788639131.452471:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788639131.452476:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788639131.452596:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f83bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+53:11275:x1875523754041856:12345-192.168.206.18@tcp:36:bash.0 Request processed in 606us (2342us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1788639131.452604:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 68 00000020:00080000:1.0:1788639131.452610:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788639131.458501:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639131.458650:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754041984 00000100:00100000:2.0:1788639131.458664:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754041984 00000100:00100000:2.0:1788639131.458733:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 69 00000100:00100000:2.0:1788639131.458742:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f83b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+53:11275:x1875523754041984:12345-192.168.206.18@tcp:101:bash.0 00010000:00010000:2.0:1788639131.458778:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639131.458979:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262c674 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e8552d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.459069:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262c67b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.459084:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c65f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85526 expref: 54 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.459093:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262c67b lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.459282:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c65f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85526 expref: 54 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.459296:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c65f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85526 expref: 54 pid: 11314 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639131.459310:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f82a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1875523773002368:192.168.206.18@tcp:104: 00000100:00100000:2.0:1788639131.460094:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243066e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788639131.461752:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f82a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1875523773002368:192.168.206.18@tcp:104: 00010000:00010000:2.0:1788639131.461776:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262c67b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639131.462298:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639131.462841:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754042112 00000100:00100000:3.0:1788639131.462849:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754042112 00010000:00010000:3.0:1788639131.463011:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c65f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85526 expref: 55 pid: 11314 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639131.463129:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 58 00000100:00100000:3.0:1788639131.463140:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f83a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+55:2407:x1875523754042112:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788639131.463155:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639131.463162:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c65f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85526 expref: 55 pid: 11314 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639131.463176:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c65f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85526 expref: 55 pid: 11314 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639131.463197:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c65f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85526 expref: 55 pid: 11314 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639131.463217:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae242381f00) 00010000:00010000:3.0:1788639131.463234:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262c67b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639131.463244:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262c67b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639131.463267:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262c67b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639131.463297:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639131.463357:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f83a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+54:2407:x1875523754042112:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 220us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639131.463365:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 58 00010000:00010000:2.0:1788639131.463460:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262c67b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.463471:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262c67b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788639131.464217:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788639131.464223:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788639131.464247:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262c67b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.464279:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262c674 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8552d expref: 54 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.464298:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262c67b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8552d expref: 53 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.464306:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae242381f00) 00010000:00010000:2.0:1788639131.464309:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788639131.464312:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78b000, rc 0) 00000100:00100000:2.0:1788639131.464371:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f83b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+53:11275:x1875523754041984:12345-192.168.206.18@tcp:101:bash.0 Request processed in 5630us (5885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639131.464390:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 69 00000100:00100000:0.0:1788639131.469498:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639131.470629:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754042368 00000100:00100000:2.0:1788639131.470641:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754042368 00000100:00100000:2.0:1788639131.470704:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 15 00000100:00100000:2.0:1788639131.470714:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ef2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+53:11275:x1875523754042368:12345-192.168.206.18@tcp:35:bash.0 00000100:00100000:2.0:1788639131.471069:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ef2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+54:11275:x1875523754042368:12345-192.168.206.18@tcp:35:bash.0 Request processed in 355us (1578us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1788639131.471078:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 15 00000100:00100000:3.0:1788639131.538328:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639131.538405:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754042624 00000100:00100000:2.0:1788639131.538415:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754042624 00000100:00100000:2.0:1788639131.538490:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 70 00000100:00100000:2.0:1788639131.538501:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f78fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+54:11285:x1875523754042624:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:2.0:1788639131.538524:0:11314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639131.538544:0:11314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262c682 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85534 expref: -99 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788639131.538677:0:11314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788639131.538774:0:11314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262c682 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85534 expref: 56 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.538788:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae362514000) 00010000:00010000:2.0:1788639131.538791:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788639131.538796:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262c682 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85534 expref: 56 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.538812:0:11314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78aa00, rc 0) 00000100:00100000:2.0:1788639131.538872:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f78fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+55:11285:x1875523754042624:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 373us (551us total) trans 4294967348 rc 301/301 00000100:00100000:2.0:1788639131.538878:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 70 00000100:00100000:1.0:1788639131.541756:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639131.542087:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754042752 00000100:00100000:2.0:1788639131.542101:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754042752 00000100:00100000:2.0:1788639131.542192:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 71 00000100:00100000:2.0:1788639131.542205:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3461b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+55:11285:x1875523754042752:12345-192.168.206.18@tcp:34:lfs.0 00010000:00010000:2.0:1788639131.542497:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b400/0x25c454990262c690 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.542514:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b400/0x25c454990262c690 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.542541:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b400/0x25c454990262c690 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.542555:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c697 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.542562:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c697 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.542568:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c697 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.542677:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262c69e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.542686:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262c69e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.542693:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262c69e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788639131.542744:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262c69e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.542756:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b400/0x25c454990262c690 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.542762:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b400/0x25c454990262c690 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.542769:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b400/0x25c454990262c690 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.543426:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78b400 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639131.543431:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b400/0x25c454990262c690 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.543439:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b400/0x25c454990262c690 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.543452:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ae242358d00) 00010000:00010000:2.0:1788639131.543454:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639131.543459:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b400/0x25c454990262c690 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.543465:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b400/0x25c454990262c690 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.543488:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c697 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.543494:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c697 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.543499:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c697 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.543504:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78a000 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639131.543507:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c697 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.543513:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c697 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.543535:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ae2430f5600) 00010000:00010000:2.0:1788639131.543538:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639131.543542:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c697 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.543548:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c697 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.543561:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262c69e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.543566:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262c69e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.543571:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262c69e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.543575:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78b200 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639131.543578:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262c69e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.543582:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262c69e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.543589:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae242381f00) 00010000:00010000:2.0:1788639131.543591:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639131.543594:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262c69e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.543600:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262c69e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639131.543837:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3461b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+55:11285:x1875523754042752:12345-192.168.206.18@tcp:34:lfs.0 Request processed in 1631us (2215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639131.543847:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 71 00000100:00100000:0.0:1788639131.547014:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639131.547319:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754043008 00000100:00100000:1.0:1788639131.547333:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754043008 00000100:00100000:1.0:1788639131.547509:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 16 00000100:00100000:1.0:1788639131.547521:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+55:11285:x1875523754043008:12345-192.168.206.18@tcp:35:lfs.0 00000100:00100000:1.0:1788639131.547860:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+56:11285:x1875523754043008:12345-192.168.206.18@tcp:35:lfs.0 Request processed in 340us (865us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1788639131.547880:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 16 00000100:00100000:0.0:1788639131.585236:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639131.585524:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754043264 00000100:00100000:2.0:1788639131.585565:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754043264 00000100:00100000:2.0:1788639131.586417:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 72 00000100:00100000:2.0:1788639131.586434:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+56:11288:x1875523754043264:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:2.0:1788639131.586458:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639131.586479:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262c6a5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e8553b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.586555:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c6ac lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.586569:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c6ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.586580:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c6ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.586592:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b400/0x25c454990262c6b3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.586599:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b400/0x25c454990262c6b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.586605:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b400/0x25c454990262c6b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.587068:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262c6ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.587079:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262c6ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.587087:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262c6ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788639131.587096:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788639131.587489:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c6ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.587497:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c6ac lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.587504:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c6ac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.587509:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78a000 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639131.587514:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c6ac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.587521:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c6ac lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.587534:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ae242358d00) 00010000:00010000:2.0:1788639131.587537:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639131.587542:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c6ac lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.587562:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c6ac lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.587581:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b400/0x25c454990262c6b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.587587:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b400/0x25c454990262c6b3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.587593:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b400/0x25c454990262c6b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.587599:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78b400 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639131.587602:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b400/0x25c454990262c6b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.587609:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b400/0x25c454990262c6b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.587663:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ae2430f5600) 00010000:00010000:2.0:1788639131.587667:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639131.587670:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b400/0x25c454990262c6b3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.587676:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b400/0x25c454990262c6b3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.587723:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262c6a5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8553b expref: 59 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.587738:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262c6ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8553b expref: 58 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.587752:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae242381f00) 00010000:00010000:2.0:1788639131.587754:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788639131.587756:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78aa00, rc 0) 00000100:00100000:2.0:1788639131.587824:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+58:11288:x1875523754043264:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 1395us (2612us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1788639131.587832:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 72 00000100:00100000:0.0:1788639131.591593:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639131.591691:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639131.591806:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754043392 00000100:00100000:1.0:1788639131.591818:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754043392 00000100:00100000:1.0:1788639131.591913:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 5 00000100:00100000:1.0:1788639131.591926:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f838e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+58:2407:x1875523754043392:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788639131.591948:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788639131.591986:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262c6ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8553b expref: 58 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.592015:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae242381f00) 00010000:00010000:1.0:1788639131.592022:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788639131.592083:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f838e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+57:2407:x1875523754043392:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 160us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639131.592091:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 5 00000100:00100000:2.0:1788639131.592312:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754043520 00000100:00100000:2.0:1788639131.592317:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754043520 00000100:00100000:2.0:1788639131.592360:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 73 00000100:00100000:2.0:1788639131.592368:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f83b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+57:11288:x1875523754043520:12345-192.168.206.18@tcp:54:lfs.0 00010000:00010000:2.0:1788639131.592450:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c6c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.592467:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.592479:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.592522:0:10169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.592530:0:10169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c6c8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.592537:0:10169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c6c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.592544:0:10169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78b600 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639131.592566:0:10169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c6c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.592575:0:10169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c6c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.592585:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae242381f00) 00010000:00010000:2.0:1788639131.592589:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788639131.592592:0:10169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c6c8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.592600:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c6c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639131.592698:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f83b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+57:11288:x1875523754043520:12345-192.168.206.18@tcp:54:lfs.0 Request processed in 330us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639131.592705:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 73 00000100:00100000:0.0:1788639131.595714:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639131.595865:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754043776 00000100:00100000:2.0:1788639131.595877:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754043776 00000100:00100000:2.0:1788639131.596074:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 17 00000100:00100000:2.0:1788639131.596085:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+57:11288:x1875523754043776:12345-192.168.206.18@tcp:35:lfs.0 00000100:00100000:2.0:1788639131.598362:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+58:11288:x1875523754043776:12345-192.168.206.18@tcp:35:lfs.0 Request processed in 2263us (2646us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1788639131.598391:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 17 00000100:00100000:3.0:1788639131.700286:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639131.701312:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754044032 00000100:00100000:2.0:1788639131.703238:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754044032 00000100:00100000:2.0:1788639131.703338:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 74 00000100:00100000:2.0:1788639131.703350:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f78e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+58:11306:x1875523754044032:12345-192.168.206.18@tcp:101:cat.0 00010000:00010000:2.0:1788639131.703390:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639131.703444:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c6cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85542 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.703880:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262c6d6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.703899:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262c6d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.704141:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262c6d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788639131.704157:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788639131.704369:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c6cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85542 expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.704826:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262c6d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85542 expref: 60 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.704838:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae242381f00) 00010000:00010000:2.0:1788639131.704842:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788639131.704846:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78b200, rc 0) 00000100:00100000:2.0:1788639131.704991:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f78e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+60:11306:x1875523754044032:12345-192.168.206.18@tcp:101:cat.0 Request processed in 1642us (4717us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1788639131.704999:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 74 00000100:00100000:0.0:1788639131.740170:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639131.740351:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754044160 00000100:00100000:2.0:1788639131.740365:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754044160 00000100:00100000:2.0:1788639131.740454:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 75 00000100:00100000:2.0:1788639131.740466:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+60:11307:x1875523754044160:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:2.0:1788639131.740507:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639131.740679:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c6e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85549 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.740769:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b400/0x25c454990262c6eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.740787:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b400/0x25c454990262c6eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.740800:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b400/0x25c454990262c6eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788639131.740908:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788639131.740980:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788639131.741006:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b400/0x25c454990262c6eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.741664:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c6e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85549 expref: 62 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.741700:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b400/0x25c454990262c6eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85549 expref: 61 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639131.741712:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ae242358d00) 00010000:00010000:2.0:1788639131.741715:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788639131.741719:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78b400, rc 0) 00000100:00100000:2.0:1788639131.741810:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+61:11307:x1875523754044160:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 1345us (1653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639131.741818:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 75 00000100:00100000:0.0:1788639131.751844:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639131.752084:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754044544 00000100:00100000:1.0:1788639131.752097:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754044544 00000100:00100000:1.0:1788639131.752182:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 18 00000100:00100000:1.0:1788639131.752193:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+61:11307:x1875523754044544:12345-192.168.206.18@tcp:35:lfs.0 00000100:00100000:1.0:1788639131.752866:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+62:11307:x1875523754044544:12345-192.168.206.18@tcp:35:lfs.0 Request processed in 671us (1655us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1788639131.752884:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 18 00000100:00100000:3.0:1788639131.757722:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639131.758008:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754044672 00000100:00100000:0.0:1788639131.758023:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754044672 00000100:00100000:0.0:1788639131.758174:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 6 00000100:00100000:0.0:1788639131.758185:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f78ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+62:11307:x1875523754044672:12345-192.168.206.18@tcp:103:lfs.0 00010000:00010000:0.0:1788639131.758201:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788639131.758236:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262c67b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8552d expref: 62 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639131.758265:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262c6d6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85542 expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639131.758275:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b600/0x25c454990262c578 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854e7 expref: 60 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639131.758286:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae242381f00) 00010000:00010000:0.0:1788639131.758291:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788639131.758347:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f78ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+59:11307:x1875523754044672:12345-192.168.206.18@tcp:103:lfs.0 Request processed in 164us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639131.758355:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 6 00000100:00100000:2.0:1788639131.760297:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639131.760443:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754044800 00000100:00100000:1.0:1788639131.760456:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754044800 00000100:00100000:1.0:1788639131.760532:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 76 00000100:00100000:1.0:1788639131.760575:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f82b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+59:11307:x1875523754044800:12345-192.168.206.18@tcp:58:lfs.0 00010000:00010000:1.0:1788639131.760922:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c6f2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.760945:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c6f2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.760958:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c6f2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788639131.761521:0:6518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788639131.761835:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1788639131.762006:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1788639131.762215:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f82b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+59:11307:x1875523754044800:12345-192.168.206.18@tcp:58:lfs.0 Request processed in 1670us (1929us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639131.762228:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 76 00000100:00100000:2.0:1788639131.778512:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639131.781359:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754044928 00000100:00100000:1.0:1788639131.781392:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754044928 00000100:00100000:1.0:1788639131.781566:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 77 00000100:00100000:1.0:1788639131.781580:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+59:11309:x1875523754044928:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:1.0:1788639131.781608:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639131.781656:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c6f9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85550 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.781778:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c700 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.781797:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c700 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.781811:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c700 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.781834:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c707 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.781842:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c707 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.781863:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c707 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.781982:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c70e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.782641:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c70e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.782658:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c70e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788639131.782722:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788639131.782727:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788639131.782752:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c70e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.782767:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c70e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.782776:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c700 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.782783:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c700 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.782807:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c700 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.782814:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fa000 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639131.782820:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c700 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.782829:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c700 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.782843:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ae242358d00) 00010000:00010000:1.0:1788639131.782847:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639131.782863:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c700 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.782871:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c700 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.782896:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c707 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.782903:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c707 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.783250:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c707 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.783258:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fbe00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639131.783261:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c707 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.783280:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c707 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.783291:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ae2430f5600) 00010000:00010000:1.0:1788639131.783293:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639131.783297:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c707 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.783303:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c707 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.783347:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c6f9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85550 expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.783364:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c70e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85550 expref: 60 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639131.783381:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae242381f00) 00010000:00010000:1.0:1788639131.783384:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788639131.783387:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fb400, rc 0) 00000100:00100000:1.0:1788639131.783484:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+60:11309:x1875523754044928:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 1906us (4985us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639131.783494:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 77 00010000:00010000:3.0:1788639132.085051:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788639132.450587:0:14208:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788639132.450595:0:14208:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788639132.450647:0:14208:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788639132.450654:0:14208:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788639132.724888:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788639132.725048:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788639132.725088:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788639132.725098:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788639132.725302:0:13794:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3461b4e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1875523773002496:192.168.206.18@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788639132.725426:0:13794:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2420b33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788639132.736397:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639132.736506:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754045056 00000100:00100000:0.0:1788639132.736515:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754045056 00000100:00100000:0.0:1788639132.736593:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 78 00000100:00100000:0.0:1788639132.736613:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f82a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+61:11322:x1875523754045056:12345-192.168.206.18@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788639132.736669:0:6516:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788639132.736777:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f82a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+61:11322:x1875523754045056:12345-192.168.206.18@tcp:53:lhsmtool_posix.0 Request processed in 166us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639132.736785:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 78 00000100:00080000:2.0:1788639132.736945:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788639132.737078:0:13794:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3461b4e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1875523773002496:192.168.206.18@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788639132.740867:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639132.741020:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754045184 00000100:00100000:1.0:1788639132.741030:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754045184 00000100:00100000:1.0:1788639132.741083:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 79 00000100:00100000:1.0:1788639132.741092:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f78df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+60:11322:x1875523754045184:12345-192.168.206.18@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788639132.741153:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c715 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.741167:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c715 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.741180:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c715 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.741245:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c71c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.741252:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c71c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.741258:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c71c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.741282:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c723 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.741309:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c723 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.741316:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c723 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788639132.741357:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788639132.741361:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788639132.741382:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c723 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.741392:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c715 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.741398:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c715 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.741405:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c715 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.741410:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fa600 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639132.741414:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c715 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.741420:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c715 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.741430:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ae34af01b00) 00010000:00010000:1.0:1788639132.741433:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639132.741438:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c715 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.741453:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c715 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.741466:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c71c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.741471:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c71c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.741476:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c71c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.741481:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fbe00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639132.741483:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c71c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.741489:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c71c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.741497:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9ae362514a00) 00010000:00010000:1.0:1788639132.741499:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639132.741502:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c71c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.741508:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c71c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.741521:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c723 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.741527:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c723 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.741540:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c723 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.741545:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fa000 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639132.741548:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c723 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.741554:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c723 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.741562:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae242381f00) 00010000:00010000:1.0:1788639132.741564:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639132.741567:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c723 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.741573:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c723 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639132.741773:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f78df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+60:11322:x1875523754045184:12345-192.168.206.18@tcp:34:lhsmtool_posix.0 Request processed in 681us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639132.741781:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 79 00000100:00100000:0.0:1788639132.746258:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639132.746408:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754045440 00000100:00100000:1.0:1788639132.746417:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754045440 00000100:00100000:1.0:1788639132.746470:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 80 00000100:00100000:1.0:1788639132.746479:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+60:11322:x1875523754045440:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788639132.746498:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639132.746515:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c72a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85557 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.746663:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c731 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.746677:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c731 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.746688:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c731 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788639132.746699:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788639132.746771:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c731 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.746779:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c731 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.746785:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c731 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.746791:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fbe00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639132.746795:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c731 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.746802:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c731 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.746815:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae242381f00) 00010000:00010000:1.0:1788639132.746818:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788639132.746822:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c731 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.746838:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c731 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.746939:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c72a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85557 expref: 62 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.746950:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ae34af01b00) 00010000:00010000:1.0:1788639132.746953:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788639132.746957:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c72a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85557 expref: 62 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.746967:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fa000, rc 0) 00000100:00100000:1.0:1788639132.747025:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+61:11322:x1875523754045440:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 546us (775us total) trans 4294967354 rc 301/301 00000100:00100000:1.0:1788639132.747031:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 80 00000100:00100000:0.0:1788639132.749928:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639132.750004:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754045568 00000100:00100000:3.0:1788639132.750013:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754045568 00000100:00100000:3.0:1788639132.750104:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 81 00000100:00100000:3.0:1788639132.750115:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+61:11322:x1875523754045568:12345-192.168.206.18@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788639132.750145:0:11314:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788639132.750275:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+61:11322:x1875523754045568:12345-192.168.206.18@tcp:53:lhsmtool_posix.0 Request processed in 161us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639132.750283:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 81 00000100:00100000:3.0:1788639132.754073:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639132.754182:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754045824 00000100:00100000:1.0:1788639132.754191:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754045824 00000100:00100000:1.0:1788639132.754259:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 82 00000100:00100000:1.0:1788639132.754270:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f78dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+61:11322:x1875523754045824:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788639132.754289:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639132.754292:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788639132.754318:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b400/0x25c454990262c6eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85549 expref: 61 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.754346:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ae242358d00) 00010000:00010000:1.0:1788639132.754352:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788639132.754395:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c73f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e8555e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788639132.754792:0:6518:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:1.0:1788639132.754934:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031000/0x25c454990262c746 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.754947:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031000/0x25c454990262c746 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.754957:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031000/0x25c454990262c746 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.755007:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c73f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8555e expref: 63 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.755022:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031000/0x25c454990262c746 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8555e expref: 62 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.755030:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ae362514a00) 00010000:00010000:1.0:1788639132.755033:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788639132.755036:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae340031000, rc 0) 00000100:00100000:1.0:1788639132.755099:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f78dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+62:11322:x1875523754045824:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 831us (1036us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1788639132.755107:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 82 00000100:00100000:0.0:1788639132.760009:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639132.760191:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754046080 00000100:00100000:2.0:1788639132.760201:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754046080 00000100:00100000:2.0:1788639132.760273:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 83 00000100:00100000:2.0:1788639132.760285:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+62:11322:x1875523754046080:12345-192.168.206.18@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788639132.760338:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788639132.760363:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031000/0x25c454990262c746 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8555e expref: 62 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.760396:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ae362514a00) 00010000:00010000:2.0:1788639132.760406:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788639132.760427:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262c754 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.760440:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262c754 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.760451:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262c754 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.760464:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262c75b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x985269cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.760471:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262c75b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x985269cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.760477:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262c75b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x985269cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.760534:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262c754 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.760542:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262c754 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.760549:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262c754 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.760555:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78a600 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639132.760560:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262c754 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.760567:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262c754 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.760576:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ae242358d00) 00010000:00010000:2.0:1788639132.760579:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639132.760583:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262c754 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.760589:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262c754 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.760602:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262c75b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x985269cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.760608:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262c75b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x985269cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.760635:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262c75b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x985269cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.760646:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78a800 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639132.760650:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262c75b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x985269cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.760657:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262c75b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x985269cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.760665:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x985269cd (ffff9ae242358c00) 00010000:00010000:2.0:1788639132.760668:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639132.760671:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262c75b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x985269cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.760676:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262c75b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x985269cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639132.760748:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+61:11322:x1875523754046080:12345-192.168.206.18@tcp:36:lhsmtool_posix.0 Request processed in 465us (747us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788639132.760755:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 83 00000100:00100000:0.0:1788639132.764969:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639132.765129:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754046208 00000100:00100000:3.0:1788639132.765138:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754046208 00000100:00100000:3.0:1788639132.765193:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 84 00000100:00100000:3.0:1788639132.765202:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+61:11322:x1875523754046208:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788639132.765231:0:11314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639132.765269:0:11314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a200/0x25c454990262c762 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85565 expref: -99 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.765306:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a600/0x25c454990262c769 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.765319:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a600/0x25c454990262c769 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.765331:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a600/0x25c454990262c769 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.765449:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a200/0x25c454990262c762 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85565 expref: 63 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.765469:0:11314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a600/0x25c454990262c769 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85565 expref: 62 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.765478:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ae242381300) 00010000:00010000:3.0:1788639132.765481:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788639132.765484:0:11314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae38217a600, rc 0) 00000100:00100000:3.0:1788639132.765537:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+62:11322:x1875523754046208:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 335us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639132.765544:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 84 00000100:00100000:0.0:1788639132.773125:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639132.773200:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754046464 00000100:00100000:3.0:1788639132.773211:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754046464 00000100:00100000:3.0:1788639132.773280:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 85 00000100:00100000:3.0:1788639132.773296:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+62:11322:x1875523754046464:12345-192.168.206.18@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788639132.773387:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c770 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.773420:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c770 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.773431:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c770 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788639132.773598:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1788639132.773609:0:6517:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 391567991969ns, next at 392567989621ns, rc = 0 00000004:00010000:3.0:1788639132.773689:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000068a4bfd2 reply state 000000003a09eb4d transno 4294967356 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c770 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.773701:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c770 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.773709:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ae242381300) 00010000:00010000:3.0:1788639132.773711:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788639132.773715:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788639132.773800:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+64:11322:x1875523754046464:12345-192.168.206.18@tcp:36:lhsmtool_posix.0 Request processed in 506us (1187us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1788639132.773807:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 85 00000100:00100000:0.0:1788639132.776827:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639132.776915:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754046592 00000100:00100000:1.0:1788639132.776924:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754046592 00000100:00100000:1.0:1788639132.776979:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 86 00000100:00100000:1.0:1788639132.776991:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+64:11322:x1875523754046592:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788639132.777029:0:10169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639132.777049:0:10169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030400/0x25c454990262c777 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e8556c expref: -99 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.777105:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030400/0x25c454990262c777 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8556c expref: 65 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.777120:0:10169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030400/0x25c454990262c777 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8556c expref: 65 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.777138:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ae242381300) 00010000:00010000:1.0:1788639132.777141:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788639132.777145:0:10169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae340030400, rc 0) 00000100:00100000:1.0:1788639132.777194:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+65:11322:x1875523754046592:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 205us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639132.777201:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 86 00000100:00100000:0.0:1788639132.782861:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639132.784024:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754046720 00000100:00100000:1.0:1788639132.784039:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754046720 00000100:00100000:1.0:1788639132.784098:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 32 00000100:00100000:1.0:1788639132.784107:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2404:x1875523754046720:12345-192.168.206.18@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1788639132.784140:0:8432:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 5deb128c-4fe3-4f51-b21e-f30846e08445@192.168.206.18@tcp t0 exp 0000000000000000 cur 391 last 0 00000020:00000080:1.0:1788639132.784189:0:8432:0:(genops.c:1385:class_connect()) connect: client 5deb128c-4fe3-4f51-b21e-f30846e08445, cookie 0x25c454990262c77e 00002000:00100000:1.0:1788639132.784202:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5deb128c-4fe3-4f51-b21e-f30846e08445/ffff9ae343eb8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788639132.784219:0:8432:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788639132.784296:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788639132.784348:0:8432:0:(import.c:65:import_set_state_nolock()) ffff9ae343eba000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788639132.784444:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2404:x1875523754046720:12345-192.168.206.18@tcp:8:lhsmtool_posix.0 Request processed in 336us (1644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639132.784452:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 32 00000100:00100000:0.0:1788639132.786786:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639132.787300:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754046848 00000100:00100000:2.0:1788639132.787313:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754046848 00000100:00100000:2.0:1788639132.787470:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 33 00000100:00100000:2.0:1788639132.787483:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+6:0:x1875523754046848:12345-192.168.206.18@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788639132.788992:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1788639132.800250:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:1.0:1788639132.800264:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5deb128c-4fe3-4f51-b21e-f30846e08445 00000100:00100000:2.0:1788639132.807408:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+5:0:x1875523754046848:12345-192.168.206.18@tcp:2:lhsmtool_posix.0 Request processed in 19918us (20627us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788639132.807425:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 33 00000100:00100000:0.0:1788639132.812750:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639132.812936:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754047104 00000100:00100000:2.0:1788639132.812950:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754047104 00000100:00100000:2.0:1788639132.813147:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 19 00000100:00100000:2.0:1788639132.813159:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+65:11322:x1875523754047104:12345-192.168.206.18@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788639132.813488:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+66:11322:x1875523754047104:12345-192.168.206.18@tcp:35:lhsmtool_posix.0 Request processed in 330us (750us total) trans 4294967357 rc 0/0 00000100:00100000:2.0:1788639132.813497:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 19 00000100:00100000:0.0:1788639132.819250:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639132.819413:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754047360 00000100:00100000:1.0:1788639132.819424:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754047360 00000100:00100000:1.0:1788639132.819517:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 87 00000100:00100000:1.0:1788639132.819527:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+66:11322:x1875523754047360:12345-192.168.206.18@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788639132.819688:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+66:11322:x1875523754047360:12345-192.168.206.18@tcp:57:lhsmtool_posix.0 Request processed in 161us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639132.819696:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 87 00000100:00100000:0.0:1788639132.822987:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639132.823139:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754047488 00000100:00100000:2.0:1788639132.823147:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754047488 00000100:00100000:2.0:1788639132.823208:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 88 00000100:00100000:2.0:1788639132.823226:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+66:11322:x1875523754047488:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788639132.823247:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639132.823271:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262c785 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85573 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.823336:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262c78c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.823350:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262c78c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.823361:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262c78c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788639132.823415:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788639132.823435:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262c78c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.823461:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262c785 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85573 expref: 68 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.823502:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262c78c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85573 expref: 67 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.823523:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ae242381300) 00010000:00010000:2.0:1788639132.823526:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788639132.823529:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78a600, rc 0) 00000100:00100000:2.0:1788639132.824216:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+67:11322:x1875523754047488:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 997us (1236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639132.824225:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 88 00000100:00100000:0.0:1788639132.828341:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639132.828434:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754047616 00000100:00100000:3.0:1788639132.828441:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754047616 00000100:00100000:3.0:1788639132.828497:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 34 00000100:00100000:3.0:1788639132.828506:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2407:x1875523754047616:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788639132.828526:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639132.828814:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012ddb085/0x25c454990262c793 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e8557a expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788639132.828858:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c779d, blocks: 0x0 00010000:00010000:3.0:1788639132.828877:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=391s v=(0 0) 00010000:00010000:3.0:1788639132.828882:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639132.828892:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012ddb085/0x25c454990262c793 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8557a expref: 6 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.828914:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012ddb085/0x25c454990262c793 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8557a expref: 6 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.828926:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae38217a200, rc 0) 00000100:00100000:3.0:1788639132.829022:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2407:x1875523754047616:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 516us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639132.829029:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 34 00000100:00100000:0.0:1788639132.833054:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639132.833253:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754047872 00000100:00100000:3.0:1788639132.833382:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754047872 00000100:00100000:3.0:1788639132.833497:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 89 00000100:00100000:3.0:1788639132.833508:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+67:11322:x1875523754047872:12345-192.168.206.18@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788639132.833637:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+67:11322:x1875523754047872:12345-192.168.206.18@tcp:57:lhsmtool_posix.0 Request processed in 110us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639132.833646:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 89 00000100:00100000:0.0:1788639132.837759:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639132.838774:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754048000 00000100:00100000:1.0:1788639132.838786:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754048000 00000100:00100000:1.0:1788639132.838849:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 35 00000100:00100000:1.0:1788639132.838860:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+6:11322:x1875523754048000:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788639132.838878:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639132.838897:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055027089/0x25c454990262c79a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85581 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.838938:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012ddb085/0x25c454990262c793 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8557a expref: 7 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.838947:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639132.838952:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639132.838982:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055027089/0x25c454990262c79a lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85581 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.839016:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000012ddb085/0x25c454990262c793 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8557a expref: 7 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.839030:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000012ddb085/0x25c454990262c793 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8557a expref: 7 pid: 8431 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639132.839044:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3461b4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1875523773002624:192.168.206.18@tcp:104: 00000100:00100000:1.0:1788639132.839186:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2420b3300 going to sleep for 11 seconds 00000100:00100000:0.0:1788639132.846019:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639132.846239:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3461b4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1875523773002624:192.168.206.18@tcp:104: 00010000:00010000:1.0:1788639132.846270:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000055027089/0x25c454990262c79a lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85581 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.846290:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae340030800, rc 0) 00000100:00100000:1.0:1788639132.846359:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+7:11322:x1875523754048000:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 7500us (8608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639132.846377:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 35 00000100:00100000:2.0:1788639132.846445:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754048128 00000100:00100000:2.0:1788639132.846452:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754048128 00010000:00010000:2.0:1788639132.846485:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000012ddb085/0x25c454990262c793 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8557a expref: 7 pid: 8431 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639132.846521:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 59 00000100:00100000:2.0:1788639132.846531:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+7:2407:x1875523754048128:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788639132.846742:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788639132.846766:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000012ddb085/0x25c454990262c793 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8557a expref: 7 pid: 8431 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.846780:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000012ddb085/0x25c454990262c793 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8557a expref: 7 pid: 8431 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.846802:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012ddb085/0x25c454990262c793 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8557a expref: 7 pid: 8431 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.846835:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788639132.846839:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788639132.846847:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000055027089/0x25c454990262c79a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85581 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.846858:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055027089/0x25c454990262c79a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85581 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.846960:0:6500:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000055027089/0x25c454990262c79a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85581 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639132.846974:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f82b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6500:1875523773002752:192.168.206.18@tcp:105: 00000100:00100000:2.0:1788639132.847086:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2431a4000 going to sleep for 11 seconds 00000100:00100000:2.0:1788639132.850404:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f82b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6500:1875523773002752:192.168.206.18@tcp:105: 00010000:00010000:2.0:1788639132.850429:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788639132.850481:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2407:x1875523754048128:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 3950us (4470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639132.850491:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 59 00000100:00100000:0.0:1788639132.855959:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639132.856092:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754048256 00000100:00100000:3.0:1788639132.856103:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754048256 00002000:00100000:3.0:1788639132.856147:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9ae3505d3480 x1875523754048256/t0(0) o4->5deb128c-4fe3-4f51-b21e-f30846e08445@192.168.206.18@tcp:353/0 lens 504/0 e 0 to 0 dl 1788639143 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788639132.856180:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae3505d3480 with x1875523754048256 ext(0->8) 00002000:00010000:3.0:1788639132.856186:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ae3505d3480 00000100:00100000:3.0:1788639132.856219:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 0 00000100:00100000:3.0:1788639132.856229:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2407:x1875523754048256:12345-192.168.206.18@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788639132.859248:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+8:2407:x1875523754048256:12345-192.168.206.18@tcp:4:lhsmtool_posix.0 Request processed in 3010us (3287us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788639132.859262:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 0 00002000:00100000:3.0:1788639132.859273:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9ae3505d3480 x1875523754048256/t4294967303(0) o4->5deb128c-4fe3-4f51-b21e-f30846e08445@192.168.206.18@tcp:353/0 lens 504/448 e 0 to 0 dl 1788639143 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788639132.859284:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae3505d3480 with x1875523754048256 ext(0->8) 00002000:00010000:3.0:1788639132.859290:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ae3505d3480 00000100:00100000:0.0:1788639132.869859:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639132.869963:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754048384 00000100:00100000:1.0:1788639132.869972:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754048384 00000100:00100000:1.0:1788639132.870030:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 90 00000100:00100000:1.0:1788639132.870039:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae343063800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+67:11322:x1875523754048384:12345-192.168.206.18@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788639132.872454:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967357 is committed 00000004:00080000:0.0:1788639132.872468:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:0.0:1788639132.872534:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:0.0:1788639132.872553:0:6494:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ae3801ec780 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1788639132.872568:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ae2420f8200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ae3801ec300 00000020:00080000:0.0:1788639132.872571:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ae2420f8400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ae348fbca00 00000100:00100000:0.0:1788639132.872741:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae343063800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+20:11322:x1875523754048384:12345-192.168.206.18@tcp:44:lhsmtool_posix.0 Request processed in 2700us (2890us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639132.872751:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 90 00000100:00100000:1.0:1788639132.873184:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788639132.873201:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3461b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773003008:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788639132.873261:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639132.873318:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788639132.873328:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f82b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773002880:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788639132.873389:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788639132.873415:0:6548:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1788639132.873751:0:6548:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1788639132.873765:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773003008 00000100:00100000:1.0:1788639132.873771:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773003008 00000100:00100000:1.0:1788639132.873808:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773002880 00000100:00100000:1.0:1788639132.873810:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773002880 00000100:00100000:1.0:1788639132.873828:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788639132.873835:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3461b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1875523773003008:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788639132.873859:0:8432:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:1.0:1788639132.873889:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a9c779b, atime: 0x6a9c779b, ctime: 0x6a9c779b, blocks: 0x8 00010000:00010000:1.0:1788639132.873896:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ead9f13a/0x25c454990262c7a1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.873911:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=391s v=(0 0) 00010000:00010000:1.0:1788639132.873916:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639132.873922:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ead9f13a/0x25c454990262c7a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.873937:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ead9f13a/0x25c454990262c7a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.873947:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ead9f13a/0x25c454990262c7a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.873966:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ead9f13a/0x25c454990262c7a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.873981:0:8432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788639132.874091:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3461b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3642:x1875523773003008:12345-0@lo:6:osp-syn-1-0.0 Request processed in 256us (830us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788639132.874097:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788639132.874112:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788639132.874118:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3461b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523773002880:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788639132.874191:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788639132.874194:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788639133 00002000:00010000:1.0:1788639132.874197:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788639132.874199:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788639133 -> 1788639133 00002000:00010000:1.0:1788639132.874201:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788639132.874231:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3461b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1875523773002880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 113us (841us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788639132.874237:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:1.0:1788639132.874276:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ae37f82b100/2, rc 0, transno 4294967304 00000100:00100000:1.0:1788639132.874282:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f82b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773002880:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1788639132.874305:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ae3461b4e00/2, rc 0, transno 4294967302 00000100:00100000:1.0:1788639132.874309:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3461b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773003008:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788639132.874426:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788639132.874433:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ead9f13a/0x25c454990262c7a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.874441:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae340031600 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:2.0:1788639132.874445:0:8446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ead9f13a/0x25c454990262c7a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.874461:0:8446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ead9f13a/0x25c454990262c7a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.874487:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ead9f13a/0x25c454990262c7a1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.874495:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ead9f13a/0x25c454990262c7a1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.874513:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639132.874515:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639132.874517:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788639132.874526:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788639132.874530:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788639132.875069:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262c4b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875080:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262c4b4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875085:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262c4b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875090:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78bc00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639132.875094:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262c4b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875099:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262c4b4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875123:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ae242358400) 00010000:00010000:3.0:1788639132.875126:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639132.875175:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262c4b4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875183:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262c4b4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875206:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ac00/0x25c454990262c4bb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875212:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ac00/0x25c454990262c4bb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875217:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ac00/0x25c454990262c4bb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875222:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78ac00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639132.875225:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ac00/0x25c454990262c4bb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875230:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ac00/0x25c454990262c4bb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875238:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ae242358d00) 00010000:00010000:3.0:1788639132.875240:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639132.875242:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ac00/0x25c454990262c4bb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875247:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ac00/0x25c454990262c4bb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875270:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030e00/0x25c454990262c4fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875277:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030e00/0x25c454990262c4fa lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875282:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030e00/0x25c454990262c4fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875287:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae340030e00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639132.875290:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030e00/0x25c454990262c4fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875296:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030e00/0x25c454990262c4fa lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875304:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ae2430f5600) 00010000:00010000:3.0:1788639132.875306:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639132.875308:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030e00/0x25c454990262c4fa lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875313:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030e00/0x25c454990262c4fa lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875326:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262c604 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875332:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262c604 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875336:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262c604 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875346:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fae00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639132.875349:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262c604 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875354:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262c604 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875361:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae242381f00) 00010000:00010000:3.0:1788639132.875362:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639132.875365:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262c604 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875381:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262c604 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875392:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262c627 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875397:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262c627 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875402:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262c627 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875406:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78be00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639132.875409:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262c627 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875414:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262c627 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875429:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae242381f00) 00010000:00010000:3.0:1788639132.875431:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639132.875434:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262c627 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875439:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262c627 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875449:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262c66d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875455:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262c66d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875459:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262c66d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875464:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fa200 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639132.875467:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262c66d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875472:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262c66d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875546:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae242381f00) 00010000:00010000:3.0:1788639132.875548:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639132.875551:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262c66d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875556:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262c66d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875576:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c770 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875582:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c770 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875587:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c770 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875591:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae38217b800 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639132.875594:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c770 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875600:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c770 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875606:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ae242381300) 00010000:00010000:3.0:1788639132.875608:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788639132.875610:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c770 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.875687:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c770 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639132.878799:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639132.879172:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754048512 00000100:00100000:1.0:1788639132.879182:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754048512 00000100:00100000:1.0:1788639132.879245:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 38 00000100:00100000:1.0:1788639132.879272:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae343062680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+8:2408:x1875523754048512:12345-192.168.206.18@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788639132.881055:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:0.0:1788639132.881070:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:1.0:1788639132.881330:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae343062680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2408:x1875523754048512:12345-192.168.206.18@tcp:16:lhsmtool_posix.0 Request processed in 2056us (2534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639132.881340:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 38 00000100:00100000:0.0:1788639132.885333:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639132.885441:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754048768 00000100:00100000:2.0:1788639132.885449:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754048768 00000100:00100000:2.0:1788639132.885610:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 91 00000100:00100000:2.0:1788639132.885679:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae343061c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+14:11322:x1875523754048768:12345-192.168.206.18@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788639132.885729:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788639132.885752:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262c78c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85573 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.885770:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ae242381300) 00010000:00010000:2.0:1788639132.885775:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788639132.885801:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262c7a8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.885831:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262c7a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.885841:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262c7a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788639132.886080:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c60289a4 reply state 000000009188825b transno 4294967358 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262c7a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.886092:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262c7a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.886098:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ae242381300) 00010000:00010000:2.0:1788639132.886100:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788639132.886103:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788639132.886412:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae343061c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+15:11322:x1875523754048768:12345-192.168.206.18@tcp:36:lhsmtool_posix.0 Request processed in 734us (1086us total) trans 4294967358 rc 0/0 00000100:00100000:2.0:1788639132.886420:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 91 00000100:00100000:1.0:1788639132.889786:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639132.889997:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754048896 00000100:00100000:3.0:1788639132.890007:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754048896 00000100:00100000:3.0:1788639132.890098:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 39 00000100:00100000:3.0:1788639132.890110:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3461b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2408:x1875523754048896:12345-192.168.206.18@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788639132.890279:0:8431:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788639132.890283:0:8431:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1788639133 -> 1788639132 00002000:00010000:3.0:1788639132.890300:0:8431:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788639131 00002000:00010000:3.0:1788639132.890302:0:8431:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788639133 -> 1788639132 00002000:00010000:3.0:1788639132.890304:0:8431:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788639132.890362:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3461b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+7:2408:x1875523754048896:12345-192.168.206.18@tcp:2:lhsmtool_posix.0 Request processed in 254us (584us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788639132.890380:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 39 00000100:00100000:0.0:1788639132.893265:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639132.893384:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754049152 00000100:00100000:3.0:1788639132.893392:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754049152 00000100:00100000:3.0:1788639132.893445:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 92 00000100:00100000:3.0:1788639132.893454:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae343063480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+15:11322:x1875523754049152:12345-192.168.206.18@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788639132.893695:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c7af lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.893711:0:11314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a600/0x25c454990262c769 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85565 expref: 15 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.893720:0:11314:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c7af lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.893752:0:11314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a600/0x25c454990262c769 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85565 expref: 15 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.893764:0:11314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a600/0x25c454990262c769 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85565 expref: 15 pid: 11314 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639132.893776:0:11314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f78d180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11314:1875523773003136:192.168.206.18@tcp:104: 00000100:00100000:3.0:1788639132.893856:0:11314:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae35058a000 going to sleep for 11 seconds 00000100:00100000:0.0:1788639132.897659:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639132.897755:0:11314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f78d180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11314:1875523773003136:192.168.206.18@tcp:104: 00010000:00010000:3.0:1788639132.897799:0:11314:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c7af lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639132.898196:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754049280 00000100:00100000:1.0:1788639132.898204:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754049280 00010000:00010000:1.0:1788639132.898246:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a600/0x25c454990262c769 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85565 expref: 16 pid: 11314 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639132.898281:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 60 00000100:00100000:1.0:1788639132.898291:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae343060380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+16:2407:x1875523754049280:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788639132.898304:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788639132.898310:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a600/0x25c454990262c769 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85565 expref: 16 pid: 11314 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.898321:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a600/0x25c454990262c769 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85565 expref: 16 pid: 11314 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.898340:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a600/0x25c454990262c769 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85565 expref: 16 pid: 11314 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.898355:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ae242381300) 00010000:00010000:1.0:1788639132.898359:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c7af lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.898379:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c7af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.898394:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c7af lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.898421:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788639132.898468:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae343060380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+15:2407:x1875523754049280:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 178us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639132.898481:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 60 00010000:00010000:2.0:1788639132.898599:0:11314:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c7af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.898606:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c7af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.898673:0:11314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c7af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.898680:0:11314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c7af lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.898685:0:11314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c7af lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.898696:0:11314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae38217b800 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639132.898700:0:11314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c7af lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.898707:0:11314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c7af lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.898715:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ae242381300) 00010000:00010000:2.0:1788639132.898717:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788639132.898720:0:11314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c7af lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.898726:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c7af lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639132.898762:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae343063480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+14:11322:x1875523754049152:12345-192.168.206.18@tcp:55:lhsmtool_posix.0 Request processed in 5309us (5505us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788639132.898768:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 92 00000100:00100000:1.0:1788639132.901482:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639132.901606:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754049408 00000100:00100000:2.0:1788639132.901651:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754049408 00000100:00100000:2.0:1788639132.901699:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 40 00000100:00100000:2.0:1788639132.901708:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3461b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+7:2405:x1875523754049408:12345-192.168.206.18@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788639132.901746:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000037681740/0x25c454990262c7b6 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.901766:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000055027089/0x25c454990262c79a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85581 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.901792:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788639132.901796:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788639132.901800:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037681740/0x25c454990262c7b6 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.901836:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000055027089/0x25c454990262c79a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85581 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.901862:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000055027089/0x25c454990262c79a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85581 expref: 7 pid: 8430 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639132.901884:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e14bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1875523773003264:192.168.206.18@tcp:104: 00000100:00100000:2.0:1788639132.901949:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2431a49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788639132.906079:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639132.906166:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e14bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1875523773003264:192.168.206.18@tcp:104: 00010000:00010000:2.0:1788639132.906190:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000037681740/0x25c454990262c7b6 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639132.906249:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754049536 00000100:00100000:3.0:1788639132.906256:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754049536 00010000:00010000:3.0:1788639132.906292:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000055027089/0x25c454990262c79a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85581 expref: 8 pid: 8430 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639132.906327:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 61 00000100:00100000:3.0:1788639132.906335:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae343061880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+8:2408:x1875523754049536:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788639132.906347:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639132.906365:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000055027089/0x25c454990262c79a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85581 expref: 8 pid: 8430 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.906391:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000055027089/0x25c454990262c79a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85581 expref: 8 pid: 8430 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.906412:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055027089/0x25c454990262c79a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85581 expref: 8 pid: 8430 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.906428:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788639132.906432:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788639132.906438:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000037681740/0x25c454990262c7b6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.906448:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037681740/0x25c454990262c7b6 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.906501:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639132.906555:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae343061880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+7:2408:x1875523754049536:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 220us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639132.906562:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 61 00010000:00010000:2.0:1788639132.906711:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000037681740/0x25c454990262c7b6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.906720:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037681740/0x25c454990262c7b6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.906739:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000037681740/0x25c454990262c7b6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.906752:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037681740/0x25c454990262c7b6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.906760:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037681740/0x25c454990262c7b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.906767:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78a600 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:2.0:1788639132.906771:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037681740/0x25c454990262c7b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.906780:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037681740/0x25c454990262c7b6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.906791:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037681740/0x25c454990262c7b6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.906798:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037681740/0x25c454990262c7b6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639132.906846:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3461b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2405:x1875523754049408:12345-192.168.206.18@tcp:1:lhsmtool_posix.0 Request processed in 5139us (5381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639132.906864:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 40 00000100:00100000:0.0:1788639132.910259:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639132.910406:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754049792 00000100:00100000:1.0:1788639132.910414:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754049792 00000100:00100000:1.0:1788639132.910466:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 93 00000100:00100000:1.0:1788639132.910566:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae343060000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+14:11322:x1875523754049792:12345-192.168.206.18@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788639132.910684:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031000/0x25c454990262c7bd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.910700:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262c5fd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8550a expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.910709:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031000/0x25c454990262c7bd lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.910738:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262c5fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8550a expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.910750:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262c5fd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8550a expref: 14 pid: 6518 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639132.910761:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3461b5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1875523773003392:192.168.206.18@tcp:104: 00000100:00100000:1.0:1788639132.912118:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2420b36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788639132.914275:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639132.914356:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754049920 00000100:00100000:3.0:1788639132.914365:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754049920 00010000:00010000:3.0:1788639132.914416:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262c5fd lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8550a expref: 15 pid: 6518 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639132.914459:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 62 00000100:00100000:3.0:1788639132.914470:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ff8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+15:2407:x1875523754049920:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788639132.914495:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639132.914503:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262c5fd lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8550a expref: 15 pid: 6518 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.914516:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262c5fd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8550a expref: 15 pid: 6518 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.914537:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae242381f00) 00010000:00010000:3.0:1788639132.914542:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031000/0x25c454990262c7bd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.914552:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031000/0x25c454990262c7bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.914560:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031000/0x25c454990262c7bd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.914597:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639132.914679:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ff8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+15:2407:x1875523754049920:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 209us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639132.914686:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 62 00010000:00010000:1.0:1788639132.915827:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262c5fd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8550a expref: 14 pid: 6518 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639132.915856:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3461b5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1875523773003392:192.168.206.18@tcp:104: 00010000:00010000:1.0:1788639132.915886:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031000/0x25c454990262c7bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.915896:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031000/0x25c454990262c7bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.915902:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031000/0x25c454990262c7bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.916064:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030e00/0x25c454990262c7c4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.916077:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030400/0x25c454990262c777 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8556c expref: 14 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.916087:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030e00/0x25c454990262c7c4 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.916114:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030400/0x25c454990262c777 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8556c expref: 14 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.916127:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030400/0x25c454990262c777 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8556c expref: 14 pid: 10169 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639132.916139:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3461b5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1875523773003520:192.168.206.18@tcp:104: 00000100:00100000:1.0:1788639132.916233:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2420b3300 going to sleep for 11 seconds 00000100:00100000:0.0:1788639132.922314:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639132.922409:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754050048 00000100:00100000:2.0:1788639132.922418:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754050048 00010000:00010000:2.0:1788639132.922454:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030400/0x25c454990262c777 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8556c expref: 15 pid: 10169 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639132.922505:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 63 00000100:00100000:2.0:1788639132.922512:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae343060700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+15:2407:x1875523754050048:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788639132.922525:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788639132.922531:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030400/0x25c454990262c777 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8556c expref: 15 pid: 10169 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.922543:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030400/0x25c454990262c777 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8556c expref: 15 pid: 10169 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.922561:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ae242381300) 00010000:00010000:2.0:1788639132.922565:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030e00/0x25c454990262c7c4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.922574:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030e00/0x25c454990262c7c4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.922581:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030e00/0x25c454990262c7c4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.922598:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788639132.922669:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae343060700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+15:2407:x1875523754050048:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 156us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639132.922676:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 63 00010000:00010000:1.0:1788639132.923216:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030400/0x25c454990262c777 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8556c expref: 14 pid: 10169 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639132.923234:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3461b5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1875523773003520:192.168.206.18@tcp:104: 00010000:00010000:1.0:1788639132.923253:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030e00/0x25c454990262c7c4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.923261:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030e00/0x25c454990262c7c4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.923267:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030e00/0x25c454990262c7c4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788639132.923384:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:1.0:1788639132.923506:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000001:00080000:1.0:1788639132.923541:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:1.0:1788639132.923697:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3461b5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6518:1875523773003648:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788639132.923744:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639132.923766:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2420b33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788639132.923994:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773003648 00000100:00100000:0.0:1788639132.924000:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773003648 00000100:00100000:0.0:1788639132.924048:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788639132.924056:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3461b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6518:x1875523773003648:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788639132.924145:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3461b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6518:x1875523773003648:12345-0@lo:1000:mdt00_002.0 Request processed in 89us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639132.924152:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788639132.925207:0:6518:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1788639132.925223:0:6518:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ae37f82b100, transno 4294967304 00000100:00100000:1.0:1788639132.925238:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3461b5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6518:1875523773003648:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1788639132.925377:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967362 00000100:00100000:1.0:1788639132.925438:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3461b5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6518:1875523773003776:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788639132.925491:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639132.925510:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36e1829c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788639132.925812:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773003776 00000100:00100000:0.0:1788639132.925818:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773003776 00000100:00100000:0.0:1788639132.925864:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788639132.925882:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3461b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6518:x1875523773003776:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788639132.926006:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3461b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6518:x1875523773003776:12345-0@lo:1000:mdt00_002.0 Request processed in 126us (514us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788639132.926025:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788639132.926106:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3461b5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6518:1875523773003776:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788639132.926142:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030e00/0x25c454990262c7c4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.926159:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030e00/0x25c454990262c7c4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.926166:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030e00/0x25c454990262c7c4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.926171:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae340030e00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639132.926175:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030e00/0x25c454990262c7c4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.926182:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030e00/0x25c454990262c7c4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.926213:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ae242381300) 00010000:00010000:2.0:1788639132.926216:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788639132.926220:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030e00/0x25c454990262c7c4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.926225:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030e00/0x25c454990262c7c4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.926255:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c6f2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.926260:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c6f2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.926265:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c6f2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.926270:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fac00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639132.926278:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c6f2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.926284:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c6f2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.926292:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae242381f00) 00010000:00010000:2.0:1788639132.926294:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788639132.926297:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c6f2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.926302:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c6f2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.926342:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262c7cb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.926354:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c70e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85550 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.926362:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262c7cb lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.926399:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c70e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85550 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.926412:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c70e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85550 expref: 17 pid: 6517 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639132.926422:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e14bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1875523773003904:192.168.206.18@tcp:104: 00000100:00100000:2.0:1788639132.926492:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2431a4780 going to sleep for 11 seconds 00000100:00100000:1.0:1788639132.929275:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e14bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6518:1875523773003904:192.168.206.18@tcp:104: 00010000:00010000:1.0:1788639132.929320:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262c7cb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639132.936358:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639132.941336:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754050176 00000100:00100000:2.0:1788639132.941352:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754050176 00010000:00010000:2.0:1788639132.941406:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c70e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85550 expref: 18 pid: 6517 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639132.941456:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 64 00000100:00100000:2.0:1788639132.941464:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae343060a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+18:2408:x1875523754050176:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788639132.941765:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788639132.941775:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c70e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85550 expref: 18 pid: 6517 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.941788:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c70e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85550 expref: 18 pid: 6517 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.941808:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c70e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85550 expref: 18 pid: 6517 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.941823:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae242381f00) 00010000:00010000:2.0:1788639132.941829:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262c7cb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.941841:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262c7cb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.941849:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262c7cb lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639132.942329:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788639132.942456:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262c7cb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.942466:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262c7cb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.942488:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262c7cb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.942494:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262c7cb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.942500:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262c7cb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.942505:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78a600 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639132.942509:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262c7cb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.942516:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262c7cb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.942525:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae242381f00) 00010000:00010000:1.0:1788639132.942528:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639132.942531:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262c7cb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.942536:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262c7cb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.942568:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031000/0x25c454990262c7bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.942573:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031000/0x25c454990262c7bd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.942578:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031000/0x25c454990262c7bd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.942582:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae340031000 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639132.942585:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031000/0x25c454990262c7bd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.942590:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031000/0x25c454990262c7bd lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.942596:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae242381f00) 00010000:00010000:1.0:1788639132.942598:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788639132.942600:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031000/0x25c454990262c7bd lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.942605:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031000/0x25c454990262c7bd lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639132.942783:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae343060a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+17:2408:x1875523754050176:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 1317us (6432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639132.942799:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 64 00000040:00080000:3.0:1788639132.943038:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788639132.943043:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788639132.943057:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788639132.943068:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788639132.943207:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae343060000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+16:11322:x1875523754049792:12345-192.168.206.18@tcp:57:lhsmtool_posix.0 Request processed in 32733us (32955us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1788639132.943224:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 93 00000020:00080000:1.0:1788639132.943228:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1788639132.947400:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639132.947821:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754050432 00000100:00100000:1.0:1788639132.947833:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754050432 00000100:00100000:1.0:1788639132.948050:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 20 00000100:00100000:1.0:1788639132.948062:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae343062d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+16:11322:x1875523754050432:12345-192.168.206.18@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788639132.948397:0:6519:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788639132.948429:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967364 00010000:00010000:1.0:1788639132.948459:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030400/0x25c454990262c7d2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.948542:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030400/0x25c454990262c7d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.948554:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030400/0x25c454990262c7d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.948562:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030400/0x25c454990262c7d2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.948568:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030400/0x25c454990262c7d2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.948574:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030400/0x25c454990262c7d2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639132.948665:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788639132.948745:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae343062d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+18:11322:x1875523754050432:12345-192.168.206.18@tcp:35:lhsmtool_posix.0 Request processed in 685us (1363us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1788639132.948753:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 20 00000020:00080000:1.0:1788639132.948757:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788639132.950813:0:9519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788639132.950825:0:9519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030400/0x25c454990262c7d2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.950836:0:9519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae340030400 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:3.0:1788639132.950840:0:9519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030400/0x25c454990262c7d2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.951031:0:9519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030400/0x25c454990262c7d2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.951051:0:9519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ae242381300) 00010000:00010000:3.0:1788639132.951054:0:9519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788639132.951059:0:9519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030400/0x25c454990262c7d2 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.951065:0:9519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030400/0x25c454990262c7d2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639132.951081:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639132.951083:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639132.951084:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639133.108865:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639133.366963:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788639133.366987:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e14bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773004032:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788639133.367055:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639133.367927:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773004032 00000100:00100000:2.0:1788639133.367936:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773004032 00000100:00100000:2.0:1788639133.368005:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788639133.368015:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f78ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773004032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788639133.368042:0:13805:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788639133.368108:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f78ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773004032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (1052us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639133.368115:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:3.0:1788639133.368208:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788639133.368242:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e14bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773004032:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788639133.369760:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae343063b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523773004160:0@lo:400:kworker.0 00000100:00100000:1.0:1788639133.369837:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639133.369928:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773004160 00000100:00100000:2.0:1788639133.369935:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773004160 00000100:00100000:2.0:1788639133.369982:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1788639133.369991:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370fff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+24:3643:x1875523773004160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639133.370235:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae343063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875523773004288:0@lo:400:kworker.0 00000100:00100000:3.0:1788639133.370284:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639133.370341:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773004288 00000100:00100000:3.0:1788639133.370345:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773004288 00000100:00100000:3.0:1788639133.370388:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788639133.370395:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f78d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875523773004288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639133.370433:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f78d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875523773004288:12345-0@lo:400:kworker.0 Request processed in 39us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639133.370440:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788639133.370476:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae343063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875523773004288:0@lo:400:kworker.0 00000100:00100000:2.0:1788639133.370863:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370fff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+24:3643:x1875523773004160:12345-0@lo:400:kworker.0 Request processed in 872us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639133.370871:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1788639133.370935:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae343063b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523773004160:0@lo:400:kworker.0 00000100:00100000:1.0:1788639133.371088:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae343061180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773004416:0@lo:400:kworker.0 00000100:00100000:1.0:1788639133.371120:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639133.372806:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae343062a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523773004544:0@lo:400:kworker.0 00000100:00100000:3.0:1788639133.372872:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639133.373593:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae343060e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875523773004800:0@lo:400:kworker.0 00000100:00100000:3.0:1788639133.373633:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae343062300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773004672:0@lo:400:kworker.0 00000100:00100000:1.0:1788639133.373655:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639133.373686:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639133.373693:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae343061f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875523773004928:0@lo:400:kworker.0 00000100:00100000:1.0:1788639133.373723:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639133.373992:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773004416 00000100:00100000:0.0:1788639133.373999:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773004416 00000100:00100000:0.0:1788639133.374038:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773004672 00000100:00100000:0.0:1788639133.374042:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773004672 00000100:00100000:0.0:1788639133.374058:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788639133.374066:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3461b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773004416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639133.374136:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3461b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773004416:12345-0@lo:400:kworker.0 Request processed in 70us (3015us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639133.374533:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788639133.374558:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788639133.374567:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523773004672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639133.374603:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523773004672:12345-0@lo:400:kworker.0 Request processed in 39us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639133.374609:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788639133.374672:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae343061500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523773005056:0@lo:400:kworker.0 00000100:00100000:0.0:1788639133.374723:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639133.374749:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae343061880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773005568:0@lo:400:kworker.0 00000100:00100000:0.0:1788639133.374773:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639133.374805:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788639133.374812:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae343060380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875523773005440:0@lo:400:kworker.0 00000100:00100000:0.0:1788639133.375081:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639133.375553:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773004544 00000100:00100000:3.0:1788639133.375561:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773004544 00000100:00100000:3.0:1788639133.375602:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773004800 00000100:00100000:3.0:1788639133.375605:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773004800 00000100:00100000:3.0:1788639133.375741:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773004928 00000100:00100000:3.0:1788639133.375746:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773004928 00000100:00100000:3.0:1788639133.375766:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788639133.375773:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f83a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523773004544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639133.376009:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f83a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523773004544:12345-0@lo:400:kworker.0 Request processed in 236us (3136us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639133.376029:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788639133.376044:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788639133.376050:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3461b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875523773004800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639133.376081:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3461b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875523773004800:12345-0@lo:400:kworker.0 Request processed in 31us (2427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639133.376088:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788639133.376172:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae343062a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523773004544:0@lo:400:kworker.0 00000100:00100000:0.0:1788639133.376221:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773005056 00000100:00100000:0.0:1788639133.376225:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773005056 00000100:00100000:0.0:1788639133.376268:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773005568 00000100:00100000:0.0:1788639133.376278:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773005568 00000100:00100000:0.0:1788639133.376299:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788639133.376305:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243935c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523773005056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639133.376343:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243935c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523773005056:12345-0@lo:400:kworker.0 Request processed in 38us (1620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639133.376349:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788639133.376360:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788639133.376378:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243937480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3642:x1875523773005568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639133.376405:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773005440 00000100:00100000:0.0:1788639133.376407:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243937480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3642:x1875523773005568:12345-0@lo:400:kworker.0 Request processed in 40us (1633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639133.376411:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773005440 00000100:00100000:0.0:1788639133.376416:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788639133.376436:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788639133.376444:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3461b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875523773004928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639133.376458:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae343063b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773005184:0@lo:400:kworker.0 00000100:00100000:0.0:1788639133.376488:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639133.376514:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae343062300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773004672:0@lo:400:kworker.0 00000100:00100000:0.0:1788639133.376532:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788639133.376539:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3461b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875523773004928:12345-0@lo:400:kworker.0 Request processed in 94us (2815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639133.376541:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae343063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875523773005312:0@lo:400:kworker.0 00000100:00100000:3.0:1788639133.376550:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788639133.376567:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788639133.376572:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639133.376577:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243934380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875523773005440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639133.376595:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773005184 00000100:00100000:0.0:1788639133.376600:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773005184 00000100:00100000:3.0:1788639133.376634:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243934380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875523773005440:12345-0@lo:400:kworker.0 Request processed in 40us (1532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639133.376644:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788639133.376644:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788639133.376654:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243935880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3643:x1875523773005184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639133.376685:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243935880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3643:x1875523773005184:12345-0@lo:400:kworker.0 Request processed in 34us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639133.376702:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788639133.376719:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773005312 00000100:00100000:3.0:1788639133.376724:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773005312 00000100:00100000:0.0:1788639133.376739:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae343063b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773005184:0@lo:400:kworker.0 00000100:00100000:3.0:1788639133.376750:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788639133.376759:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875523773005312:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788639133.376771:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae343060380 x1875523773005440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639133.376783:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae343060380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875523773005440:0@lo:400:kworker.0 00000100:00100000:0.0:1788639133.376796:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae343061500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523773005056:0@lo:400:kworker.0 00000100:00100000:0.0:1788639133.376808:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae343061880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773005568:0@lo:400:kworker.0 00000100:00100000:0.0:1788639133.376852:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae343060e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875523773004800:0@lo:400:kworker.0 00010000:00080000:0.0:1788639133.376876:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae343061f80 x1875523773004928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639133.376887:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae343061f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875523773004928:0@lo:400:kworker.0 00000100:00100000:0.0:1788639133.376898:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae343061180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773004416:0@lo:400:kworker.0 00000100:00080000:0.0:1788639133.376964:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788639133.376980:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788639133.376982:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788639133.376993:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875523773005312:12345-0@lo:400:kworker.0 Request processed in 234us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639133.377001:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788639133.377038:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae343063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875523773005312:0@lo:400:kworker.0 00000040:00080000:1.0:1788639133.750766:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788639133.877229:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788639133.877254:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243953100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773005696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788639133.877325:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639133.877409:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3505d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773005824:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788639133.877436:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639133.878096:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773005696 00000100:00100000:1.0:1788639133.878105:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773005696 00000100:00100000:1.0:1788639133.878157:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788639133.878167:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243934700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1875523773005696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788639133.878188:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788639133.878248:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243934700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1875523773005696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639133.878255:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788639133.878382:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773005824 00000100:00100000:3.0:1788639133.878388:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773005824 00000100:00100000:3.0:1788639133.878425:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788639133.878433:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243934a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773005824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788639133.878565:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788639133.878608:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243953100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773005696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788639133.878610:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243934a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773005824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 176us (1171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639133.878642:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788639133.878664:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3505d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773005824:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1788639134.004823:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788639134.004831:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788639134.004847:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788639134.004855:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788639134.133517:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788639134.168774:0:14259:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788639134.168782:0:14259:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788639134.168807:0:14259:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788639134.168815:0:14259:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788639134.279351:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639134.279458:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754050688 00000100:00100000:3.0:1788639134.279468:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754050688 00000100:00080000:0.0:1788639134.279523:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788639134.279537:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 94 00000100:00100000:3.0:1788639134.279550:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243936d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+18:11339:x1875523754050688:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:3.0:1788639134.279573:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639134.279594:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c7d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85588 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.279794:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a600/0x25c454990262c7e0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.279811:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a600/0x25c454990262c7e0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.279826:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a600/0x25c454990262c7e0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788639134.279848:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788639134.279942:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c7d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85588 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.279959:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a600/0x25c454990262c7e0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85588 expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.279969:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ae242358d00) 00010000:00010000:3.0:1788639134.279972:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788639134.279976:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae38217a600, rc 0) 00000100:00100000:3.0:1788639134.280052:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243936d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+20:11339:x1875523754050688:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 505us (707us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1788639134.280060:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 94 00000100:00100000:3.0:1788639134.286215:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639134.286252:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754050816 00000100:00100000:3.0:1788639134.286261:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754050816 00000100:00100000:3.0:1788639134.286309:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 95 00000100:00100000:3.0:1788639134.286413:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+20:11339:x1875523754050816:12345-192.168.206.18@tcp:34:lfs.0 00010000:00010000:3.0:1788639134.286483:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a200/0x25c454990262c7ee lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.286500:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a200/0x25c454990262c7ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.286512:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a200/0x25c454990262c7ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.286528:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b600/0x25c454990262c7f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.286544:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b600/0x25c454990262c7f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.286552:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b600/0x25c454990262c7f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.286723:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c7fc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.286735:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c7fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.286744:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c7fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788639134.286858:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c7fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.286872:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a200/0x25c454990262c7ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.286880:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a200/0x25c454990262c7ee lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.286888:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a200/0x25c454990262c7ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.286895:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae38217a200 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639134.286899:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a200/0x25c454990262c7ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.286908:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a200/0x25c454990262c7ee lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.286926:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ae242358d00) 00010000:00010000:3.0:1788639134.286929:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639134.286934:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a200/0x25c454990262c7ee lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.286952:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a200/0x25c454990262c7ee lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.286965:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b600/0x25c454990262c7f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.286972:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b600/0x25c454990262c7f5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.286976:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b600/0x25c454990262c7f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.286982:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae38217b600 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639134.286984:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b600/0x25c454990262c7f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.286991:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b600/0x25c454990262c7f5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.286999:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ae242381500) 00010000:00010000:3.0:1788639134.287001:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639134.287004:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b600/0x25c454990262c7f5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.287009:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b600/0x25c454990262c7f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.287032:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c7fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.287038:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c7fc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.287044:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c7fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.287050:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae38217b000 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639134.287053:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c7fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.287059:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c7fc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.287065:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae242381700) 00010000:00010000:3.0:1788639134.287068:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639134.287070:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c7fc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.287075:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c7fc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639134.287145:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+20:11339:x1875523754050816:12345-192.168.206.18@tcp:34:lfs.0 Request processed in 736us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639134.287153:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 95 00000100:00100000:0.0:1788639134.317812:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639134.318425:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754051072 00000100:00100000:1.0:1788639134.318434:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754051072 00000100:00100000:1.0:1788639134.318492:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 96 00000100:00100000:1.0:1788639134.318501:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243937b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+20:11342:x1875523754051072:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:1.0:1788639134.318524:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639134.318542:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030e00/0x25c454990262c803 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e8558f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.318669:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030800/0x25c454990262c80a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.318683:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030800/0x25c454990262c80a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.318693:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030800/0x25c454990262c80a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.318706:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030400/0x25c454990262c811 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.318712:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030400/0x25c454990262c811 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.318718:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030400/0x25c454990262c811 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.318949:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031000/0x25c454990262c818 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.318958:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031000/0x25c454990262c818 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.318964:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031000/0x25c454990262c818 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788639134.318973:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788639134.319044:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030800/0x25c454990262c80a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.319051:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030800/0x25c454990262c80a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.319064:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030800/0x25c454990262c80a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.319070:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae340030800 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639134.319073:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030800/0x25c454990262c80a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.319080:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030800/0x25c454990262c80a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.319090:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ae242358d00) 00010000:00010000:1.0:1788639134.319092:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639134.319096:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030800/0x25c454990262c80a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.319102:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030800/0x25c454990262c80a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.319115:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030400/0x25c454990262c811 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.319120:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030400/0x25c454990262c811 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.319125:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030400/0x25c454990262c811 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.319129:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae340030400 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639134.319132:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030400/0x25c454990262c811 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.319147:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030400/0x25c454990262c811 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.319154:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ae362514f00) 00010000:00010000:1.0:1788639134.319156:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639134.319159:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030400/0x25c454990262c811 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.319165:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030400/0x25c454990262c811 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.319202:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340030e00/0x25c454990262c803 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8558f expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.319216:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031000/0x25c454990262c818 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8558f expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.319222:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae362514400) 00010000:00010000:1.0:1788639134.319224:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788639134.319226:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae340031000, rc 0) 00000100:00100000:1.0:1788639134.319752:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243937b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+22:11342:x1875523754051072:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 1249us (1946us total) trans 4294967367 rc 0/0 00000100:00100000:1.0:1788639134.319761:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 96 00000100:00100000:0.0:1788639134.328599:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639134.329093:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754051200 00000100:00100000:1.0:1788639134.329103:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754051200 00000100:00100000:1.0:1788639134.329159:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 97 00000100:00100000:1.0:1788639134.329170:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243937100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+22:11342:x1875523754051200:12345-192.168.206.18@tcp:54:lfs.0 00010000:00010000:1.0:1788639134.329244:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031600/0x25c454990262c826 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.329260:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031600/0x25c454990262c826 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.329273:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031600/0x25c454990262c826 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.329325:0:10169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031600/0x25c454990262c826 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.329332:0:10169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031600/0x25c454990262c826 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.329338:0:10169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031600/0x25c454990262c826 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.329343:0:10169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae340031600 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639134.329346:0:10169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031600/0x25c454990262c826 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.329353:0:10169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031600/0x25c454990262c826 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.329374:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae362514400) 00010000:00010000:1.0:1788639134.329377:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788639134.329382:0:10169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031600/0x25c454990262c826 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.329388:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031600/0x25c454990262c826 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639134.329466:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243937100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+22:11342:x1875523754051200:12345-192.168.206.18@tcp:54:lfs.0 Request processed in 297us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639134.329474:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 97 00000100:00100000:0.0:1788639134.335423:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639134.335477:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754051456 00000100:00100000:0.0:1788639134.335487:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754051456 00000100:00100000:0.0:1788639134.335547:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 21 00000100:00100000:0.0:1788639134.335561:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ef1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+22:11342:x1875523754051456:12345-192.168.206.18@tcp:35:lfs.0 00000100:00100000:0.0:1788639134.335799:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ef1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+23:11342:x1875523754051456:12345-192.168.206.18@tcp:35:lfs.0 Request processed in 240us (382us total) trans 4294967368 rc 0/0 00000100:00100000:0.0:1788639134.335814:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 21 00000100:00100000:1.0:1788639134.372602:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639134.372723:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754051712 00000100:00100000:3.0:1788639134.372732:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754051712 00000100:00100000:3.0:1788639134.372780:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 98 00000100:00100000:3.0:1788639134.372804:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243950e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+23:10861:x1875523754051712:12345-192.168.206.18@tcp:101:bash.0 00010000:00010000:3.0:1788639134.372827:0:11314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639134.372846:0:11314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae341480800/0x25c454990262c82d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85596 expref: -99 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.372948:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae341480600/0x25c454990262c834 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.372962:0:11314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031000/0x25c454990262c818 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8558f expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.372970:0:11314:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae341480600/0x25c454990262c834 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.373000:0:11314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031000/0x25c454990262c818 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8558f expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.373012:0:11314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031000/0x25c454990262c818 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8558f expref: 24 pid: 6518 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639134.373026:0:11314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3505d1880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11314:1875523773005952:192.168.206.18@tcp:104: 00000100:00100000:3.0:1788639134.373109:0:11314:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3801ecc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788639134.375672:0:11314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3505d1880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11314:1875523773005952:192.168.206.18@tcp:104: 00010000:00010000:1.0:1788639134.375698:0:11314:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae341480600/0x25c454990262c834 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639134.376964:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639134.377115:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754051840 00000100:00100000:3.0:1788639134.377123:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754051840 00010000:00010000:3.0:1788639134.377160:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031000/0x25c454990262c818 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8558f expref: 25 pid: 6518 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639134.377198:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 65 00000100:00100000:3.0:1788639134.377207:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243951500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+25:2407:x1875523754051840:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788639134.377229:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639134.377237:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031000/0x25c454990262c818 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8558f expref: 25 pid: 6518 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.377250:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031000/0x25c454990262c818 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8558f expref: 25 pid: 6518 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.377271:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae340031000/0x25c454990262c818 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8558f expref: 25 pid: 6518 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.377284:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae362514400) 00010000:00010000:3.0:1788639134.377289:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae341480600/0x25c454990262c834 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.377298:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae341480600/0x25c454990262c834 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.377305:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae341480600/0x25c454990262c834 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.377333:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639134.377398:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243951500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+24:2407:x1875523754051840:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 191us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639134.377405:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 65 00010000:00010000:1.0:1788639134.377467:0:11314:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae341480600/0x25c454990262c834 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.377475:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae341480600/0x25c454990262c834 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788639134.377493:0:11314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788639134.377605:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae341480800/0x25c454990262c82d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85596 expref: 25 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.377652:0:11314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae341480600/0x25c454990262c834 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85596 expref: 24 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.377660:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae362514400) 00010000:00010000:1.0:1788639134.377662:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788639134.377665:0:11314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae341480600, rc 0) 00000100:00100000:1.0:1788639134.377690:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243950e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+24:10861:x1875523754051712:12345-192.168.206.18@tcp:101:bash.0 Request processed in 4888us (5096us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1788639134.377709:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 98 00000100:00100000:3.0:1788639134.385178:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639134.385256:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754051968 00000100:00100000:1.0:1788639134.385265:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754051968 00000100:00100000:1.0:1788639134.385325:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 99 00000100:00100000:1.0:1788639134.385334:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+24:10861:x1875523754051968:12345-192.168.206.18@tcp:101:bash.0 00010000:00010000:1.0:1788639134.385356:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639134.385384:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c842 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e8559d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.385418:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262c849 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.385432:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262c849 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.385442:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262c849 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.385561:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c842 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8559d expref: 26 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.385578:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262c849 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8559d expref: 25 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.385587:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae362514400) 00010000:00010000:1.0:1788639134.385590:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788639134.385593:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fb000, rc 0) 00000100:00100000:1.0:1788639134.385693:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+25:10861:x1875523754051968:12345-192.168.206.18@tcp:101:bash.0 Request processed in 359us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639134.385705:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 99 00000100:00100000:3.0:1788639134.388004:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639134.389839:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae36e14bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773006080:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788639134.389900:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639134.390012:0:12414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773006080 00000100:00100000:3.0:1788639134.390020:0:12414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773006080 00000100:00100000:3.0:1788639134.390074:0:12414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788639134.390097:0:12414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243953100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773006080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788639134.390128:0:12414:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788639134.390216:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754052224 00000100:00100000:0.0:1788639134.390221:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754052224 00000100:00100000:0.0:1788639134.390255:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 100 00000100:00100000:0.0:1788639134.390262:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+25:10861:x1875523754052224:12345-192.168.206.18@tcp:36:bash.0 00010000:00010000:0.0:1788639134.390479:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262c850 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.390496:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262c850 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.390505:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262c850 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788639134.390554:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000004:00010000:0.0:1788639134.390577:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f44e046c reply state 0000000024b222b0 transno 4294967371 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262c850 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.390590:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262c850 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.390597:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae362514400) 00010000:00010000:0.0:1788639134.390599:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788639134.390602:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788639134.390667:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967371 00000100:00100000:0.0:1788639134.390743:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+29:10861:x1875523754052224:12345-192.168.206.18@tcp:36:bash.0 Request processed in 481us (2783us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1788639134.390750:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 100 00000020:00080000:0.0:1788639134.390754:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788639134.391986:0:12414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243953100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773006080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1884us (2078us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639134.391997:0:12414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788639134.392068:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae36e14bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773006080:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788639134.392575:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639134.392762:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754052352 00000100:00100000:1.0:1788639134.392775:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754052352 00000100:00100000:1.0:1788639134.392848:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 101 00000100:00100000:1.0:1788639134.392934:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+29:10861:x1875523754052352:12345-192.168.206.18@tcp:101:bash.0 00010000:00010000:1.0:1788639134.392969:0:11314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639134.392998:0:11314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262c857 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e855a4 expref: -99 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.393075:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262c857 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855a4 expref: 30 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.393095:0:11314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262c857 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855a4 expref: 30 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.393119:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae362514400) 00010000:00010000:1.0:1788639134.393123:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788639134.393128:0:11314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fa200, rc 0) 00000100:00100000:1.0:1788639134.393410:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+30:10861:x1875523754052352:12345-192.168.206.18@tcp:101:bash.0 Request processed in 549us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639134.393418:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 101 00000100:00100000:3.0:1788639134.397222:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639134.397305:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754052480 00000100:00100000:1.0:1788639134.397334:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754052480 00000100:00100000:1.0:1788639134.397434:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 41 00000100:00100000:1.0:1788639134.397446:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243150a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+6:10861:x1875523754052480:12345-192.168.206.18@tcp:101:bash.0 00010000:00010000:1.0:1788639134.397469:0:8829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639134.397496:0:8829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff0a6b68/0x25c454990262c85e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e855ab expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788639134.397527:0:8829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9c779c, atime: 0x6a9c779b, ctime: 0x6a9c779c, blocks: 0x8 00010000:00010000:1.0:1788639134.397554:0:8829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=393s v=(0 0) 00010000:00010000:1.0:1788639134.397560:0:8829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639134.397570:0:8829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff0a6b68/0x25c454990262c85e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855ab expref: 7 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.397598:0:8829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff0a6b68/0x25c454990262c85e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855ab expref: 7 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.397636:0:8829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fae00, rc 0) 00000100:00080000:2.0:1788639134.397743:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788639134.398163:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243150a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+7:10861:x1875523754052480:12345-192.168.206.18@tcp:101:bash.0 Request processed in 716us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639134.398172:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 41 00000100:00100000:3.0:1788639134.400934:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639134.401179:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754052608 00000100:00100000:1.0:1788639134.401192:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754052608 00002000:00010000:1.0:1788639134.401308:0:8435:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:1.0:1788639134.401314:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae243150380 with x1875523754052608 ext(0->18446744073709551615) 00002000:00010000:1.0:1788639134.401328:0:8435:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ae243150380. 00000100:00100000:1.0:1788639134.401411:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 1 00000100:00100000:1.0:1788639134.401423:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+7:2408:x1875523754052608:12345-192.168.206.18@tcp:10:bash.0 00002000:00010000:1.0:1788639134.401783:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788639134.401788:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1788639132 -> 1788639135 00002000:00010000:1.0:1788639134.401790:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1788639131 -> 1788639131 00002000:00010000:1.0:1788639134.401792:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788639132 -> 1788639135 00002000:00010000:1.0:1788639134.401795:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1788639134.401876:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+8:2408:x1875523754052608:12345-192.168.206.18@tcp:10:bash.0 Request processed in 444us (949us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788639134.401883:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 1 00002000:00010000:1.0:1788639134.401887:0:8435:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:1.0:1788639134.401889:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae243150380 with x1875523754052608 ext(0->18446744073709551615) 00002000:00010000:1.0:1788639134.401895:0:8435:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ae243150380. 00000100:00100000:0.0:1788639134.471478:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639134.471591:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754052736 00000100:00100000:1.0:1788639134.471604:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754052736 00000100:00100000:1.0:1788639134.471708:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 102 00000100:00100000:1.0:1788639134.471720:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243935180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+30:11356:x1875523754052736:12345-192.168.206.18@tcp:34:lfs.0 00010000:00010000:1.0:1788639134.471817:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c865 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.471839:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c865 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.471864:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c865 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.471883:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c86c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.471890:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c86c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.471912:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c86c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.471997:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c873 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.472008:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c873 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.472015:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c873 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788639134.472069:0:10169:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c873 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.472082:0:10169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c865 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.472089:0:10169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c865 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.472097:0:10169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c865 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.472103:0:10169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fac00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639134.472108:0:10169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c865 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.472116:0:10169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c865 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.472129:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ae242358d00) 00010000:00010000:1.0:1788639134.472138:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639134.472144:0:10169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c865 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.472151:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c865 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.472167:0:10169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c86c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.472173:0:10169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c86c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.472179:0:10169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c86c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.472185:0:10169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fa600 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639134.472188:0:10169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c86c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.472194:0:10169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c86c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.472202:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ae362514700) 00010000:00010000:1.0:1788639134.472314:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639134.472318:0:10169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c86c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.472324:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c86c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.472340:0:10169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c873 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.472352:0:10169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c873 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.472368:0:10169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c873 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.472373:0:10169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fa000 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639134.472376:0:10169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c873 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.472382:0:10169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c873 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.472390:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae362514400) 00010000:00010000:1.0:1788639134.472392:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639134.472395:0:10169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c873 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.472401:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c873 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639134.472494:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243935180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+30:11356:x1875523754052736:12345-192.168.206.18@tcp:34:lfs.0 Request processed in 774us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639134.472503:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 102 00000100:00100000:2.0:1788639134.512071:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639134.512181:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754052992 00000100:00100000:1.0:1788639134.512194:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754052992 00000100:00100000:1.0:1788639134.512277:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 103 00000100:00100000:1.0:1788639134.512291:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36e14bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+30:11359:x1875523754052992:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:1.0:1788639134.512318:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639134.512372:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c87a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e855b2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.512473:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c881 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.512491:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c881 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.512505:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c881 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.512523:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c888 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.512530:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c888 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.512536:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c888 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.512712:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c88f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.512723:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c88f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.512730:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c88f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788639134.512742:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788639134.512843:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c881 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.512879:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c881 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.512886:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c881 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.512893:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fa600 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639134.512898:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c881 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.512907:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c881 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.512921:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ae242358d00) 00010000:00010000:1.0:1788639134.512924:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639134.512930:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c881 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.512937:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c881 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.512952:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c888 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.512959:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c888 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.512965:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c888 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.512971:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fac00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639134.512980:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c888 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.512986:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c888 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.512994:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ae362514700) 00010000:00010000:1.0:1788639134.512997:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639134.513000:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c888 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.513006:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c888 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.513053:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262c87a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855b2 expref: 33 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.513066:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c88f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855b2 expref: 32 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.513073:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae362514400) 00010000:00010000:1.0:1788639134.513076:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788639134.513078:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fbe00, rc 0) 00000100:00100000:1.0:1788639134.513142:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36e14bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+32:11359:x1875523754052992:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 854us (1089us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1788639134.513150:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 103 00000100:00100000:0.0:1788639134.516497:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639134.516585:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754053120 00000100:00100000:1.0:1788639134.516597:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754053120 00000100:00100000:1.0:1788639134.516705:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 104 00000100:00100000:1.0:1788639134.516718:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243936a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+32:11359:x1875523754053120:12345-192.168.206.18@tcp:54:lfs.0 00010000:00010000:1.0:1788639134.516825:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c89d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.516846:0:11314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae341480600/0x25c454990262c834 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85596 expref: 32 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.517215:0:11314:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c89d lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.517264:0:11314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae341480600/0x25c454990262c834 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85596 expref: 32 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.517281:0:11314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae341480600/0x25c454990262c834 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85596 expref: 32 pid: 11314 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639134.517299:0:11314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242ed7800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11314:1875523773006208:192.168.206.18@tcp:104: 00000100:00100000:1.0:1788639134.517460:0:11314:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2420b3900 going to sleep for 11 seconds 00000100:00100000:0.0:1788639134.520317:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639134.520835:0:11314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242ed7800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11314:1875523773006208:192.168.206.18@tcp:104: 00010000:00010000:1.0:1788639134.520883:0:11314:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c89d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639134.520983:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754053376 00000100:00100000:2.0:1788639134.520993:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754053376 00000100:00100000:2.0:1788639134.521050:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 22 00000100:00100000:2.0:1788639134.521061:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243936300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+33:6175:x1875523754053376:12345-192.168.206.18@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788639134.521440:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243936300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+34:6175:x1875523754053376:12345-192.168.206.18@tcp:35:ldlm_bl.0 Request processed in 379us (1134us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1788639134.521449:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 22 00000100:00100000:2.0:1788639134.523858:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639134.523948:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754053504 00000100:00100000:3.0:1788639134.523959:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754053504 00010000:00010000:3.0:1788639134.524003:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae341480600/0x25c454990262c834 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85596 expref: 34 pid: 11314 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639134.524047:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 66 00000100:00100000:3.0:1788639134.524060:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f82b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+34:2407:x1875523754053504:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788639134.524077:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639134.524085:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae341480600/0x25c454990262c834 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85596 expref: 34 pid: 11314 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.524101:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae341480600/0x25c454990262c834 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85596 expref: 34 pid: 11314 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.524129:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae341480600/0x25c454990262c834 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85596 expref: 34 pid: 11314 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.524150:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae362514400) 00010000:00010000:3.0:1788639134.524157:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c89d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.524182:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c89d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.524191:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c89d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.524246:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639134.524460:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f82b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+33:2407:x1875523754053504:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 390us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639134.524474:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 66 00010000:00010000:2.0:1788639134.524694:0:11314:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c89d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.524705:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c89d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.524748:0:11314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c89d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.524755:0:11314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c89d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.524763:0:11314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c89d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.524779:0:11314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fb400 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639134.524783:0:11314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c89d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.524791:0:11314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c89d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.524808:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae362514400) 00010000:00010000:2.0:1788639134.524810:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788639134.524815:0:11314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c89d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.524821:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c89d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639134.524906:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243936a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+32:11359:x1875523754053120:12345-192.168.206.18@tcp:54:lfs.0 Request processed in 8191us (8423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639134.524933:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 104 00000100:00100000:3.0:1788639134.526759:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639134.526878:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754053760 00000100:00100000:2.0:1788639134.526890:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754053760 00000100:00100000:2.0:1788639134.526958:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 23 00000100:00100000:2.0:1788639134.526968:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243152d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+32:11359:x1875523754053760:12345-192.168.206.18@tcp:35:lfs.0 00000100:00100000:2.0:1788639134.527188:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243152d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+33:11359:x1875523754053760:12345-192.168.206.18@tcp:35:lfs.0 Request processed in 221us (440us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1788639134.527196:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 23 00000100:00100000:0.0:1788639134.580917:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639134.581139:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754054016 00000100:00100000:2.0:1788639134.581152:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754054016 00000100:00100000:2.0:1788639134.581290:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 105 00000100:00100000:2.0:1788639134.581303:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243934e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+33:11370:x1875523754054016:12345-192.168.206.18@tcp:101:cat.0 00010000:00010000:2.0:1788639134.581335:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639134.581377:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c8a4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e855b9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.581471:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262c8ab lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.581491:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262c8ab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.581505:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262c8ab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.581525:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c8b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.581555:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c8b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.581562:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c8b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.581761:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262c8b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.581772:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262c8b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.581780:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262c8b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788639134.581791:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:2.0:1788639134.581883:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262c8ab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.581891:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262c8ab lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.581898:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262c8ab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.581904:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78aa00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639134.581909:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262c8ab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.581917:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262c8ab lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.581940:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ae242358d00) 00010000:00010000:2.0:1788639134.581943:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639134.581948:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262c8ab lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.581955:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262c8ab lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.581974:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c8b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.581980:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c8b2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.581985:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c8b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.581990:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78a000 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639134.581993:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c8b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.581999:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c8b2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.582006:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ae242358c00) 00010000:00010000:2.0:1788639134.582008:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639134.582011:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c8b2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.582017:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c8b2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.582071:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c8a4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855b9 expref: 36 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.582094:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262c8b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855b9 expref: 35 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.582101:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae362514400) 00010000:00010000:2.0:1788639134.582103:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788639134.582106:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78b000, rc 0) 00000100:00100000:2.0:1788639134.582185:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243934e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+35:11370:x1875523754054016:12345-192.168.206.18@tcp:101:cat.0 Request processed in 885us (1281us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1788639134.582193:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 105 00000100:00100000:3.0:1788639134.587812:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639134.587958:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754054272 00000100:00100000:2.0:1788639134.587971:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754054272 00000100:00100000:2.0:1788639134.588042:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 24 00000100:00100000:2.0:1788639134.588052:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243153800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+35:11370:x1875523754054272:12345-192.168.206.18@tcp:35:cat.0 00000100:00100000:2.0:1788639134.588498:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243153800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+36:11370:x1875523754054272:12345-192.168.206.18@tcp:35:cat.0 Request processed in 445us (698us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1788639134.588507:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 24 00000100:00100000:3.0:1788639134.603144:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639134.603265:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754054528 00000100:00100000:2.0:1788639134.603281:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754054528 00000100:00100000:2.0:1788639134.603414:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 106 00000100:00100000:2.0:1788639134.603424:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+36:11371:x1875523754054528:12345-192.168.206.18@tcp:36:rm.0 00010000:00010000:2.0:1788639134.603503:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1788639134.603536:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262c857 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855a4 expref: 36 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.603582:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262c8b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855b9 expref: 35 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.603606:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c88f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855b2 expref: 34 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.603695:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262c849 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8559d expref: 33 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.603707:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae362514400) 00010000:00010000:2.0:1788639134.603713:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788639134.603743:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c8c7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.603758:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c8c7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.603768:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c8c7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.603783:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c8ce lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.603790:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c8ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.603797:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c8ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.604102:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262c8d5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.604112:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262c8d5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.604119:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262c8d5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788639134.604488:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1788639134.604502:0:6518:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 393398884221ns, next at 394398881041ns, rc = 0 00010000:00010000:2.0:1788639134.604560:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262c8dc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.604570:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262c8dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.604579:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262c8dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.604587:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262c8dc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.604593:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262c8dc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.604600:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262c8dc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.604673:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788639134.604699:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262c8d5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.604716:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262c8d5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.604723:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262c8d5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.604729:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78aa00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639134.604734:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262c8d5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.604745:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262c8d5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.604759:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae362514400) 00010000:00010000:2.0:1788639134.604763:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788639134.604768:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262c8d5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.604774:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262c8d5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.604797:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c8c7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.604804:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c8c7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.604810:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c8c7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.604815:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78b600 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639134.604825:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c8c7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.604832:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c8c7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.604839:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ae242358d00) 00010000:00010000:2.0:1788639134.604842:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639134.604845:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c8c7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.604852:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c8c7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.604983:0:9520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788639134.604992:0:9520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262c8dc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.604998:0:9520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78b200 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:1.0:1788639134.605002:0:9520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262c8dc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.605021:0:9520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262c8dc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.605031:0:9520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae362514400) 00010000:00010000:1.0:1788639134.605033:0:9520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788639134.605037:0:9520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262c8dc lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.605043:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262c8dc lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.607695:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639134.607706:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639134.607710:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:2.0:1788639134.607827:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aa4bf99a reply state 0000000085cc85e7 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c8ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.608749:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c8ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.608769:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ae242358c00) 00010000:00010000:2.0:1788639134.608772:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788639134.608777:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788639134.608889:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+34:11371:x1875523754054528:12345-192.168.206.18@tcp:36:rm.0 Request processed in 5460us (5751us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1788639134.608899:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 106 00000100:00100000:0.0:1788639134.642132:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639134.642279:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754054784 00000100:00100000:2.0:1788639134.642370:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754054784 00000100:00100000:2.0:1788639134.642448:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 107 00000100:00100000:2.0:1788639134.642460:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243935f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+34:11377:x1875523754054784:12345-192.168.206.18@tcp:101:bash.0 00010000:00010000:2.0:1788639134.642491:0:11314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639134.642534:0:11314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c8e3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e855c0 expref: -99 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.643100:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c8ea lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.643120:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c8ea lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.643135:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c8ea lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.643148:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b600/0x25c454990262c8f1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.643155:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b600/0x25c454990262c8f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.643162:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b600/0x25c454990262c8f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788639134.644226:0:11314:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:3.0:1788639134.644550:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a200/0x25c454990262c8f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.644565:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a200/0x25c454990262c8f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.644576:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a200/0x25c454990262c8f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.644654:0:11314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c8ea lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.644663:0:11314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c8ea lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.644671:0:11314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c8ea lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.644677:0:11314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae38217b000 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639134.644683:0:11314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c8ea lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.644691:0:11314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c8ea lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.644707:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ae242358d00) 00010000:00010000:3.0:1788639134.644710:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639134.644716:0:11314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c8ea lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.644739:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c8ea lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788639134.644755:0:11314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cabaa35f reply state 00000000c444e31d transno 4294967379 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b600/0x25c454990262c8f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.644770:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b600/0x25c454990262c8f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.644776:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ae242358c00) 00010000:00010000:3.0:1788639134.644779:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788639134.644783:0:11314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788639134.644821:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262c8e3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855c0 expref: 37 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.645051:0:11314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a200/0x25c454990262c8f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855c0 expref: 36 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.645062:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ae242381700) 00010000:00010000:3.0:1788639134.645065:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788639134.645068:0:11314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae38217a200, rc 0) 00000100:00100000:3.0:1788639134.645151:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243935f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+37:11377:x1875523754054784:12345-192.168.206.18@tcp:101:bash.0 Request processed in 2693us (3032us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1788639134.645160:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 107 00000100:00100000:2.0:1788639134.650098:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639134.650266:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754054912 00000100:00100000:0.0:1788639134.650277:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754054912 00000100:00100000:0.0:1788639134.650474:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 42 00000100:00100000:0.0:1788639134.650486:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243875180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+7:2406:x1875523754054912:12345-192.168.206.18@tcp:101:bash.0 00010000:00010000:0.0:1788639134.650507:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639134.650534:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ec3eeb2/0x25c454990262c906 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e855c7 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788639134.650580:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788639134.650605:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=393s v=(0 0) 00010000:00010000:0.0:1788639134.650610:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788639134.650642:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ec3eeb2/0x25c454990262c906 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855c7 expref: 8 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.650667:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002ec3eeb2/0x25c454990262c906 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855c7 expref: 8 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.650684:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375ef4c00, rc 0) 00000100:00100000:0.0:1788639134.650752:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243875180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+8:2406:x1875523754054912:12345-192.168.206.18@tcp:101:bash.0 Request processed in 269us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639134.650760:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 42 00000100:00080000:2.0:1788639134.651430:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788639134.653462:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639134.653573:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754055040 00000100:00100000:1.0:1788639134.653585:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754055040 00000100:00100000:1.0:1788639134.653676:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 43 00000100:00100000:1.0:1788639134.653687:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243935500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+8:11377:x1875523754055040:12345-192.168.206.18@tcp:101:bash.0 00010000:00010000:1.0:1788639134.653709:0:8829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639134.653729:0:8829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013d414da/0x25c454990262c90d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e855ce expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.653764:0:8829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002ec3eeb2/0x25c454990262c906 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855c7 expref: 9 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.653773:0:8829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639134.653778:0:8829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639134.653784:0:8829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013d414da/0x25c454990262c90d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855ce expref: 9 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.653837:0:8829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002ec3eeb2/0x25c454990262c906 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855c7 expref: 9 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.653852:0:8829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002ec3eeb2/0x25c454990262c906 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855c7 expref: 9 pid: 8431 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639134.653878:0:8829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242ed7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8829:1875523773006336:192.168.206.18@tcp:104: 00000100:00100000:1.0:1788639134.654001:0:8829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2420b3900 going to sleep for 11 seconds 00000100:00100000:3.0:1788639134.659896:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639134.660039:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754055168 00000100:00100000:2.0:1788639134.660052:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754055168 00010000:00010000:2.0:1788639134.660101:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002ec3eeb2/0x25c454990262c906 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855c7 expref: 10 pid: 8431 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639134.660153:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 67 00000100:00100000:2.0:1788639134.660165:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+10:2408:x1875523754055168:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788639134.660184:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788639134.660223:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002ec3eeb2/0x25c454990262c906 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855c7 expref: 10 pid: 8431 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.660241:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002ec3eeb2/0x25c454990262c906 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855c7 expref: 10 pid: 8431 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.660275:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788639134.660280:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788639134.660291:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000013d414da/0x25c454990262c90d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855ce expref: 10 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.660303:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013d414da/0x25c454990262c90d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855ce expref: 10 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.660383:0:6501:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000013d414da/0x25c454990262c90d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855ce expref: 10 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639134.660401:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243876a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6501:1875523773006464:192.168.206.18@tcp:105: 00000100:00100000:2.0:1788639134.660498:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2431a4900 going to sleep for 11 seconds 00010000:00010000:1.0:1788639134.661680:0:8829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ec3eeb2/0x25c454990262c906 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855c7 expref: 10 pid: 8431 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639134.661703:0:8829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242ed7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8829:1875523773006336:192.168.206.18@tcp:104: 00010000:00010000:1.0:1788639134.661734:0:8829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000013d414da/0x25c454990262c90d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855ce expref: 9 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.661749:0:8829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fa000, rc 0) 00000100:00100000:1.0:1788639134.661812:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243935500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+9:11377:x1875523754055040:12345-192.168.206.18@tcp:101:bash.0 Request processed in 8127us (8363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639134.661821:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 43 00000100:00100000:2.0:1788639134.664885:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243876a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6501:1875523773006464:192.168.206.18@tcp:105: 00010000:00010000:2.0:1788639134.664922:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788639134.664993:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+8:2408:x1875523754055168:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 4830us (5111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639134.665006:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 67 00000100:00100000:2.0:1788639134.667852:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639134.668010:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754055424 00000100:00100000:0.0:1788639134.668024:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754055424 00000100:00100000:0.0:1788639134.668093:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 25 00000100:00100000:0.0:1788639134.668106:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+37:11377:x1875523754055424:12345-192.168.206.18@tcp:35:bash.0 00000100:00100000:0.0:1788639134.668491:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+38:11377:x1875523754055424:12345-192.168.206.18@tcp:35:bash.0 Request processed in 387us (650us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1788639134.668500:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 25 00000100:00100000:0.0:1788639134.691949:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639134.692001:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639134.692037:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639134.692098:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639134.692112:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754056064 00000100:00100000:1.0:1788639134.692126:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754056064 00000100:00100000:0.0:1788639134.692132:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639134.692159:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754055680 00000100:00100000:0.0:1788639134.692164:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754055680 00000100:00100000:3.0:1788639134.692290:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754055808 00000100:00100000:3.0:1788639134.692296:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754055808 00000100:00100000:0.0:1788639134.692346:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754055936 00000100:00100000:0.0:1788639134.692350:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754055936 00000100:00100000:1.0:1788639134.692385:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 271 00000100:00100000:2.0:1788639134.692427:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754055552 00000100:00100000:2.0:1788639134.692432:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754055552 00000100:00100000:2.0:1788639134.692466:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 378 00000100:00100000:2.0:1788639134.692475:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+13:2407:x1875523754055552:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:1.0:1788639134.692519:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2407:x1875523754055680:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639134.692565:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+13:2407:x1875523754055552:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 90us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639134.692575:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 378 00000100:00100000:1.0:1788639134.692597:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2407:x1875523754055680:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 200us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639134.694783:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 113 00000100:00100000:3.0:1788639134.694822:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243937800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+8:2407:x1875523754055808:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639134.694908:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243937800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+8:2407:x1875523754055808:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 95us (2906us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639134.694916:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 113 00000100:00100000:0.0:1788639134.698581:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 272 00000100:00100000:0.0:1788639134.698633:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243936680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2407:x1875523754056064:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639134.698740:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243936680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2407:x1875523754056064:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 142us (6701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639134.698750:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 272 00000100:00100000:0.0:1788639134.698790:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 273 00000100:00100000:0.0:1788639134.698800:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2407:x1875523754055936:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639134.698828:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2407:x1875523754055936:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 31us (6697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639134.698835:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 273 00000100:00100000:1.0:1788639134.699373:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 271 00000100:00080000:1.0:1788639134.699430:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788639134.699436:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788639134.787413:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639134.787495:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754056192 00000100:00100000:0.0:1788639134.787509:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754056192 00000100:00100000:0.0:1788639134.787744:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 108 00000100:00100000:0.0:1788639134.787756:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+38:11393:x1875523754056192:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:0.0:1788639134.787787:0:10169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639134.787816:0:10169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4400/0x25c454990262c914 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e855d5 expref: -99 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.787919:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4c00/0x25c454990262c91b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.787958:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4c00/0x25c454990262c91b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.787972:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4c00/0x25c454990262c91b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788639134.788031:0:10169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788639134.788035:0:10169:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788639134.788057:0:10169:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4c00/0x25c454990262c91b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.788086:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4400/0x25c454990262c914 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855d5 expref: 40 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.788107:0:10169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4c00/0x25c454990262c91b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855d5 expref: 39 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.788117:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ae242358d00) 00010000:00010000:0.0:1788639134.788120:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788639134.788124:0:10169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375ef4c00, rc 0) 00000100:00100000:0.0:1788639134.788197:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+39:11393:x1875523754056192:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 443us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639134.788214:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 108 00000100:00100000:0.0:1788639134.794741:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639134.795105:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754056448 00000100:00100000:1.0:1788639134.795119:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754056448 00000100:00100000:1.0:1788639134.795250:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 109 00000100:00100000:1.0:1788639134.795263:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae343062d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+39:11393:x1875523754056448:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:1.0:1788639134.795290:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639134.795333:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c922 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e855dc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.795490:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c929 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.795508:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c929 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.795522:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c929 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788639134.795534:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788639134.795717:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262c922 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855dc expref: 42 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.795738:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c929 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855dc expref: 41 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.795897:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ae242381700) 00010000:00010000:1.0:1788639134.795900:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788639134.795905:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fa600, rc 0) 00000100:00100000:1.0:1788639134.795982:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae343062d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+41:11393:x1875523754056448:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 722us (1255us total) trans 4294967381 rc 0/0 00000100:00100000:1.0:1788639134.795988:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 109 00000100:00100000:3.0:1788639134.798447:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639134.798607:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639134.798796:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754056832 00000100:00100000:0.0:1788639134.798808:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754056832 00000100:00100000:0.0:1788639134.798879:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 110 00000100:00100000:0.0:1788639134.798892:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+41:11393:x1875523754056832:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:0.0:1788639134.798936:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639134.798962:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4400/0x25c454990262c937 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e855e3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.799091:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4e00/0x25c454990262c93e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.799110:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4e00/0x25c454990262c93e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.799124:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4e00/0x25c454990262c93e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788639134.799139:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00000100:00100000:2.0:1788639134.799289:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754056576 00000100:00100000:2.0:1788639134.799295:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754056576 00000100:00100000:2.0:1788639134.799338:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 7 00000100:00100000:2.0:1788639134.799346:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+45:2408:x1875523754056576:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788639134.799372:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788639134.800026:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4400/0x25c454990262c937 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855e3 expref: 45 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.800039:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262c929 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855dc expref: 45 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.800053:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4e00/0x25c454990262c93e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855e3 expref: 43 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.800058:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ae242381700) 00010000:00010000:0.0:1788639134.800068:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ae242381700) 00010000:00010000:2.0:1788639134.800069:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788639134.800074:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788639134.800077:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375ef4e00, rc 0) 00000100:00100000:2.0:1788639134.800156:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+43:2408:x1875523754056576:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 805us (1713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639134.800156:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+43:11393:x1875523754056832:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 1262us (1543us total) trans 4294967382 rc 0/0 00000100:00100000:2.0:1788639134.800176:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 7 00000100:00100000:0.0:1788639134.800176:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 110 00000100:00100000:2.0:1788639134.804775:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639134.808792:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754056960 00000100:00100000:0.0:1788639134.808815:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754056960 00000100:00100000:0.0:1788639134.808919:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 44 00000100:00100000:0.0:1788639134.808951:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243874e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+8:2405:x1875523754056960:12345-192.168.206.18@tcp:1:lfs.0 00010000:00010000:0.0:1788639134.809014:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fee87d85/0x25c454990262c94c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.809040:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000013d414da/0x25c454990262c90d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855ce expref: 8 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.809049:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788639134.809054:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788639134.809060:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fee87d85/0x25c454990262c94c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.809107:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000013d414da/0x25c454990262c90d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855ce expref: 8 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.809123:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000013d414da/0x25c454990262c90d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855ce expref: 8 pid: 8829 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639134.809142:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae343063100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8432:1875523773006592:192.168.206.18@tcp:104: 00000100:00100000:0.0:1788639134.809300:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae348a869c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788639134.814690:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639134.815144:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae343063100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8432:1875523773006592:192.168.206.18@tcp:104: 00010000:00010000:0.0:1788639134.815184:0:8432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fee87d85/0x25c454990262c94c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639134.815432:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754057088 00000100:00100000:3.0:1788639134.815442:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754057088 00002000:00100000:3.0:1788639134.815506:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9ae242ed7800 x1875523754057088/t0(0) o4->5deb128c-4fe3-4f51-b21e-f30846e08445@192.168.206.18@tcp:355/0 lens 504/0 e 0 to 0 dl 1788639145 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788639134.815517:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae242ed7800 with x1875523754057088 ext(0->8) 00010000:00010000:3.0:1788639134.815525:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000013d414da/0x25c454990262c90d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855ce expref: 9 pid: 8829 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.815541:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000013d414da/0x25c454990262c90d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855ce expref: 9 pid: 8829 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788639134.815548:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ae242ed7800 00000100:00100000:3.0:1788639134.815583:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 1 00000100:00100000:3.0:1788639134.815595:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+9:2407:x1875523754057088:12345-192.168.206.18@tcp:4:lfs.0 00000100:00100000:3.0:1788639134.816804:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+11:2407:x1875523754057088:12345-192.168.206.18@tcp:4:lfs.0 Request processed in 1199us (2115us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788639134.816819:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 1 00002000:00100000:3.0:1788639134.816833:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9ae242ed7800 x1875523754057088/t4294967303(0) o4->5deb128c-4fe3-4f51-b21e-f30846e08445@192.168.206.18@tcp:355/0 lens 504/448 e 0 to 0 dl 1788639145 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788639134.816864:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae242ed7800 with x1875523754057088 ext(0->8) 00010000:00010000:3.0:1788639134.816875:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000013d414da/0x25c454990262c90d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855ce expref: 11 pid: 8829 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.816894:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000013d414da/0x25c454990262c90d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855ce expref: 11 pid: 8829 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788639134.816902:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ae242ed7800 00000100:00100000:3.0:1788639134.823773:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639134.823999:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754057216 00000100:00100000:2.0:1788639134.824016:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754057216 00010000:00010000:2.0:1788639134.824076:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000013d414da/0x25c454990262c90d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855ce expref: 11 pid: 8829 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639134.824140:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 68 00000100:00100000:2.0:1788639134.824152:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b60cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+11:2408:x1875523754057216:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788639134.824172:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788639134.824196:0:6501:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788639134.824200:0:6501:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788639135 00002000:00010000:2.0:1788639134.824202:0:6501:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788639135 00002000:00010000:2.0:1788639134.824205:0:6501:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788639135 00002000:00010000:2.0:1788639134.824207:0:6501:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788639134.824214:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000013d414da/0x25c454990262c90d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855ce expref: 11 pid: 8829 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.824230:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000013d414da/0x25c454990262c90d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855ce expref: 11 pid: 8829 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.824283:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013d414da/0x25c454990262c90d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855ce expref: 11 pid: 8829 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.824314:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788639134.824319:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788639134.824326:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fee87d85/0x25c454990262c94c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.824337:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fee87d85/0x25c454990262c94c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639134.824392:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788639134.824443:0:8432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fee87d85/0x25c454990262c94c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.824462:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fee87d85/0x25c454990262c94c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639134.824473:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b60cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+10:2408:x1875523754057216:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 319us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639134.824486:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 68 00010000:00010000:3.0:1788639134.824503:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fee87d85/0x25c454990262c94c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.824517:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fee87d85/0x25c454990262c94c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.824528:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fee87d85/0x25c454990262c94c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.824536:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef5c00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:3.0:1788639134.824555:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fee87d85/0x25c454990262c94c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.824566:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fee87d85/0x25c454990262c94c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.824588:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fee87d85/0x25c454990262c94c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.824596:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fee87d85/0x25c454990262c94c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639134.824733:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243874e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+9:2405:x1875523754056960:12345-192.168.206.18@tcp:1:lfs.0 Request processed in 15783us (20121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639134.824742:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 44 00000100:00100000:2.0:1788639134.829518:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639134.829655:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754057472 00000100:00100000:0.0:1788639134.829665:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754057472 00000100:00100000:0.0:1788639134.829740:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 26 00000100:00100000:0.0:1788639134.829750:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ef1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+42:11393:x1875523754057472:12345-192.168.206.18@tcp:35:lfs.0 00000004:00010000:0.0:1788639134.829821:0:6519:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4e00/0x25c454990262c93e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855e3 expref: 42 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788639134.830034:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1788639134.830070:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:0.0:1788639134.831067:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00010000:00010000:0.0:1788639134.831304:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4400/0x25c454990262c953 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.831322:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a200/0x25c454990262c8f8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855c0 expref: 46 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.831331:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4400/0x25c454990262c953 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.831375:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a200/0x25c454990262c8f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855c0 expref: 46 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.831390:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a200/0x25c454990262c8f8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855c0 expref: 46 pid: 11314 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639134.831405:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae343063100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6519:1875523773006720:192.168.206.18@tcp:104: 00000100:00100000:0.0:1788639134.831526:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae34945e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788639134.839419:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639134.839842:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754057600 00000100:00100000:3.0:1788639134.839852:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754057600 00010000:00010000:3.0:1788639134.839900:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a200/0x25c454990262c8f8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855c0 expref: 47 pid: 11314 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639134.839934:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 69 00000100:00100000:3.0:1788639134.839945:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243875f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+47:2407:x1875523754057600:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788639134.839959:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639134.839965:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a200/0x25c454990262c8f8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855c0 expref: 47 pid: 11314 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.839979:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a200/0x25c454990262c8f8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855c0 expref: 47 pid: 11314 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.840016:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ae242381700) 00010000:00010000:3.0:1788639134.840022:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4400/0x25c454990262c953 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.840030:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4400/0x25c454990262c953 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.840037:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4400/0x25c454990262c953 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639134.840055:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639134.840111:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243875f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+47:2407:x1875523754057600:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 167us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639134.840118:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 69 00010000:00010000:0.0:1788639134.842393:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a200/0x25c454990262c8f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855c0 expref: 46 pid: 11314 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639134.842419:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae343063100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6519:1875523773006720:192.168.206.18@tcp:104: 00010000:00010000:0.0:1788639134.842458:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4400/0x25c454990262c953 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.842469:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4400/0x25c454990262c953 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.842474:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4400/0x25c454990262c953 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788639134.842577:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000001:00080000:0.0:1788639134.844073:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:0.0:1788639134.844926:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae343063100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6519:1875523773006848:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788639134.844987:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639134.845079:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae348a869c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788639134.845706:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773006848 00000100:00100000:3.0:1788639134.845714:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773006848 00000100:00100000:3.0:1788639134.845780:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788639134.845789:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae343061180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6519:x1875523773006848:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:1.0:1788639134.846975:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788639134.847268:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae343063100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6519:1875523773006848:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788639134.847342:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae343061180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6519:x1875523773006848:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 1552us (2353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639134.847368:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000001:00080000:1.0:1788639134.847541:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00000100:00100000:1.0:1788639134.847639:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242ed6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6519:1875523773006976:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788639134.847699:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639134.847728:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae34945e000 going to sleep for 11 seconds 00000100:00100000:3.0:1788639134.847904:0:12414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773006976 00000100:00100000:3.0:1788639134.847911:0:12414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773006976 00000100:00100000:3.0:1788639134.847954:0:12414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788639134.847963:0:12414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f7c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6519:x1875523773006976:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788639134.848087:0:12414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f7c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6519:x1875523773006976:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 125us (387us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788639134.848115:0:12414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788639134.848259:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242ed6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6519:1875523773006976:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788639134.848303:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:1.0:1788639134.848344:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4400/0x25c454990262c953 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.848354:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4400/0x25c454990262c953 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.848373:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4400/0x25c454990262c953 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.848378:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef4400 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639134.848384:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4400/0x25c454990262c953 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.848404:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4400/0x25c454990262c953 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.848421:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ae242381700) 00010000:00010000:1.0:1788639134.848424:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788639134.848430:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4400/0x25c454990262c953 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.848437:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4400/0x25c454990262c953 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788639134.848536:0:6519:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788639134.848600:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1788639134.848612:0:6519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 393642995424ns, next at 394642993017ns, rc = 0 00000001:00080000:1.0:1788639134.848667:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967390 00010000:00010000:1.0:1788639134.848974:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ae242381700) 00010000:00010000:1.0:1788639134.848978:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788639134.848986:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4e00/0x25c454990262c93e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855e3 expref: 50 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639134.849135:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ef1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+49:11393:x1875523754057472:12345-192.168.206.18@tcp:35:lfs.0 Request processed in 19385us (19624us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1788639134.849144:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 26 00000020:00080000:1.0:1788639134.849148:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788639134.856015:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639134.856115:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754057728 00000100:00100000:0.0:1788639134.856125:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754057728 00000100:00100000:0.0:1788639134.856223:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 111 00000100:00100000:0.0:1788639134.856235:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+49:11393:x1875523754057728:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:0.0:1788639134.856257:0:10169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639134.856278:0:10169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5200/0x25c454990262c95a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e855ea expref: -99 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.856335:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5200/0x25c454990262c95a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855ea expref: 50 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.856350:0:10169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5200/0x25c454990262c95a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855ea expref: 50 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.856401:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ae34ac63e00) 00010000:00010000:0.0:1788639134.856405:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788639134.856408:0:10169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375ef5200, rc 0) 00000100:00100000:0.0:1788639134.856465:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+50:11393:x1875523754057728:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 232us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639134.856472:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 111 00000100:00100000:2.0:1788639134.859492:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639134.859662:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754057984 00000100:00100000:0.0:1788639134.859672:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754057984 00000100:00100000:0.0:1788639134.859729:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 27 00000100:00100000:0.0:1788639134.859740:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+50:11393:x1875523754057984:12345-192.168.206.18@tcp:35:lfs.0 00000100:00100000:0.0:1788639134.859995:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+51:11393:x1875523754057984:12345-192.168.206.18@tcp:35:lfs.0 Request processed in 256us (511us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1788639134.860003:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 27 00000100:00100000:2.0:1788639134.950175:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639134.950275:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754058112 00000100:00100000:1.0:1788639134.950285:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754058112 00000100:00100000:1.0:1788639134.950348:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 112 00000100:00100000:1.0:1788639134.950370:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+51:11403:x1875523754058112:12345-192.168.206.18@tcp:34:lfs.0 00010000:00010000:1.0:1788639134.950467:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c961 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.950484:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c961 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.950496:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c961 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.950507:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262c968 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.950515:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262c968 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.950522:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262c968 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.950591:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c96f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.950599:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c96f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.950606:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c96f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788639134.950710:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c96f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.950723:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c961 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.950739:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c961 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.950746:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c961 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.950752:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fbe00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639134.950756:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c961 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.950763:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c961 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.950775:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ae242358d00) 00010000:00010000:1.0:1788639134.950778:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639134.950783:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c961 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.950789:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262c961 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.950804:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262c968 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.950810:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262c968 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.950815:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262c968 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.950820:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fa200 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639134.950830:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262c968 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.950837:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262c968 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.950845:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ae242358c00) 00010000:00010000:1.0:1788639134.950848:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639134.950851:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262c968 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.950857:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262c968 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.950878:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c96f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.950883:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c96f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.950889:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c96f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.950895:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fb400 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639134.950897:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c96f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.950903:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c96f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.950910:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ae34ac63e00) 00010000:00010000:1.0:1788639134.950912:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639134.950921:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c96f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639134.950926:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262c96f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639134.951013:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+51:11403:x1875523754058112:12345-192.168.206.18@tcp:34:lfs.0 Request processed in 655us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639134.951022:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 112 00000100:00100000:2.0:1788639134.995123:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639134.995411:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754058368 00000100:00100000:0.0:1788639134.995421:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754058368 00000100:00100000:0.0:1788639134.995489:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 113 00000100:00100000:0.0:1788639134.995498:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+51:11406:x1875523754058368:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:0.0:1788639134.995518:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639134.995540:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4800/0x25c454990262c976 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e855f1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.995612:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4200/0x25c454990262c97d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.995806:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4200/0x25c454990262c97d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.995833:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4200/0x25c454990262c97d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.999161:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5800/0x25c454990262c984 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.999183:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5800/0x25c454990262c984 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.999196:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5800/0x25c454990262c984 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.999314:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4600/0x25c454990262c98b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.999323:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4600/0x25c454990262c98b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.999331:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4600/0x25c454990262c98b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788639134.999343:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788639134.999430:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4200/0x25c454990262c97d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.999438:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4200/0x25c454990262c97d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.999446:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4200/0x25c454990262c97d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.999451:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef4200 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639134.999469:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4200/0x25c454990262c97d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.999478:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4200/0x25c454990262c97d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.999490:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ae242358d00) 00010000:00010000:0.0:1788639134.999493:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639134.999497:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4200/0x25c454990262c97d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.999504:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4200/0x25c454990262c97d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.999518:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5800/0x25c454990262c984 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.999525:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5800/0x25c454990262c984 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.999531:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5800/0x25c454990262c984 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.999537:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef5800 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639134.999540:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5800/0x25c454990262c984 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.999546:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5800/0x25c454990262c984 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.999553:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ae242358c00) 00010000:00010000:0.0:1788639134.999555:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639134.999564:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5800/0x25c454990262c984 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.999570:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5800/0x25c454990262c984 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.999646:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4800/0x25c454990262c976 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855f1 expref: 54 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.999662:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4600/0x25c454990262c98b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855f1 expref: 53 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639134.999669:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ae34ac63e00) 00010000:00010000:0.0:1788639134.999789:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788639134.999793:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375ef4600, rc 0) 00000100:00100000:0.0:1788639134.999859:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+53:11406:x1875523754058368:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 4361us (4744us total) trans 4294967393 rc 0/0 00000100:00100000:0.0:1788639134.999868:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 113 00000100:00100000:3.0:1788639135.005587:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639135.005716:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754058496 00000100:00100000:0.0:1788639135.005726:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754058496 00000100:00100000:0.0:1788639135.005781:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 114 00000100:00100000:0.0:1788639135.005791:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+53:11406:x1875523754058496:12345-192.168.206.18@tcp:54:lfs.0 00010000:00010000:0.0:1788639135.005848:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5800/0x25c454990262c999 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639135.005875:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5800/0x25c454990262c999 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639135.005888:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5800/0x25c454990262c999 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639135.005940:0:10169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5800/0x25c454990262c999 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639135.005949:0:10169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5800/0x25c454990262c999 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639135.005955:0:10169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5800/0x25c454990262c999 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639135.005962:0:10169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef5800 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639135.005966:0:10169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5800/0x25c454990262c999 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639135.005975:0:10169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5800/0x25c454990262c999 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639135.005987:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ae34ac63e00) 00010000:00010000:0.0:1788639135.005990:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788639135.005994:0:10169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5800/0x25c454990262c999 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639135.006001:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5800/0x25c454990262c999 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639135.006079:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+53:11406:x1875523754058496:12345-192.168.206.18@tcp:54:lfs.0 Request processed in 289us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639135.006087:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 114 00000100:00100000:3.0:1788639135.009698:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639135.009961:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754058752 00000100:00100000:0.0:1788639135.009970:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754058752 00000100:00100000:0.0:1788639135.010022:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 28 00000100:00100000:0.0:1788639135.010048:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+53:11406:x1875523754058752:12345-192.168.206.18@tcp:35:lfs.0 00000100:00100000:0.0:1788639135.010275:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+54:11406:x1875523754058752:12345-192.168.206.18@tcp:35:lfs.0 Request processed in 228us (583us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1788639135.010283:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 28 00000100:00100000:3.0:1788639135.110777:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639135.114569:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754059008 00000100:00100000:2.0:1788639135.114582:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754059008 00000100:00100000:2.0:1788639135.114713:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 115 00000100:00100000:2.0:1788639135.114723:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+54:11416:x1875523754059008:12345-192.168.206.18@tcp:101:bash.0 00010000:00010000:2.0:1788639135.114764:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639135.114768:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788639135.114792:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4c00/0x25c454990262c91b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855d5 expref: 54 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.114810:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ae242358d00) 00010000:00010000:2.0:1788639135.114815:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788639135.114830:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b800/0x25c454990262c9a0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e855f8 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.114930:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262c9a7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.114944:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4600/0x25c454990262c98b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855f1 expref: 54 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.114952:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262c9a7 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.114984:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4600/0x25c454990262c98b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855f1 expref: 54 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.114997:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4600/0x25c454990262c98b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855f1 expref: 54 pid: 6518 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639135.115011:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243877480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1875523773007104:192.168.206.18@tcp:104: 00000100:00100000:2.0:1788639135.115123:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2431a4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788639135.123519:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639135.123644:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754059136 00000100:00100000:0.0:1788639135.123652:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754059136 00010000:00010000:0.0:1788639135.123697:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4600/0x25c454990262c98b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855f1 expref: 55 pid: 6518 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639135.123732:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 70 00000100:00100000:0.0:1788639135.123741:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+55:2407:x1875523754059136:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788639135.123753:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788639135.123759:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4600/0x25c454990262c98b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855f1 expref: 55 pid: 6518 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639135.123772:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4600/0x25c454990262c98b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855f1 expref: 55 pid: 6518 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639135.123793:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ae34ac63e00) 00010000:00010000:0.0:1788639135.123798:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262c9a7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639135.123809:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262c9a7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639135.123817:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262c9a7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639135.123846:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788639135.123889:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+55:2407:x1875523754059136:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 149us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639135.123896:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 70 00010000:00010000:2.0:1788639135.124893:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4600/0x25c454990262c98b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855f1 expref: 54 pid: 6518 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639135.124926:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243877480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1875523773007104:192.168.206.18@tcp:104: 00010000:00010000:2.0:1788639135.124949:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262c9a7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.124959:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262c9a7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.124965:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262c9a7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788639135.124984:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788639135.125106:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b800/0x25c454990262c9a0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855f8 expref: 55 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.125129:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262c9a7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855f8 expref: 54 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.125138:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ae34ac63e00) 00010000:00010000:2.0:1788639135.125141:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788639135.125144:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78a200, rc 0) 00000100:00100000:2.0:1788639135.125184:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+54:11416:x1875523754059008:12345-192.168.206.18@tcp:101:bash.0 Request processed in 10462us (14419us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1788639135.125192:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 115 00000100:00100000:0.0:1788639135.128962:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639135.129047:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754059264 00000100:00100000:2.0:1788639135.129062:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754059264 00000100:00100000:2.0:1788639135.129142:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 116 00000100:00100000:2.0:1788639135.129152:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae343061f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+54:11416:x1875523754059264:12345-192.168.206.18@tcp:101:bash.0 00010000:00010000:2.0:1788639135.129189:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639135.129211:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b400/0x25c454990262c9b5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e855ff expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.129242:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262c9bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.129256:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262c9bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.129267:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262c9bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.129382:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b400/0x25c454990262c9b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855ff expref: 56 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.129411:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262c9bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855ff expref: 55 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.129420:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ae34ac63e00) 00010000:00010000:2.0:1788639135.129423:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788639135.129427:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78bc00, rc 0) 00000100:00100000:2.0:1788639135.129656:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae343061f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+55:11416:x1875523754059264:12345-192.168.206.18@tcp:101:bash.0 Request processed in 463us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639135.129665:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 116 00000100:00100000:1.0:1788639135.144481:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639135.146422:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754059520 00000100:00100000:2.0:1788639135.146439:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754059520 00000100:00100000:2.0:1788639135.146515:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 117 00000100:00100000:2.0:1788639135.146527:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243936300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+55:11416:x1875523754059520:12345-192.168.206.18@tcp:36:bash.0 00010000:00010000:2.0:1788639135.146805:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b800/0x25c454990262c9c3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.146824:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b800/0x25c454990262c9c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.146835:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b800/0x25c454990262c9c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788639135.146877:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967396 00000004:00010000:2.0:1788639135.146898:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a9e4c56 reply state 000000002c14c9c2 transno 4294967397 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b800/0x25c454990262c9c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.146912:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b800/0x25c454990262c9c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.146919:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ae34ac63e00) 00010000:00010000:2.0:1788639135.146923:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788639135.146926:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788639135.147011:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243936300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+58:11416:x1875523754059520:12345-192.168.206.18@tcp:36:bash.0 Request processed in 486us (2537us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1788639135.147019:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 117 00000020:00080000:2.0:1788639135.147024:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788639135.158563:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00010000:00010000:2.0:1788639135.158690:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639135.158770:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754059648 00000100:00100000:3.0:1788639135.158781:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754059648 00000100:00100000:3.0:1788639135.158840:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 118 00000100:00100000:3.0:1788639135.158851:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae343060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+58:11416:x1875523754059648:12345-192.168.206.18@tcp:101:bash.0 00010000:00010000:3.0:1788639135.158874:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639135.158893:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c9ca lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85606 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639135.158980:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c9d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639135.158994:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262c9a7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855f8 expref: 59 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639135.159005:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c9d1 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639135.159038:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262c9a7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855f8 expref: 59 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639135.159052:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262c9a7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855f8 expref: 59 pid: 6516 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639135.159099:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cf100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1875523773007232:192.168.206.18@tcp:104: 00000100:00100000:3.0:1788639135.159206:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36e182900 going to sleep for 11 seconds 00000100:00100000:0.0:1788639135.168310:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639135.168565:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754059776 00000100:00100000:1.0:1788639135.168576:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754059776 00010000:00010000:1.0:1788639135.168640:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262c9a7 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855f8 expref: 60 pid: 6516 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639135.168684:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 71 00000100:00100000:1.0:1788639135.168695:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae343061880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+60:2408:x1875523754059776:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788639135.168713:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788639135.168720:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262c9a7 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855f8 expref: 60 pid: 6516 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639135.168736:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262c9a7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855f8 expref: 60 pid: 6516 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639135.168762:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ae34ac63e00) 00010000:00010000:1.0:1788639135.168768:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c9d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639135.168779:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c9d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639135.168812:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c9d1 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639135.168836:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788639135.168907:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae343061880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+60:2408:x1875523754059776:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 214us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639135.168915:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 71 00010000:00010000:3.0:1788639135.169528:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262c9a7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855f8 expref: 59 pid: 6516 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639135.169550:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cf100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1875523773007232:192.168.206.18@tcp:104: 00010000:00010000:3.0:1788639135.169571:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c9d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639135.169922:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c9d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639135.169931:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c9d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788639135.169983:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788639135.169987:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788639135.170007:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c9d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639135.170039:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262c9ca lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85606 expref: 59 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639135.170058:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c9d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85606 expref: 58 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639135.170066:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ae34ac63e00) 00010000:00010000:0.0:1788639135.170068:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788639135.170071:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae38217b000, rc 0) 00000100:00100000:1.0:1788639135.178253:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae343060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+58:11416:x1875523754059648:12345-192.168.206.18@tcp:101:bash.0 Request processed in 19393us (19689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639135.178265:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 118 00000100:00100000:0.0:1788639135.189121:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639135.189229:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754060032 00000100:00100000:2.0:1788639135.189237:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754060032 00000100:00100000:2.0:1788639135.189289:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 29 00000100:00100000:2.0:1788639135.189298:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae343061500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+58:11416:x1875523754060032:12345-192.168.206.18@tcp:35:bash.0 00000100:00100000:2.0:1788639135.189507:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae343061500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+59:11416:x1875523754060032:12345-192.168.206.18@tcp:35:bash.0 Request processed in 208us (392us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1788639135.189524:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 29 00000100:00100000:2.0:1788639135.268822:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639135.269203:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754060160 00000100:00100000:0.0:1788639135.269213:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754060160 00000100:00100000:0.0:1788639135.269270:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 119 00000100:00100000:0.0:1788639135.269280:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+59:11422:x1875523754060160:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:0.0:1788639135.269303:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639135.269322:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4a00/0x25c454990262c9d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e8560d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639135.269393:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262c9df lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639135.269409:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262c9df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639135.269422:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262c9df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788639135.269465:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788639135.269470:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788639135.269488:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262c9df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639135.269510:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4a00/0x25c454990262c9d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8560d expref: 61 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639135.269529:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262c9df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8560d expref: 60 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639135.269538:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ae242358d00) 00010000:00010000:0.0:1788639135.269541:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788639135.269560:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375ef5a00, rc 0) 00000100:00100000:0.0:1788639135.269725:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+60:11422:x1875523754060160:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 438us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639135.269734:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 119 00000100:00100000:0.0:1788639135.277340:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639135.279485:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754060288 00000100:00100000:3.0:1788639135.279499:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754060288 00000100:00100000:2.0:1788639135.282449:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 120 00000100:00100000:2.0:1788639135.282474:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae343060380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+60:11422:x1875523754060288:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:2.0:1788639135.282496:0:11314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639135.282518:0:11314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262c9e6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85614 expref: -99 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.282589:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a400/0x25c454990262c9ed lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.282604:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a400/0x25c454990262c9ed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.282632:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a400/0x25c454990262c9ed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.282645:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ae00/0x25c454990262c9f4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.282653:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ae00/0x25c454990262c9f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.282661:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ae00/0x25c454990262c9f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.282726:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262c9fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.282736:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262c9fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.282759:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262c9fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788639135.282800:0:11314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788639135.282805:0:11314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788639135.282834:0:11314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262c9fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.282846:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262c9fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.282854:0:11314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a400/0x25c454990262c9ed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.282861:0:11314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a400/0x25c454990262c9ed lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.282867:0:11314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a400/0x25c454990262c9ed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.282873:0:11314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78a400 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639135.282877:0:11314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a400/0x25c454990262c9ed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.282884:0:11314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a400/0x25c454990262c9ed lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.282894:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ae242358d00) 00010000:00010000:2.0:1788639135.282897:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639135.282902:0:11314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a400/0x25c454990262c9ed lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.282919:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a400/0x25c454990262c9ed lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.282936:0:11314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ae00/0x25c454990262c9f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.282941:0:11314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ae00/0x25c454990262c9f4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.282947:0:11314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ae00/0x25c454990262c9f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.282952:0:11314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78ae00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639135.282955:0:11314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ae00/0x25c454990262c9f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.282961:0:11314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ae00/0x25c454990262c9f4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.282969:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ae242358c00) 00010000:00010000:2.0:1788639135.282971:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639135.282974:0:11314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ae00/0x25c454990262c9f4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.282980:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ae00/0x25c454990262c9f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.283005:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262c9e6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85614 expref: 62 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.283030:0:11314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262c9fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85614 expref: 61 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.283037:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ae34ac63e00) 00010000:00010000:2.0:1788639135.283040:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788639135.283042:0:11314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78b000, rc 0) 00000100:00100000:2.0:1788639135.283123:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae343060380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+61:11422:x1875523754060288:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 662us (5791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639135.283131:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 120 00000100:00100000:3.0:1788639135.287739:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639135.288137:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754060544 00000100:00100000:2.0:1788639135.288147:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754060544 00000100:00100000:2.0:1788639135.288219:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 121 00000100:00100000:2.0:1788639135.288229:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+61:11422:x1875523754060544:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:2.0:1788639135.288248:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639135.288266:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262ca02 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e8561b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.288404:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262ca09 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.288420:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c9d1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85606 expref: 62 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.288428:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262c9fb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85614 expref: 62 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.288448:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262ca09 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639135.288828:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639135.288901:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754060672 00000100:00100000:3.0:1788639135.288906:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754060672 00010000:00010000:3.0:1788639135.288930:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262c9fb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85614 expref: 63 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639135.288961:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 72 00000100:00100000:3.0:1788639135.288969:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae343063b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+63:2407:x1875523754060672:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788639135.288978:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639135.290890:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ae34ac63e00) 00010000:00010000:3.0:1788639135.290902:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262ca09 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639135.291080:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262ca09 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639135.291111:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639135.291255:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae343063b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+63:2407:x1875523754060672:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 2282us (2422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639135.291267:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 72 00010000:00010000:2.0:1788639135.292491:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262c9fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85614 expref: 62 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.292546:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c9d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85606 expref: 61 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.292561:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c9d1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85606 expref: 61 pid: 6516 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639135.292576:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243874380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1875523773007488:192.168.206.18@tcp:104: 00000100:00100000:2.0:1788639135.292699:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2431a4000 going to sleep for 11 seconds 00000100:00100000:2.0:1788639135.298440:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243874380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1875523773007488:192.168.206.18@tcp:104: 00010000:00010000:2.0:1788639135.298473:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262ca09 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639135.300278:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639135.300451:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754060800 00000100:00100000:0.0:1788639135.300460:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754060800 00010000:00010000:0.0:1788639135.300503:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c9d1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85606 expref: 62 pid: 6516 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639135.300583:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 73 00000100:00100000:0.0:1788639135.300592:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243152d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+62:2408:x1875523754060800:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788639135.300610:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788639135.300662:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c9d1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85606 expref: 62 pid: 6516 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639135.300676:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c9d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85606 expref: 62 pid: 6516 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639135.300697:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262c9d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85606 expref: 62 pid: 6516 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639135.300716:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ae34ac63e00) 00010000:00010000:0.0:1788639135.300721:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262ca09 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639135.300731:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262ca09 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639135.300947:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262ca09 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.301068:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262ca09 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.301084:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262ca09 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788639135.301102:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788639135.301233:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262ca02 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8561b expref: 63 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.301268:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262ca09 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8561b expref: 62 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639135.301276:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ae34ac63e00) 00010000:00010000:2.0:1788639135.301279:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788639135.301282:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78b600, rc 0) 00000100:00100000:2.0:1788639135.301343:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+62:11422:x1875523754060544:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 13115us (13613us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1788639135.301352:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 121 00010000:00010000:0.0:1788639135.301525:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788639135.301563:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243152d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+61:2408:x1875523754060800:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 971us (1360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639135.301570:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 73 00000100:00100000:1.0:1788639135.309551:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639135.309719:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754061056 00000100:00100000:3.0:1788639135.309728:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754061056 00000100:00100000:3.0:1788639135.310126:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 8 00000100:00100000:3.0:1788639135.310136:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243153800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+61:11422:x1875523754061056:12345-192.168.206.18@tcp:103:lfs.0 00010000:00010000:3.0:1788639135.310150:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639135.310175:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5200/0x25c454990262c95a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855ea expref: 61 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639135.310195:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ae34ac63e00) 00010000:00010000:3.0:1788639135.310211:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639135.310270:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243153800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+60:11422:x1875523754061056:12345-192.168.206.18@tcp:103:lfs.0 Request processed in 135us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639135.310276:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 8 00000100:00100000:2.0:1788639135.315437:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639135.315579:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754061184 00000100:00100000:1.0:1788639135.315590:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754061184 00000100:00100000:1.0:1788639135.315683:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 122 00000100:00100000:1.0:1788639135.315693:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+60:11422:x1875523754061184:12345-192.168.206.18@tcp:58:lfs.0 00010000:00010000:1.0:1788639135.316055:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262ca17 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639135.316073:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262ca17 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639135.316084:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262ca17 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788639135.316174:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1788639135.316269:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+60:11422:x1875523754061184:12345-192.168.206.18@tcp:58:lfs.0 Request processed in 576us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639135.316295:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 122 00000100:00100000:2.0:1788639135.319700:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639135.319977:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754061312 00000100:00100000:3.0:1788639135.319987:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754061312 00000100:00100000:3.0:1788639135.320048:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 123 00000100:00100000:3.0:1788639135.320059:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+60:11422:x1875523754061312:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:3.0:1788639135.320088:0:11314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639135.320109:0:11314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262ca1e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85622 expref: -99 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639135.320162:0:11314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262ca17 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639135.320187:0:11314:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262ca1e lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85622 expref: 61 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639135.320217:0:11314:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262ca17 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639135.320230:0:11314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262ca1e lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85622 expref: 61 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639135.320244:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ae34ac63e00) 00010000:00010000:3.0:1788639135.320247:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788639135.320251:0:11314:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262ca1e lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85622 expref: 61 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639135.320260:0:11314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae38217b800, rc 0) 00000100:00100000:3.0:1788639135.320323:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+61:11422:x1875523754061312:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 266us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639135.320329:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 123 00000004:00080000:3.0:1788639135.924944:0:8828:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 394719325448ns, next at 395719322644ns, rc = 0 00000100:00100000:3.0:1788639135.924977:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788639135.924997:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243993b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773007616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788639135.925065:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639135.925383:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788639135.925394:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae343062300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773007744:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788639135.925416:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773007616 00000100:00100000:2.0:1788639135.925426:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773007616 00000100:00100000:0.0:1788639135.925431:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639135.925463:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773007744 00000100:00100000:0.0:1788639135.925468:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773007744 00000100:00100000:2.0:1788639135.925494:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788639135.925502:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788639135.925516:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae343062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773007744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788639135.925543:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788639135.925584:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae343062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773007744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639135.925590:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788639135.925641:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae343062300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773007744:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788639135.925669:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788639135.925849:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243993100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875523773007616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788639135.925864:0:13805:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788639135.925977:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243993b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773007616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788639135.925984:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243993100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875523773007616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 478us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639135.925993:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000001:00080000:2.0:1788639135.929700:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:2.0:1788639135.929714:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000040:00080000:3.0:1788639136.052818:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788639136.052829:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788639136.052877:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1788639136.052890:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788639136.053042:0:13794:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243993b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1875523773007872:192.168.206.18@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788639136.053694:0:13794:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36e1829c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788639136.061326:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639136.061588:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754061440 00000100:00100000:1.0:1788639136.061598:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754061440 00000100:00100000:1.0:1788639136.061695:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 124 00000100:00100000:1.0:1788639136.061706:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+62:11423:x1875523754061440:12345-192.168.206.18@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788639136.061736:0:6516:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788639136.061839:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+62:11423:x1875523754061440:12345-192.168.206.18@tcp:53:lhsmtool_posix.0 Request processed in 135us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639136.061847:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 124 00000100:00100000:3.0:1788639136.062378:0:13794:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243993b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1875523773007872:192.168.206.18@tcp:107:hsm_cdtr.0 00000100:00080000:0.0:1788639136.062636:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788639136.069707:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639136.069808:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754061568 00000100:00100000:1.0:1788639136.069818:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754061568 00000100:00100000:1.0:1788639136.069880:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 125 00000100:00100000:1.0:1788639136.069890:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+61:11423:x1875523754061568:12345-192.168.206.18@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788639136.069968:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262ca25 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.069985:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262ca25 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.069998:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262ca25 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.070013:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262ca2c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.070020:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262ca2c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.070047:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262ca2c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.070072:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262ca33 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.070080:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262ca33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.070088:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262ca33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788639136.070133:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788639136.070138:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788639136.070150:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262ca33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.070160:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262ca25 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.070167:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262ca25 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.070173:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262ca25 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.070179:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fa000 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639136.070183:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262ca25 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.070191:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262ca25 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.070210:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ae34af01b00) 00010000:00010000:1.0:1788639136.070213:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639136.070218:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262ca25 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.070225:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262ca25 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.070239:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262ca2c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.070247:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262ca2c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.070253:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262ca2c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.070258:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fac00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639136.070261:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262ca2c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.070268:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262ca2c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.070275:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff9ae34af01600) 00010000:00010000:1.0:1788639136.070277:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639136.070280:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262ca2c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.070286:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262ca2c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.070310:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262ca33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.070316:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262ca33 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.070322:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262ca33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.070328:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fa600 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639136.070330:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262ca33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.070337:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262ca33 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.070344:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ae34ac63e00) 00010000:00010000:1.0:1788639136.070347:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639136.070363:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262ca33 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.070369:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262ca33 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639136.070453:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+61:11423:x1875523754061568:12345-192.168.206.18@tcp:34:lhsmtool_posix.0 Request processed in 563us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639136.070461:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 125 00000100:00100000:1.0:1788639136.076974:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639136.077074:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754061824 00000100:00100000:0.0:1788639136.077084:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754061824 00000100:00100000:0.0:1788639136.077146:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 126 00000100:00100000:0.0:1788639136.077157:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2433a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+61:11423:x1875523754061824:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788639136.077176:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639136.077223:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4a00/0x25c454990262ca3a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85629 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639136.077342:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262ca41 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639136.077373:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262ca41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639136.077385:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262ca41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788639136.077396:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788639136.077482:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262ca41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639136.077489:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262ca41 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639136.077495:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262ca41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639136.077501:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef4000 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639136.077505:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262ca41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639136.077514:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262ca41 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639136.077526:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ae34ac63e00) 00010000:00010000:0.0:1788639136.077529:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788639136.077534:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262ca41 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639136.077551:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262ca41 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639136.077593:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4a00/0x25c454990262ca3a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85629 expref: 63 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639136.077605:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ae34af01b00) 00010000:00010000:0.0:1788639136.077607:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788639136.077612:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4a00/0x25c454990262ca3a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85629 expref: 63 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639136.077659:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375ef4a00, rc 0) 00000100:00100000:0.0:1788639136.077772:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2433a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+62:11423:x1875523754061824:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 617us (806us total) trans 4294967400 rc 301/301 00000100:00100000:0.0:1788639136.077780:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 126 00000100:00100000:2.0:1788639136.082787:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639136.082879:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754061952 00000100:00100000:0.0:1788639136.082889:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754061952 00000100:00100000:0.0:1788639136.082940:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 127 00000100:00100000:0.0:1788639136.082950:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+62:11423:x1875523754061952:12345-192.168.206.18@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788639136.082983:0:10169:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788639136.083096:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+62:11423:x1875523754061952:12345-192.168.206.18@tcp:53:lhsmtool_posix.0 Request processed in 147us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639136.083104:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 127 00000100:00100000:2.0:1788639136.090804:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639136.090893:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754062208 00000100:00100000:3.0:1788639136.090903:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754062208 00000100:00100000:3.0:1788639136.090964:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 128 00000100:00100000:3.0:1788639136.090975:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+62:11423:x1875523754062208:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788639136.090996:0:11314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639136.090998:0:11314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788639136.091024:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262c9df lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8560d expref: 62 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639136.091047:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ae242358d00) 00010000:00010000:3.0:1788639136.091052:0:11314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788639136.091066:0:11314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a200/0x25c454990262ca4f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85630 expref: -99 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788639136.091470:0:11314:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:3.0:1788639136.096170:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262ca56 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639136.096190:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262ca56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639136.096201:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262ca56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639136.096258:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a200/0x25c454990262ca4f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85630 expref: 64 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639136.096291:0:11314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262ca56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85630 expref: 63 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639136.096300:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ae242374900) 00010000:00010000:3.0:1788639136.096304:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788639136.096307:0:11314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae38217b000, rc 0) 00000100:00100000:3.0:1788639136.096382:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+63:11423:x1875523754062208:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 5409us (5585us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1788639136.096390:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 128 00000100:00100000:2.0:1788639136.105325:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639136.106691:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754062464 00000100:00100000:1.0:1788639136.106705:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754062464 00000100:00100000:1.0:1788639136.106777:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 129 00000100:00100000:1.0:1788639136.106787:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+63:11423:x1875523754062464:12345-192.168.206.18@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788639136.106851:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788639136.106875:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b000/0x25c454990262ca56 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85630 expref: 63 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.106894:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ae242374900) 00010000:00010000:1.0:1788639136.106905:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788639136.106926:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262ca64 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.106940:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262ca64 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.106949:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262ca64 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.106962:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262ca6b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x75d7ff4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.106968:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262ca6b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x75d7ff4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.106974:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262ca6b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x75d7ff4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.107014:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262ca64 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.107021:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262ca64 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.107037:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262ca64 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.107042:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fa600 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639136.107046:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262ca64 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.107052:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262ca64 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.107060:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ae242358d00) 00010000:00010000:1.0:1788639136.107063:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639136.107066:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262ca64 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.107072:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262ca64 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.107081:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262ca6b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x75d7ff4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.107086:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262ca6b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x75d7ff4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.107092:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262ca6b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x75d7ff4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.107096:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fac00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639136.107098:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262ca6b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x75d7ff4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.107113:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262ca6b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x75d7ff4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.107121:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x75d7ff4f (ffff9ae34af01600) 00010000:00010000:1.0:1788639136.107123:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639136.107126:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262ca6b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x75d7ff4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.107132:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262ca6b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x75d7ff4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639136.107214:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+62:11423:x1875523754062464:12345-192.168.206.18@tcp:36:lhsmtool_posix.0 Request processed in 427us (1896us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788639136.107221:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 129 00000100:00100000:2.0:1788639136.121013:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639136.121161:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754062592 00000100:00100000:1.0:1788639136.121170:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754062592 00000100:00100000:1.0:1788639136.121231:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 130 00000100:00100000:1.0:1788639136.121318:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+62:11423:x1875523754062592:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788639136.121338:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639136.121371:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262ca72 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85637 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.121408:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262ca79 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.121423:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262ca79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.121435:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262ca79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.121648:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262ca72 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85637 expref: 64 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.121667:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262ca79 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85637 expref: 63 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.121676:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ae34af01600) 00010000:00010000:1.0:1788639136.121678:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788639136.121681:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fa600, rc 0) 00000100:00100000:1.0:1788639136.121742:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+63:11423:x1875523754062592:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 502us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639136.121750:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 130 00000100:00100000:2.0:1788639136.128420:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639136.128731:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754062848 00000100:00100000:3.0:1788639136.128741:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754062848 00000100:00100000:3.0:1788639136.128802:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 131 00000100:00100000:3.0:1788639136.128813:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+63:11423:x1875523754062848:12345-192.168.206.18@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788639136.128905:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a200/0x25c454990262ca80 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639136.128923:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a200/0x25c454990262ca80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639136.128935:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a200/0x25c454990262ca80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788639136.129097:0:11314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00010000:3.0:1788639136.129149:0:11314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000843448ad reply state 00000000ee0f6d38 transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a200/0x25c454990262ca80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639136.129161:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a200/0x25c454990262ca80 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639136.129182:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ae34af01600) 00010000:00010000:3.0:1788639136.129185:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788639136.129188:0:11314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788639136.130161:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+65:11423:x1875523754062848:12345-192.168.206.18@tcp:36:lhsmtool_posix.0 Request processed in 1344us (1743us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1788639136.130171:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 131 00000100:00100000:2.0:1788639136.140375:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639136.140530:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754062976 00000100:00100000:0.0:1788639136.140539:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754062976 00000100:00100000:0.0:1788639136.140603:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 132 00000100:00100000:0.0:1788639136.140668:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243951500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+65:11423:x1875523754062976:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788639136.140690:0:10169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639136.140709:0:10169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4a00/0x25c454990262ca87 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e8563e expref: -99 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639136.140761:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4a00/0x25c454990262ca87 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8563e expref: 66 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639136.140775:0:10169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4a00/0x25c454990262ca87 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8563e expref: 66 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639136.140810:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ae34af01600) 00010000:00010000:0.0:1788639136.140814:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788639136.140818:0:10169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375ef4a00, rc 0) 00000100:00100000:0.0:1788639136.140988:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243951500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+66:11423:x1875523754062976:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 322us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639136.140995:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 132 00000100:00100000:2.0:1788639136.144999:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639136.145108:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754063104 00000100:00100000:3.0:1788639136.145117:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754063104 00000100:00100000:3.0:1788639136.145239:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 45 00000100:00100000:3.0:1788639136.145250:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f82b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+8:2408:x1875523754063104:12345-192.168.206.18@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788639136.145745:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f82b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+9:2408:x1875523754063104:12345-192.168.206.18@tcp:2:lhsmtool_posix.0 Request processed in 496us (754us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788639136.145754:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 45 00000100:00080000:0.0:1788639136.146563:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788639136.153609:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639136.153743:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754063360 00000100:00100000:2.0:1788639136.153753:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754063360 00000100:00100000:2.0:1788639136.153808:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 30 00000100:00100000:2.0:1788639136.153818:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+66:11423:x1875523754063360:12345-192.168.206.18@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788639136.154025:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+67:11423:x1875523754063360:12345-192.168.206.18@tcp:35:lhsmtool_posix.0 Request processed in 207us (423us total) trans 4294967403 rc 0/0 00000100:00100000:2.0:1788639136.154032:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 30 00000100:00100000:2.0:1788639136.157282:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639136.157480:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754063616 00000100:00100000:1.0:1788639136.157489:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754063616 00000100:00100000:1.0:1788639136.157556:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 133 00000100:00100000:1.0:1788639136.157567:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+67:11423:x1875523754063616:12345-192.168.206.18@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788639136.157709:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+67:11423:x1875523754063616:12345-192.168.206.18@tcp:57:lhsmtool_posix.0 Request processed in 143us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639136.157717:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 133 00000100:00100000:3.0:1788639136.168568:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639136.168688:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754063744 00000100:00100000:2.0:1788639136.168697:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754063744 00000100:00100000:2.0:1788639136.168755:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 134 00000100:00100000:2.0:1788639136.168765:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243993b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+67:11423:x1875523754063744:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788639136.168783:0:11314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639136.168801:0:11314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262ca8e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85645 expref: -99 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.168865:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262ca95 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.168879:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262ca95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.168906:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262ca95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788639136.168950:0:11314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788639136.168969:0:11314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262ca95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.168995:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262ca8e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85645 expref: 69 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.169022:0:11314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262ca95 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85645 expref: 68 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.169031:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ae34af01600) 00010000:00010000:2.0:1788639136.169034:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788639136.169038:0:11314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78be00, rc 0) 00000100:00100000:2.0:1788639136.169098:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243993b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+68:11423:x1875523754063744:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 334us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639136.169105:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 134 00000100:00100000:3.0:1788639136.173793:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639136.173842:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754063872 00000100:00100000:2.0:1788639136.173851:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754063872 00000100:00100000:2.0:1788639136.173905:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 46 00000100:00100000:2.0:1788639136.173916:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243991180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+9:2408:x1875523754063872:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788639136.173933:0:8829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639136.173952:0:8829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027e6f44d/0x25c454990262ca9c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e8564c expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788639136.174000:0:8829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c77a0, blocks: 0x0 00010000:00010000:2.0:1788639136.174019:0:8829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=394s v=(0 0) 00010000:00010000:2.0:1788639136.174023:0:8829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788639136.174032:0:8829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027e6f44d/0x25c454990262ca9c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8564c expref: 10 pid: 8829 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.174052:0:8829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027e6f44d/0x25c454990262ca9c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8564c expref: 10 pid: 8829 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.174065:0:8829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78ac00, rc 0) 00000100:00100000:2.0:1788639136.174125:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243991180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+10:2408:x1875523754063872:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 210us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639136.174133:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 46 00000100:00100000:1.0:1788639136.176251:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639136.176421:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754064128 00000100:00100000:2.0:1788639136.176429:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754064128 00000100:00100000:2.0:1788639136.176485:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 135 00000100:00100000:2.0:1788639136.176495:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f814380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+68:11423:x1875523754064128:12345-192.168.206.18@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788639136.176607:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f814380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+68:11423:x1875523754064128:12345-192.168.206.18@tcp:57:lhsmtool_posix.0 Request processed in 113us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639136.176641:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 135 00010000:00010000:3.0:1788639136.181650:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639136.183917:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639136.184443:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754064256 00000100:00100000:1.0:1788639136.184453:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754064256 00000100:00100000:1.0:1788639136.184511:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 47 00000100:00100000:1.0:1788639136.184521:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243992a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+10:11423:x1875523754064256:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788639136.184552:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639136.184570:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dfc560a/0x25c454990262caa3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85653 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.184603:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027e6f44d/0x25c454990262ca9c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8564c expref: 11 pid: 8829 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.184637:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639136.184644:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639136.184651:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dfc560a/0x25c454990262caa3 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85653 expref: 11 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.184701:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000027e6f44d/0x25c454990262ca9c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8564c expref: 11 pid: 8829 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.184716:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000027e6f44d/0x25c454990262ca9c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8564c expref: 11 pid: 8829 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639136.184730:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243958380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1875523773008000:192.168.206.18@tcp:104: 00000100:00100000:1.0:1788639136.184829:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2420b3180 going to sleep for 11 seconds 00000100:00100000:1.0:1788639136.190516:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243958380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1875523773008000:192.168.206.18@tcp:104: 00010000:00010000:1.0:1788639136.190554:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003dfc560a/0x25c454990262caa3 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85653 expref: 11 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.190576:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fb000, rc 0) 00000100:00100000:1.0:1788639136.190684:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243992a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+11:11423:x1875523754064256:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 6164us (6776us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639136.190693:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 47 00000100:00100000:2.0:1788639136.197551:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639136.198001:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754064384 00000100:00100000:0.0:1788639136.198011:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754064384 00010000:00010000:0.0:1788639136.198051:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000027e6f44d/0x25c454990262ca9c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8564c expref: 11 pid: 8829 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639136.198095:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 74 00000100:00100000:0.0:1788639136.198105:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b60dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+11:2407:x1875523754064384:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788639136.198119:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788639136.198156:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000027e6f44d/0x25c454990262ca9c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8564c expref: 11 pid: 8829 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639136.198170:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000027e6f44d/0x25c454990262ca9c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8564c expref: 11 pid: 8829 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639136.198190:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027e6f44d/0x25c454990262ca9c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8564c expref: 11 pid: 8829 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639136.198226:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788639136.198230:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788639136.198239:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003dfc560a/0x25c454990262caa3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85653 expref: 10 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639136.198249:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dfc560a/0x25c454990262caa3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85653 expref: 10 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639136.198290:0:6501:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003dfc560a/0x25c454990262caa3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85653 expref: 10 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639136.198305:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae343062300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6501:1875523773008128:192.168.206.18@tcp:105: 00000100:00100000:0.0:1788639136.198409:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae342c283c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788639136.208049:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639136.208162:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae343062300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6501:1875523773008128:192.168.206.18@tcp:105: 00010000:00010000:0.0:1788639136.208184:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788639136.208257:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b60dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+10:2407:x1875523754064384:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 10153us (10715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639136.208286:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 74 00000100:00100000:1.0:1788639136.208662:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754064512 00000100:00100000:1.0:1788639136.208669:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754064512 00002000:00100000:1.0:1788639136.208713:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9ae243992300 x1875523754064512/t0(0) o4->5deb128c-4fe3-4f51-b21e-f30846e08445@192.168.206.18@tcp:357/0 lens 504/0 e 0 to 0 dl 1788639147 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788639136.208723:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae243992300 with x1875523754064512 ext(0->12) 00002000:00010000:1.0:1788639136.208728:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ae243992300 00000100:00100000:1.0:1788639136.208745:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 2 00000100:00100000:1.0:1788639136.208753:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243992300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+10:2408:x1875523754064512:12345-192.168.206.18@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788639136.211126:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243992300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+12:2408:x1875523754064512:12345-192.168.206.18@tcp:4:lhsmtool_posix.0 Request processed in 2365us (3078us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788639136.211139:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 2 00002000:00100000:1.0:1788639136.211150:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9ae243992300 x1875523754064512/t4294967309(0) o4->5deb128c-4fe3-4f51-b21e-f30846e08445@192.168.206.18@tcp:357/0 lens 504/448 e 0 to 0 dl 1788639147 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788639136.211160:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae243992300 with x1875523754064512 ext(0->12) 00002000:00010000:1.0:1788639136.211165:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ae243992300 00000100:00100000:3.0:1788639136.221940:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639136.222259:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754064640 00000100:00100000:2.0:1788639136.222401:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754064640 00000100:00100000:2.0:1788639136.222475:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 136 00000100:00100000:2.0:1788639136.222500:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243990e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+68:11423:x1875523754064640:12345-192.168.206.18@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788639136.224730:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967403 is committed 00000004:00080000:0.0:1788639136.224752:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:0.0:1788639136.224782:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:0.0:1788639136.224802:0:6494:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ae2420b3900 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1788639136.224817:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ae35859e500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ae2420b3540 00000020:00080000:0.0:1788639136.224820:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ae35859e600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ae375c3ce00 00000004:00080000:0.0:1788639136.224844:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1788639136.224880:0:6494:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ae2420b33c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1788639136.224884:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ae36d36d600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ae2420b36c0 00000020:00080000:0.0:1788639136.224887:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ae242f18400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ae3627eae00 00000020:00080000:0.0:1788639136.224898:0:6494:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:1.0:1788639136.225122:0:6548:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1788639136.225179:0:6548:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788639136.225371:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788639136.225389:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243958380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773008256:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788639136.225452:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639136.225502:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773008256 00000100:00100000:3.0:1788639136.225509:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773008256 00000100:00100000:3.0:1788639136.225558:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788639136.225568:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243991500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523773008256:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788639136.225643:0:8432:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:3.0:1788639136.225673:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9c779f, atime: 0x6a9c779f, ctime: 0x6a9c779f, blocks: 0x8 00010000:00010000:3.0:1788639136.225681:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1b946ca/0x25c454990262caaa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639136.225704:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=395s v=(0 0) 00010000:00010000:3.0:1788639136.225708:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639136.225715:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1b946ca/0x25c454990262caaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639136.225732:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1b946ca/0x25c454990262caaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639136.225743:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1b946ca/0x25c454990262caaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639136.225751:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1b946ca/0x25c454990262caaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639136.225766:0:8432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788639136.225889:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788639136.225895:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1b946ca/0x25c454990262caaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.225903:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae38217b000 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:1.0:1788639136.225914:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1b946ca/0x25c454990262caaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.225924:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1b946ca/0x25c454990262caaa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.225938:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1b946ca/0x25c454990262caaa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.225946:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1b946ca/0x25c454990262caaa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.225965:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639136.225967:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639136.225968:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639136.225979:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773008384:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788639136.226010:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639136.226042:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773008384 00000100:00100000:1.0:1788639136.226047:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773008384 00000100:00100000:1.0:1788639136.226073:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788639136.226081:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243959880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1875523773008384:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788639136.226095:0:8431:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:1.0:1788639136.226109:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecbfdf9e/0x25c454990262cab1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.226124:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff0a6b68/0x25c454990262c85e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855ab expref: 11 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.226143:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1788639136.226146:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788639136.226150:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecbfdf9e/0x25c454990262cab1 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.226177:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ff0a6b68/0x25c454990262c85e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855ab expref: 11 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.226192:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ff0a6b68/0x25c454990262c85e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855ab expref: 11 pid: 8829 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639136.226219:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243958000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1875523773008512:192.168.206.18@tcp:104: 00000100:00100000:1.0:1788639136.226277:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2420b3180 going to sleep for 11 seconds 00000100:00100000:3.0:1788639136.227168:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243991500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1875523773008256:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1600us (1714us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788639136.227178:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:2.0:1788639136.227235:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262c7a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.227245:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262c7a8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.227252:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262c7a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.227257:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78a800 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639136.227262:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262c7a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.227269:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262c7a8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.227361:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ae242381300) 00010000:00010000:2.0:1788639136.227366:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639136.227370:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262c7a8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.227377:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262c7a8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788639136.227401:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788639136.227401:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262c850 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.227407:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262c850 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.227413:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262c850 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.227428:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef5e00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639136.227431:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262c850 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.227437:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262c850 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.227445:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ae362514400) 00010000:00010000:2.0:1788639136.227447:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639136.227450:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262c850 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.227455:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262c850 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639136.227460:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1788639136.227466:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967304 00010000:00010000:2.0:1788639136.227471:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c8ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.227476:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c8ce lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.227481:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c8ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788639136.227482:0:3643:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ae3461b4e00, transno 4294967302 00010000:00010000:2.0:1788639136.227486:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78a000 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639136.227489:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c8ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.227495:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c8ce lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788639136.227498:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967304 00010000:00010000:2.0:1788639136.227512:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ae242358c00) 00000100:00100000:1.0:1788639136.227512:0:3643:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9ae243958380 x1875523773008256/t4294967305(4294967305) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788639152 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788639136.227515:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639136.227518:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c8ce lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788639136.227522:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ae243958380/2, rc 0, transno 4294967305 00010000:00010000:2.0:1788639136.227524:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262c8ce lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639136.227527:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243958380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773008256:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788639136.227535:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b600/0x25c454990262c8f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639136.227795:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243990e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+19:11423:x1875523754064640:12345-192.168.206.18@tcp:44:lhsmtool_posix.0 Request processed in 5295us (5860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639136.227804:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 136 00010000:00010000:2.0:1788639136.227993:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b600/0x25c454990262c8f1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.228001:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b600/0x25c454990262c8f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.228007:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae38217b600 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639136.228010:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b600/0x25c454990262c8f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.228016:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b600/0x25c454990262c8f1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.228024:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ae242358c00) 00010000:00010000:2.0:1788639136.228027:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639136.228030:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b600/0x25c454990262c8f1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.228036:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b600/0x25c454990262c8f1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.228062:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b800/0x25c454990262c9c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.228068:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b800/0x25c454990262c9c3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.228073:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b800/0x25c454990262c9c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.228078:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78b800 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639136.228081:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b800/0x25c454990262c9c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.228086:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b800/0x25c454990262c9c3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.228094:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ae34ac63e00) 00010000:00010000:2.0:1788639136.228096:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639136.228099:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b800/0x25c454990262c9c3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.228105:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b800/0x25c454990262c9c3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.228121:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a200/0x25c454990262ca80 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.228127:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a200/0x25c454990262ca80 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.228133:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a200/0x25c454990262ca80 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.228145:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae38217a200 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639136.228148:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a200/0x25c454990262ca80 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.228154:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a200/0x25c454990262ca80 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.228162:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ae34af01600) 00010000:00010000:2.0:1788639136.228164:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788639136.228167:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a200/0x25c454990262ca80 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.228173:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a200/0x25c454990262ca80 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639136.231596:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639136.231668:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639136.231751:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754064896 00000100:00100000:2.0:1788639136.231760:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754064896 00010000:00010000:2.0:1788639136.231798:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ff0a6b68/0x25c454990262c85e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855ab expref: 12 pid: 8829 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639136.231858:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 75 00000100:00100000:2.0:1788639136.231869:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243993800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+12:2408:x1875523754064896:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788639136.231883:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788639136.231889:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ff0a6b68/0x25c454990262c85e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855ab expref: 12 pid: 8829 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.231903:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ff0a6b68/0x25c454990262c85e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855ab expref: 12 pid: 8829 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.231945:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788639136.231950:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788639136.231956:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ecbfdf9e/0x25c454990262cab1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.231965:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecbfdf9e/0x25c454990262cab1 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.231985:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788639136.232033:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243993800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+12:2408:x1875523754064896:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 166us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639136.232041:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 75 00000100:00100000:0.0:1788639136.233266:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754064768 00000100:00100000:0.0:1788639136.233276:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754064768 00000100:00100000:0.0:1788639136.233329:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 50 00000100:00100000:0.0:1788639136.233339:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36e295c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+12:2408:x1875523754064768:12345-192.168.206.18@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1788639136.233762:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff0a6b68/0x25c454990262c85e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855ab expref: 12 pid: 8829 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639136.233783:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243958000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1875523773008512:192.168.206.18@tcp:104: 00010000:00010000:1.0:1788639136.234202:0:8431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ecbfdf9e/0x25c454990262cab1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.234216:0:8431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ecbfdf9e/0x25c454990262cab1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.234225:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ecbfdf9e/0x25c454990262cab1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.234237:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecbfdf9e/0x25c454990262cab1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.234245:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ecbfdf9e/0x25c454990262cab1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.234267:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788639136.234359:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788639136.234367:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ecbfdf9e/0x25c454990262cab1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.234376:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fac00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:2.0:1788639136.234380:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecbfdf9e/0x25c454990262cab1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.234390:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecbfdf9e/0x25c454990262cab1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.234407:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ecbfdf9e/0x25c454990262cab1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.234428:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ecbfdf9e/0x25c454990262cab1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.234445:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639136.234447:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639136.234449:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639136.234847:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243959880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3641:x1875523773008384:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8765us (8835us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788639136.234857:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00080000:0.0:1788639136.235122:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ae243991f80/2, rc 0, transno 4294967310 00000100:00100000:0.0:1788639136.235144:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773008384:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1788639136.236165:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:0.0:1788639136.236180:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000100:00100000:1.0:1788639136.236471:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36e295c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2408:x1875523754064768:12345-192.168.206.18@tcp:16:lhsmtool_posix.0 Request processed in 3130us (4879us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639136.236481:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 50 00000100:00100000:3.0:1788639136.239130:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639136.239219:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754065152 00000100:00100000:0.0:1788639136.239228:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754065152 00000100:00100000:0.0:1788639136.239318:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 137 00000100:00100000:0.0:1788639136.239330:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243992680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+16:11423:x1875523754065152:12345-192.168.206.18@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788639136.239412:0:10169:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788639136.239438:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262ca95 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85645 expref: 16 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639136.239463:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ae34af01600) 00010000:00010000:0.0:1788639136.239468:0:10169:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788639136.239495:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262cab8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639136.239509:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262cab8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639136.239519:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262cab8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788639136.239680:0:10169:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a37807b1 reply state 00000000d8ddf0f7 transno 4294967404 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262cab8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639136.239692:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262cab8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639136.239698:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ae34af01600) 00010000:00010000:0.0:1788639136.239700:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788639136.239703:0:10169:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788639136.239787:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243992680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+17:11423:x1875523754065152:12345-192.168.206.18@tcp:36:lhsmtool_posix.0 Request processed in 458us (666us total) trans 4294967404 rc 0/0 00000100:00100000:0.0:1788639136.239794:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 137 00000100:00100000:2.0:1788639136.247185:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639136.247275:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754065280 00000100:00100000:0.0:1788639136.247285:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754065280 00000100:00100000:0.0:1788639136.247338:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 51 00000100:00100000:0.0:1788639136.247373:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243398700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2408:x1875523754065280:12345-192.168.206.18@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788639136.248023:0:8829:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788639136.248029:0:8829:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788639135 00002000:00010000:0.0:1788639136.248031:0:8829:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788639135 00002000:00010000:0.0:1788639136.248034:0:8829:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1788639136 -> 1788639135 00002000:00010000:0.0:1788639136.248036:0:8829:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1788639136.248103:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243398700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+7:2408:x1875523754065280:12345-192.168.206.18@tcp:2:lhsmtool_posix.0 Request processed in 731us (925us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788639136.248111:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 51 00000100:00100000:3.0:1788639136.252260:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639136.254698:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754065536 00000100:00100000:1.0:1788639136.254713:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754065536 00000100:00100000:1.0:1788639136.254778:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 138 00000100:00100000:1.0:1788639136.254788:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243991c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+17:11423:x1875523754065536:12345-192.168.206.18@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788639136.254863:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262cabf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.254880:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262ca79 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85637 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.254889:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262cabf lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.254924:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262ca79 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85637 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.254937:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262ca79 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85637 expref: 17 pid: 6517 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639136.254951:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243959880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1875523773008640:192.168.206.18@tcp:104: 00000100:00100000:1.0:1788639136.255042:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2420b3540 going to sleep for 11 seconds 00000100:00100000:1.0:1788639136.269844:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243959880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1875523773008640:192.168.206.18@tcp:104: 00010000:00010000:1.0:1788639136.269872:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262cabf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639136.273037:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639136.273140:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754065664 00000100:00100000:0.0:1788639136.273150:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754065664 00010000:00010000:0.0:1788639136.273185:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262ca79 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85637 expref: 18 pid: 6517 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639136.273226:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 76 00000100:00100000:0.0:1788639136.273234:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243993480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+18:2407:x1875523754065664:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788639136.273247:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788639136.273254:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262ca79 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85637 expref: 18 pid: 6517 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639136.273267:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262ca79 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85637 expref: 18 pid: 6517 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639136.273288:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262ca79 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85637 expref: 18 pid: 6517 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639136.273314:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ae34af01600) 00010000:00010000:0.0:1788639136.273332:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262cabf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639136.273342:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262cabf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639136.273360:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262cabf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639136.273390:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788639136.273442:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243993480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+17:2407:x1875523754065664:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 208us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639136.273451:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 76 00010000:00010000:1.0:1788639136.273841:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262cabf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.273853:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262cabf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.273898:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262cabf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.273906:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262cabf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.273912:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262cabf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.273918:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fae00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639136.273922:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262cabf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.273930:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262cabf lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.273940:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ae34af01600) 00010000:00010000:1.0:1788639136.273943:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788639136.273947:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262cabf lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.273954:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262cabf lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639136.274010:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243991c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+16:11423:x1875523754065536:12345-192.168.206.18@tcp:55:lhsmtool_posix.0 Request processed in 19223us (21757us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788639136.274019:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 138 00000100:00100000:3.0:1788639136.291845:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639136.293602:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754065792 00000100:00100000:1.0:1788639136.293719:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754065792 00000100:00100000:1.0:1788639136.293841:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 52 00000100:00100000:1.0:1788639136.293869:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243990380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+7:2408:x1875523754065792:12345-192.168.206.18@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788639136.293913:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ff0a6b68/0x25c454990262cac6 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.293933:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003dfc560a/0x25c454990262caa3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85653 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.293942:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788639136.293947:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788639136.293951:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff0a6b68/0x25c454990262cac6 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.293987:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003dfc560a/0x25c454990262caa3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85653 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.294001:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003dfc560a/0x25c454990262caa3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85653 expref: 7 pid: 8430 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639136.294015:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243959880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1875523773008768:192.168.206.18@tcp:104: 00000100:00100000:1.0:1788639136.294120:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2420b3540 going to sleep for 11 seconds 00000100:00100000:1.0:1788639136.301990:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243959880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1875523773008768:192.168.206.18@tcp:104: 00010000:00010000:1.0:1788639136.302019:0:8431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ff0a6b68/0x25c454990262cac6 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639136.305977:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639136.306501:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754065920 00000100:00100000:2.0:1788639136.306510:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754065920 00010000:00010000:2.0:1788639136.306546:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003dfc560a/0x25c454990262caa3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85653 expref: 8 pid: 8430 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639136.306609:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 77 00000100:00100000:2.0:1788639136.306656:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243991880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+8:2407:x1875523754065920:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788639136.306670:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788639136.306693:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003dfc560a/0x25c454990262caa3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85653 expref: 8 pid: 8430 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.306707:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003dfc560a/0x25c454990262caa3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85653 expref: 8 pid: 8430 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.306730:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dfc560a/0x25c454990262caa3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85653 expref: 8 pid: 8430 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.306746:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788639136.306760:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788639136.306766:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff0a6b68/0x25c454990262cac6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.306777:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff0a6b68/0x25c454990262cac6 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.306802:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788639136.306856:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243991880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+7:2407:x1875523754065920:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 237us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639136.306864:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 77 00010000:00010000:1.0:1788639136.308584:0:8431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ff0a6b68/0x25c454990262cac6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.308663:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff0a6b68/0x25c454990262cac6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.308697:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ff0a6b68/0x25c454990262cac6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.308706:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff0a6b68/0x25c454990262cac6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.308714:0:8431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff0a6b68/0x25c454990262cac6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.308721:0:8431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fae00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:1.0:1788639136.308726:0:8431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff0a6b68/0x25c454990262cac6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.308735:0:8431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff0a6b68/0x25c454990262cac6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.308754:0:8431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff0a6b68/0x25c454990262cac6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.308761:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff0a6b68/0x25c454990262cac6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639136.308868:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243990380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2408:x1875523754065792:12345-192.168.206.18@tcp:1:lhsmtool_posix.0 Request processed in 14998us (17028us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639136.308881:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 52 00000100:00100000:0.0:1788639136.314130:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639136.314409:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754066176 00000100:00100000:1.0:1788639136.314419:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754066176 00000100:00100000:1.0:1788639136.314488:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 139 00000100:00100000:1.0:1788639136.314499:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae343061880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+16:11423:x1875523754066176:12345-192.168.206.18@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788639136.314572:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262cacd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.314589:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262c9bc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855ff expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.314598:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262cacd lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.314682:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262c9bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855ff expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.314696:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262c9bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855ff expref: 16 pid: 6518 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639136.314709:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243959880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1875523773008896:192.168.206.18@tcp:104: 00000100:00100000:1.0:1788639136.314798:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2420b3540 going to sleep for 11 seconds 00000100:00100000:1.0:1788639136.318240:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243959880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1875523773008896:192.168.206.18@tcp:104: 00010000:00010000:1.0:1788639136.318295:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262cacd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639136.320051:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639136.320163:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754066304 00000100:00100000:2.0:1788639136.320172:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754066304 00010000:00010000:2.0:1788639136.320221:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262c9bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855ff expref: 17 pid: 6518 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639136.320257:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 78 00000100:00100000:2.0:1788639136.320267:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae343063b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+17:2408:x1875523754066304:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788639136.320289:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788639136.320295:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262c9bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855ff expref: 17 pid: 6518 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.320310:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262c9bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855ff expref: 17 pid: 6518 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.320331:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262c9bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e855ff expref: 17 pid: 6518 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.320384:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ae34ac63e00) 00010000:00010000:2.0:1788639136.320391:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262ca1e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85622 expref: 16 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.320400:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262cacd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.320408:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262cacd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.320415:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262cacd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.320680:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788639136.320729:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae343063b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+16:2408:x1875523754066304:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 462us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639136.320978:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 78 00010000:00010000:1.0:1788639136.321123:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262cacd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.321133:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262cacd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.321518:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262cad4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.321531:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4a00/0x25c454990262ca87 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8563e expref: 16 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.321539:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262cad4 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.321568:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4a00/0x25c454990262ca87 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8563e expref: 16 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.321583:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4a00/0x25c454990262ca87 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8563e expref: 16 pid: 10169 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639136.321597:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243959880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1875523773009024:192.168.206.18@tcp:104: 00000100:00100000:1.0:1788639136.322011:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2420b3300 going to sleep for 11 seconds 00000100:00100000:0.0:1788639136.330437:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639136.330684:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243959880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1875523773009024:192.168.206.18@tcp:104: 00010000:00010000:1.0:1788639136.330709:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262cad4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639136.330882:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754066432 00000100:00100000:2.0:1788639136.330890:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754066432 00010000:00010000:2.0:1788639136.330936:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4a00/0x25c454990262ca87 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8563e expref: 17 pid: 10169 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639136.330975:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 79 00000100:00100000:2.0:1788639136.330985:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae343062300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+17:2407:x1875523754066432:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788639136.330999:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788639136.331007:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4a00/0x25c454990262ca87 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8563e expref: 17 pid: 10169 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.331032:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4a00/0x25c454990262ca87 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8563e expref: 17 pid: 10169 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.331055:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4a00/0x25c454990262ca87 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8563e expref: 17 pid: 10169 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.331071:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ae34af01600) 00010000:00010000:2.0:1788639136.331076:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262cad4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.331085:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262cad4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.331093:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262cad4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.331121:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788639136.331163:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae343062300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+16:2407:x1875523754066432:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 179us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639136.331171:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 79 00010000:00010000:3.0:1788639136.331529:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262cad4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639136.331538:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262cad4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788639136.331689:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:3.0:1788639136.331799:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000001:00080000:3.0:1788639136.331835:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:3.0:1788639136.331918:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243990000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6516:1875523773009152:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788639136.331968:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639136.332000:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3498cb540 going to sleep for 11 seconds 00000100:00100000:2.0:1788639136.332897:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773009152 00000100:00100000:2.0:1788639136.332917:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773009152 00000100:00100000:2.0:1788639136.332965:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788639136.332974:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243990700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6516:x1875523773009152:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788639136.333064:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243990700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6516:x1875523773009152:12345-0@lo:1000:mdt00_000.0 Request processed in 92us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639136.333071:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788639136.333322:0:6516:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:3.0:1788639136.333327:0:6516:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:3.0:1788639136.333358:0:6516:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9ae243991f80 x1875523773008384/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788639152 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639136.333370:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243990000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6516:1875523773009152:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1788639136.333497:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00000100:00100000:3.0:1788639136.333557:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243990000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6516:1875523773009280:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788639136.333592:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639136.334035:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2430660c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788639136.334109:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773009280 00000100:00100000:2.0:1788639136.334114:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773009280 00000100:00100000:2.0:1788639136.334154:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788639136.334162:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243990a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6516:x1875523773009280:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788639136.334293:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243990a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6516:x1875523773009280:12345-0@lo:1000:mdt00_000.0 Request processed in 132us (700us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788639136.334300:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788639136.334444:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243990000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6516:1875523773009280:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788639136.334479:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262cad4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.334488:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262cad4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.334496:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262cad4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.334501:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fae00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639136.334506:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262cad4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.334514:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262cad4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.334528:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ae34af01600) 00010000:00010000:1.0:1788639136.334531:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788639136.334535:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262cad4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.334540:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262cad4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.334560:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262ca17 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.334565:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262ca17 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.334584:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262ca17 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.334589:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fbe00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639136.334592:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262ca17 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.334598:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262ca17 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.334606:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ae34ac63e00) 00010000:00010000:1.0:1788639136.334609:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788639136.334648:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262ca1e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85622 expref: 19 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.334661:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262ca1e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85622 expref: 19 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.334679:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262ca1e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85622 expref: 19 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.334707:0:6516:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262ca1e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85622 expref: 19 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639136.334719:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243959880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1875523773009408:192.168.206.18@tcp:105: 00000100:00100000:1.0:1788639136.334779:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2420b3300 going to sleep for 11 seconds 00000100:00100000:1.0:1788639136.340883:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243959880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1875523773009408:192.168.206.18@tcp:105: 00010000:00010000:1.0:1788639136.341005:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262ca17 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.341017:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262ca17 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.341049:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262cadb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.341061:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262cadb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.341073:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262cadb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.341082:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262cadb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.341088:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262cadb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.341094:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262cadb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.341100:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fa200 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639136.341104:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262cadb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.341111:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262cadb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.341122:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ae34ac63e00) 00010000:00010000:1.0:1788639136.341125:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639136.341135:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262cadb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.341141:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262cadb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.341151:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262cacd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.341157:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262cacd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.341163:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262cacd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.341168:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fb400 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639136.341171:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262cacd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.341177:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262cacd lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.341185:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ae34ac63e00) 00010000:00010000:1.0:1788639136.341187:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788639136.341190:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262cacd lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.341195:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262cacd lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639136.341938:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae343061880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+19:11423:x1875523754066176:12345-192.168.206.18@tcp:57:lhsmtool_posix.0 Request processed in 27436us (27811us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1788639136.341950:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 139 00000020:00080000:1.0:1788639136.341964:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788639136.343202:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788639136.343209:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788639136.344213:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788639136.344225:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788639136.347757:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639136.347869:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754066560 00000100:00100000:2.0:1788639136.347879:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754066560 00000100:00100000:2.0:1788639136.347951:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 31 00000100:00100000:2.0:1788639136.347962:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae343062680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+19:11422:x1875523754066560:12345-192.168.206.18@tcp:49:lfs.0 00000100:00100000:2.0:1788639136.348093:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae343062680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+19:11422:x1875523754066560:12345-192.168.206.18@tcp:49:lfs.0 Request processed in 132us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639136.348101:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 31 00000100:00100000:3.0:1788639136.348772:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639136.349347:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754066816 00000100:00100000:0.0:1788639136.349364:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754066816 00000100:00100000:0.0:1788639136.349500:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 32 00000100:00100000:0.0:1788639136.349521:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ef3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+19:11423:x1875523754066816:12345-192.168.206.18@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788639136.349787:0:6520:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788639136.349819:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967410 00010000:00010000:0.0:1788639136.349850:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262cae2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639136.349879:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262cae2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639136.349891:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262cae2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639136.349923:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262cae2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639136.349930:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262cae2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639136.349941:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262cae2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639136.349972:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788639136.350063:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ef3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+21:11423:x1875523754066816:12345-192.168.206.18@tcp:35:lhsmtool_posix.0 Request processed in 542us (1280us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1788639136.350080:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 32 00000020:00080000:0.0:1788639136.350085:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788639136.350438:0:9520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788639136.350445:0:9520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262cae2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639136.350463:0:9520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef5e00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:3.0:1788639136.350467:0:9520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262cae2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639136.350474:0:9520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262cae2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639136.350486:0:9520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ae34af01600) 00010000:00010000:3.0:1788639136.350489:0:9520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788639136.350493:0:9520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262cae2 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639136.350498:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262cae2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639136.350525:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639136.350527:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639136.350529:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639136.353980:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639136.355504:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754067072 00000100:00100000:0.0:1788639136.355587:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754067072 00000100:00100000:0.0:1788639136.355773:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 140 00000100:00100000:0.0:1788639136.355784:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243992d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+21:11422:x1875523754067072:12345-192.168.206.18@tcp:58:lfs.0 00000040:00080000:0.0:1788639136.355981:0:10169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1788639136.356069:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243992d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+21:11422:x1875523754067072:12345-192.168.206.18@tcp:58:lfs.0 Request processed in 287us (2095us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639136.356412:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 140 00000100:00100000:2.0:1788639136.392662:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639136.392834:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754067200 00000100:00100000:1.0:1788639136.392848:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754067200 00000100:00100000:1.0:1788639136.392906:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 141 00000100:00100000:1.0:1788639136.392915:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+21:11425:x1875523754067200:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:1.0:1788639136.392936:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639136.392953:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262cae9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e8565a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.393669:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262caf0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.393685:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262caf0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.393696:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262caf0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.393710:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262caf7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.393716:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262caf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.393722:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262caf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.393793:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262cafe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.393804:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262ca09 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8561b expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.393831:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262cafe lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.393863:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262ca09 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8561b expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.393876:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262ca09 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8561b expref: 22 pid: 6516 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639136.393889:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243959880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1875523773009536:192.168.206.18@tcp:104: 00000100:00100000:1.0:1788639136.396698:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2420b3300 going to sleep for 11 seconds 00000100:00100000:3.0:1788639136.401802:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639136.402241:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243959880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6517:1875523773009536:192.168.206.18@tcp:104: 00010000:00010000:1.0:1788639136.402268:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262cafe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639136.402374:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754067456 00000100:00100000:0.0:1788639136.402382:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754067456 00000100:00100000:0.0:1788639136.402488:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 33 00000100:00100000:0.0:1788639136.402498:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243991180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+23:6174:x1875523754067456:12345-192.168.206.18@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788639136.402746:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243991180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+24:6174:x1875523754067456:12345-192.168.206.18@tcp:35:ldlm_bl.0 Request processed in 249us (951us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1788639136.402769:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 33 00000100:00100000:3.0:1788639136.406444:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639136.407859:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754067584 00000100:00100000:2.0:1788639136.407872:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754067584 00010000:00010000:2.0:1788639136.407922:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262ca09 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8561b expref: 24 pid: 6516 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639136.407957:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 80 00000100:00100000:2.0:1788639136.407966:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243992a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+24:2408:x1875523754067584:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788639136.407982:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788639136.407988:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262ca09 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8561b expref: 24 pid: 6516 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.408001:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262ca09 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8561b expref: 24 pid: 6516 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.408039:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262ca09 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8561b expref: 24 pid: 6516 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.408062:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ae34ac63e00) 00010000:00010000:2.0:1788639136.408068:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262cafe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.408091:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262cafe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.408099:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262cafe lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639136.408130:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788639136.408160:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262cafe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.408168:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262cafe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639136.408184:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243992a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+23:2408:x1875523754067584:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 220us (1749us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639136.408201:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 80 00000004:00200000:1.0:1788639136.408214:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788639136.408217:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788639136.408236:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262cafe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.408249:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262cafe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.408268:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262caf0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.408275:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262caf0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.408282:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262caf0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.408288:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fa200 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639136.408292:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262caf0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.408298:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262caf0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.408308:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ae242358d00) 00010000:00010000:1.0:1788639136.408311:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639136.408315:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262caf0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.408320:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262caf0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.408331:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262caf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.408338:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262caf7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.408361:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262caf7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.408373:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fbe00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639136.408375:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262caf7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.408381:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262caf7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.408506:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ae34af01f00) 00010000:00010000:1.0:1788639136.408511:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639136.408516:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262caf7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.408523:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262caf7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.408558:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262cae9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8565a expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.408571:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262cafe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8565a expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639136.408579:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ae34ac63e00) 00010000:00010000:1.0:1788639136.408581:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788639136.408583:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fae00, rc 0) 00000100:00100000:1.0:1788639136.408655:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+22:11425:x1875523754067200:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 15741us (16039us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639136.408662:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 141 00000040:00080000:1.0:1788639137.144295:0:14310:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788639137.144310:0:14310:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788639137.144354:0:14310:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788639137.144362:0:14310:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788639137.207541:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788639137.396856:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788639137.396865:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788639137.396893:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788639137.396902:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788639137.397070:0:13794:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243991500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1875523773009664:192.168.206.18@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788639137.397186:0:13794:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae350c4fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788639137.403896:0:13794:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243991500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1875523773009664:192.168.206.18@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788639137.404327:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639137.405087:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754067712 00000100:00100000:1.0:1788639137.405096:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754067712 00000100:00100000:1.0:1788639137.405197:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 142 00000100:00100000:1.0:1788639137.405208:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243991500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+22:11437:x1875523754067712:12345-192.168.206.18@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788639137.405240:0:6516:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788639137.405360:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243991500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+22:11437:x1875523754067712:12345-192.168.206.18@tcp:53:lhsmtool_posix.0 Request processed in 153us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639137.405367:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 142 00000100:00100000:3.0:1788639137.410412:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639137.410609:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754067968 00000100:00100000:0.0:1788639137.410653:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754067968 00000100:00100000:0.0:1788639137.410709:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 143 00000100:00100000:0.0:1788639137.410720:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3461b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+22:11437:x1875523754067968:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788639137.410748:0:10169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639137.410769:0:10169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5800/0x25c454990262cb05 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85661 expref: -99 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639137.410878:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4e00/0x25c454990262cb0c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639137.410894:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4e00/0x25c454990262cb0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639137.410907:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4e00/0x25c454990262cb0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788639137.410917:0:10169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788639137.411015:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5800/0x25c454990262cb05 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85661 expref: 25 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639137.411037:0:10169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4e00/0x25c454990262cb0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85661 expref: 24 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639137.411046:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ae34ac63e00) 00010000:00010000:0.0:1788639137.411048:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788639137.411171:0:10169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375ef4e00, rc 0) 00000100:00100000:0.0:1788639137.411351:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3461b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+24:11437:x1875523754067968:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 623us (938us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1788639137.411359:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 143 00000100:00100000:0.0:1788639137.415188:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639137.415247:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639137.415499:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754068224 00000100:00100000:1.0:1788639137.415508:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754068224 00000100:00100000:1.0:1788639137.415563:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 144 00000100:00100000:1.0:1788639137.415572:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae343061500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+24:11437:x1875523754068224:12345-192.168.206.18@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788639137.415675:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262cb1a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639137.415697:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262cb1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639137.415709:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262cb1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639137.415716:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754068352 00000100:00100000:2.0:1788639137.415722:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754068352 00000100:00100000:2.0:1788639137.415761:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 9 00000100:00100000:2.0:1788639137.415768:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b60f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+25:2408:x1875523754068352:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788639137.415779:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788639137.415860:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262cb1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639137.415869:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262cb1a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639137.415986:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262cb1a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639137.416001:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4e00/0x25c454990262cb0c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85661 expref: 26 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639137.419435:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ae34ac63e00) 00010000:00010000:2.0:1788639137.419466:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788639137.419649:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b60f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+25:2408:x1875523754068352:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 3875us (4395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639137.419662:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 9 00010000:00010000:1.0:1788639137.420455:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fbe00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639137.420464:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262cb1a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639137.420477:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262cb1a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639137.420493:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ae34ac63e00) 00010000:00010000:1.0:1788639137.420496:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788639137.420500:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262cb1a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639137.420507:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262cb1a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639137.420737:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae343061500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+24:11437:x1875523754068224:12345-192.168.206.18@tcp:57:lhsmtool_posix.0 Request processed in 5156us (5547us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1788639137.420746:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 144 00000040:00080000:3.0:1788639137.421426:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788639137.421432:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788639137.423220:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788639137.423369:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788639137.437433:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639137.437515:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754068608 00000100:00100000:1.0:1788639137.437525:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754068608 00000100:00100000:1.0:1788639137.437581:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 34 00000100:00100000:1.0:1788639137.437591:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae343062680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+24:11437:x1875523754068608:12345-192.168.206.18@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788639137.438304:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae343062680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+25:11437:x1875523754068608:12345-192.168.206.18@tcp:35:lhsmtool_posix.0 Request processed in 711us (877us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1788639137.438314:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 34 00010000:00010000:3.0:1788639138.229710:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639138.484919:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523773009920:0@lo:400:kworker.0 00000100:00100000:1.0:1788639138.485025:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639138.485063:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243958a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875523773010176:0@lo:400:kworker.0 00000100:00100000:1.0:1788639138.485089:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24395bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875523773010432:0@lo:400:kworker.0 00000100:00100000:0.0:1788639138.485112:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639138.485134:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773009920 00000100:00100000:1.0:1788639138.485142:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773009920 00000100:00100000:0.0:1788639138.485155:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243959180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773010688:0@lo:400:kworker.0 00000100:00100000:0.0:1788639138.485183:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639138.485808:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243959f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773011200:0@lo:400:kworker.0 00000100:00100000:0.0:1788639138.485837:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639138.485862:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1788639138.485876:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243959880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523773009792:0@lo:400:kworker.0 00000100:00100000:0.0:1788639138.485916:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639138.485937:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24395ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773010304:0@lo:400:kworker.0 00000100:00100000:0.0:1788639138.485984:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639138.486005:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24395aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773010816:0@lo:400:kworker.0 00000100:00100000:0.0:1788639138.486028:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639138.486045:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243959500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773011328:0@lo:400:kworker.0 00000100:00100000:0.0:1788639138.486066:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639138.486096:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243958700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773010048:0@lo:400:kworker.0 00000100:00100000:0.0:1788639138.486119:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639138.486134:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24395b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875523773010560:0@lo:400:kworker.0 00000100:00100000:0.0:1788639138.487796:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639138.487847:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243958e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875523773011072:0@lo:400:kworker.0 00000100:00100000:2.0:1788639138.487976:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773010688 00000100:00100000:2.0:1788639138.487983:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773010688 00000100:00100000:2.0:1788639138.488031:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773011200 00000100:00100000:2.0:1788639138.488034:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773011200 00000100:00100000:2.0:1788639138.488049:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773010816 00000100:00100000:2.0:1788639138.488051:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773010816 00000100:00100000:0.0:1788639138.488172:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639138.488197:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773011328 00000100:00100000:2.0:1788639138.488202:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773011328 00000100:00100000:2.0:1788639138.488223:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788639138.488232:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae343060700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773010688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639138.488288:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae343060700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773010688:12345-0@lo:400:kworker.0 Request processed in 57us (3103us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639138.488296:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788639138.488312:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788639138.488318:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae343060a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773011200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639138.488366:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae343060a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773011200:12345-0@lo:400:kworker.0 Request processed in 48us (2529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639138.488372:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788639138.488382:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788639138.488553:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae343062300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3641:x1875523773010816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639138.488560:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788639138.488571:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24339ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773011456:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788639138.488579:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773010176 00000100:00100000:1.0:1788639138.488585:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773010176 00000100:00100000:2.0:1788639138.488597:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae343062300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3641:x1875523773010816:12345-0@lo:400:kworker.0 Request processed in 208us (2567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639138.488607:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788639138.488610:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773010560 00000100:00100000:0.0:1788639138.488612:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639138.488637:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773010560 00000100:00100000:1.0:1788639138.488661:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773011072 00000100:00100000:1.0:1788639138.488666:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773011072 00000100:00100000:2.0:1788639138.488670:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788639138.488679:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1875523773011328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639138.488684:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788639138.488700:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24395b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523773009920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639138.488716:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1875523773011328:12345-0@lo:400:kworker.0 Request processed in 37us (2647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639138.488723:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788639138.488745:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773009792 00000100:00100000:2.0:1788639138.488749:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773009792 00000100:00100000:0.0:1788639138.488760:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24395b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523773009920:12345-0@lo:400:kworker.0 Request processed in 54us (3722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639138.488776:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1788639138.488783:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+24:3641:x1875523773009792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639138.488813:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+24:3641:x1875523773009792:12345-0@lo:400:kworker.0 Request processed in 30us (2896us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639138.488818:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00080000:2.0:1788639138.488842:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788639138.488847:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788639138.488849:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788639138.488877:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243959880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523773009792:0@lo:400:kworker.0 00000100:00100000:2.0:1788639138.488893:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24395aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773010816:0@lo:400:kworker.0 00000100:00100000:2.0:1788639138.488903:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243959500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773011328:0@lo:400:kworker.0 00000100:00100000:2.0:1788639138.488912:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243959180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773010688:0@lo:400:kworker.0 00000100:00100000:2.0:1788639138.488921:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243959f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773011200:0@lo:400:kworker.0 00000100:00100000:2.0:1788639138.488957:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773010304 00000100:00100000:2.0:1788639138.488960:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773010304 00000100:00100000:2.0:1788639138.488984:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773010048 00000100:00100000:2.0:1788639138.488987:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773010048 00000100:00100000:2.0:1788639138.489000:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788639138.489005:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae343063b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773010304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639138.489050:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae343063b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773010304:12345-0@lo:400:kworker.0 Request processed in 45us (3066us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639138.489057:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788639138.489199:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788639138.489206:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773010048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639138.489243:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773010048:12345-0@lo:400:kworker.0 Request processed in 38us (3123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639138.489249:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788639138.489570:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24395ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773010304:0@lo:400:kworker.0 00000100:00100000:2.0:1788639138.489658:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639138.489678:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24395a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875523773010944:0@lo:400:kworker.0 00000100:00100000:2.0:1788639138.489703:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639138.489725:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523773009920:0@lo:400:kworker.0 00000100:00100000:2.0:1788639138.489762:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773011456 00000100:00100000:1.0:1788639138.489765:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773010432 00000100:00100000:2.0:1788639138.489767:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773011456 00000100:00100000:1.0:1788639138.489772:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773010432 00000100:00100000:2.0:1788639138.489799:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788639138.489807:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773010944 00000100:00100000:0.0:1788639138.489808:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788639138.489811:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773011456:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788639138.489812:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773010944 00000100:00100000:0.0:1788639138.489839:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00002000:00000024:2.0:1788639138.489840:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788639138.489850:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae343063100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875523773010176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639138.489881:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773011456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (1270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639138.489888:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788639138.489905:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae343063100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875523773010176:12345-0@lo:400:kworker.0 Request processed in 56us (4791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639138.489914:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788639138.489927:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788639138.489928:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875523773010560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639138.489950:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788639138.489963:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788639138.489968:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875523773011072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639138.489970:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875523773010560:12345-0@lo:400:kworker.0 Request processed in 47us (3780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639138.489979:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24339bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875523773010432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639138.489992:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1788639138.490011:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788639138.490019:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24339b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875523773010944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639138.490035:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24339bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875523773010432:12345-0@lo:400:kworker.0 Request processed in 60us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639138.490043:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1788639138.490059:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24339b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875523773010944:12345-0@lo:400:kworker.0 Request processed in 40us (354us total) trans 0 rc 0/0 00000100:00080000:1.0:1788639138.490066:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788639138.490081:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788639138.490143:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875523773011072:12345-0@lo:400:kworker.0 Request processed in 182us (1969us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639138.490152:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788639138.490169:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24395bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875523773010432:0@lo:400:kworker.0 00000100:00100000:0.0:1788639138.490261:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243958a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875523773010176:0@lo:400:kworker.0 00000100:00100000:2.0:1788639138.490713:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24339ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773011456:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788639138.490731:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243958700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773010048:0@lo:400:kworker.0 00010000:00080000:2.0:1788639138.490744:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae24395b100 x1875523773010560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639138.490753:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24395b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875523773010560:0@lo:400:kworker.0 00010000:00080000:2.0:1788639138.490764:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae243958e00 x1875523773011072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639138.490773:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243958e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875523773011072:0@lo:400:kworker.0 00000100:00100000:1.0:1788639138.490972:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24395a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875523773010944:0@lo:400:kworker.0 00000040:00080000:0.0:1788639138.860135:0:14362:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788639138.860146:0:14362:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788639138.860178:0:14362:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788639138.860191:0:14362:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788639138.984961:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639138.985095:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754068864 00000100:00100000:3.0:1788639138.985104:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754068864 00000100:00100000:3.0:1788639138.985178:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 145 00000100:00100000:3.0:1788639138.985188:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24339ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+25:11458:x1875523754068864:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:3.0:1788639138.985209:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639138.985227:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262cb21 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85668 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639138.985322:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8600/0x25c454990262cb28 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639138.985348:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8600/0x25c454990262cb28 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639138.985361:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8600/0x25c454990262cb28 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788639138.985371:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788639138.985472:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262cb21 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85668 expref: 28 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639138.985493:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8600/0x25c454990262cb28 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85668 expref: 27 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639138.985501:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ae34ac63e00) 00010000:00010000:3.0:1788639138.985518:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788639138.985523:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f8600, rc 0) 00000100:00100000:3.0:1788639138.985571:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24339ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+27:11458:x1875523754068864:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 385us (619us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1788639138.985578:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 145 00000100:00080000:2.0:1788639138.985660:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788639138.988036:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639138.988361:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754068992 00000100:00100000:2.0:1788639138.988370:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754068992 00000100:00100000:2.0:1788639138.988425:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 146 00000100:00100000:2.0:1788639138.988436:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+27:11458:x1875523754068992:12345-192.168.206.18@tcp:54:lfs.0 00010000:00010000:2.0:1788639138.988491:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262cb36 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639138.988509:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262cb36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639138.988527:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262cb36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639138.988559:0:10169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262cb36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639138.988567:0:10169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262cb36 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639138.988573:0:10169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262cb36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639138.988579:0:10169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78aa00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639138.988584:0:10169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262cb36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639138.988591:0:10169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262cb36 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639138.988602:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ae34ac63e00) 00010000:00010000:2.0:1788639138.988605:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788639138.988610:0:10169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262cb36 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639138.988639:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78aa00/0x25c454990262cb36 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639138.988702:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+27:11458:x1875523754068992:12345-192.168.206.18@tcp:54:lfs.0 Request processed in 267us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639138.988709:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 146 00000100:00100000:2.0:1788639139.002099:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243150a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773011584:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788639139.002166:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639139.002222:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773011584 00000100:00100000:1.0:1788639139.002229:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773011584 00000100:00100000:3.0:1788639139.002263:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24395a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773011712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788639139.002280:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788639139.002292:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243399180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773011584:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788639139.002307:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:1.0:1788639139.002324:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788639139.005144:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773011712 00000100:00100000:3.0:1788639139.005157:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773011712 00000100:00100000:3.0:1788639139.005285:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788639139.005295:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3461b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875523773011712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788639139.005316:0:13805:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788639139.005857:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3461b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875523773011712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 562us (3549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639139.005867:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788639139.006982:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24395a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773011712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788639139.015005:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243150a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773011584:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788639139.015273:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243399180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773011584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 11424us (11547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639139.015284:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788639139.063764:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639139.063926:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754069120 00000100:00100000:2.0:1788639139.063936:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754069120 00000100:00100000:2.0:1788639139.064009:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 53 00000100:00100000:2.0:1788639139.064021:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3461b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2408:x1875523754069120:12345-192.168.206.18@tcp:101:cat.0 00010000:00010000:2.0:1788639139.064037:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1788639139.064048:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788639139.064056:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6600111/0x25c454990262cb3d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e8566f expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788639139.064081:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9c779f, atime: 0x6a9c779f, ctime: 0x6a9c779f, blocks: 0x8 00010000:00010000:2.0:1788639139.064101:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=397s v=(0 0) 00010000:00010000:2.0:1788639139.064104:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788639139.064113:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6600111/0x25c454990262cb3d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8566f expref: 7 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639139.064130:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6600111/0x25c454990262cb3d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8566f expref: 7 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639139.064142:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78aa00, rc 0) 00000100:00100000:2.0:1788639139.064214:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3461b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+7:2408:x1875523754069120:12345-192.168.206.18@tcp:101:cat.0 Request processed in 195us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639139.064221:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 53 00000100:00100000:2.0:1788639139.067401:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639139.067501:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754069248 00000100:00100000:3.0:1788639139.067511:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754069248 00002000:00100000:3.0:1788639139.067557:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9ae24339aa00 x1875523754069248/t0(0) o3->5deb128c-4fe3-4f51-b21e-f30846e08445@192.168.206.18@tcp:360/0 lens 488/0 e 0 to 0 dl 1788639150 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788639139.067567:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae24339aa00 with x1875523754069248 ext(0->4095) 00002000:00010000:3.0:1788639139.067574:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ae24339aa00 00000100:00100000:3.0:1788639139.067606:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 3 00000100:00100000:3.0:1788639139.067648:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24339aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+7:2407:x1875523754069248:12345-192.168.206.18@tcp:3:cat.0 00000100:00100000:3.0:1788639139.067826:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24339aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+7:2407:x1875523754069248:12345-192.168.206.18@tcp:3:cat.0 Request processed in 210us (433us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788639139.067834:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 3 00002000:00100000:3.0:1788639139.067855:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9ae24339aa00 x1875523754069248/t0(0) o3->5deb128c-4fe3-4f51-b21e-f30846e08445@192.168.206.18@tcp:360/0 lens 488/4536 e 0 to 0 dl 1788639150 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788639139.067865:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae24339aa00 with x1875523754069248 ext(0->4095) 00002000:00010000:3.0:1788639139.067869:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ae24339aa00 00010000:00010000:1.0:1788639139.253802:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639139.514021:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788639139.514045:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24339a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773011840:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788639139.514113:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639139.514496:0:12414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773011840 00000100:00100000:2.0:1788639139.514520:0:12414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773011840 00000100:00100000:2.0:1788639139.514578:0:12414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788639139.514587:0:12414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243152d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773011840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788639139.514656:0:12414:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788639139.514712:0:12414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243152d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773011840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 127us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639139.514720:0:12414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788639139.514809:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24339a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773011840:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788639139.807533:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639139.807673:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639139.807698:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639139.807755:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754069760 00000100:00100000:0.0:1788639139.807765:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754069760 00000100:00100000:0.0:1788639139.807827:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 118 00000100:00100000:0.0:1788639139.807838:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24395a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+7:2405:x1875523754069760:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639139.807915:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24395a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+7:2405:x1875523754069760:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 79us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639139.807922:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 118 00000100:00100000:1.0:1788639139.808307:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639139.808350:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639139.808473:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754069376 00000100:00100000:0.0:1788639139.808477:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754069376 00000100:00100000:0.0:1788639139.808506:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 380 00000100:00100000:0.0:1788639139.808513:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+13:2405:x1875523754069376:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639139.808546:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+13:2405:x1875523754069376:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 33us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639139.808553:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 380 00000100:00100000:2.0:1788639139.809382:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754069504 00000100:00100000:2.0:1788639139.809390:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754069504 00000100:00100000:2.0:1788639139.809434:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754070016 00000100:00100000:2.0:1788639139.809438:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754070016 00000100:00100000:2.0:1788639139.809472:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 280 00000100:00100000:2.0:1788639139.809479:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24395bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+27:2405:x1875523754069504:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639139.809527:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24395bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+27:2405:x1875523754069504:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 48us (2005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639139.809534:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 280 00000100:00100000:2.0:1788639139.809550:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 281 00000100:00100000:2.0:1788639139.809556:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243959c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2405:x1875523754070016:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639139.809580:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243959c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2405:x1875523754070016:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 24us (1882us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639139.809587:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 281 00000100:00080000:0.0:1788639139.809772:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788639139.810210:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754069632 00000100:00100000:3.0:1788639139.810217:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754069632 00000100:00100000:2.0:1788639139.810357:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 282 00000100:00100000:2.0:1788639139.810366:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24395b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2405:x1875523754069632:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639139.810405:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24395b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2405:x1875523754069632:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 41us (2055us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639139.810427:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 282 00000100:00080000:0.0:1788639139.810572:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788639139.810670:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639139.810706:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639139.810856:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754069888 00000100:00100000:3.0:1788639139.810861:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754069888 00000100:00100000:3.0:1788639139.810908:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 119 00000100:00100000:3.0:1788639139.810917:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24395a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2405:x1875523754069888:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639139.810946:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24395a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2405:x1875523754069888:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 31us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639139.810953:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 119 00000100:00100000:0.0:1788639139.811187:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754070144 00000100:00100000:0.0:1788639139.811192:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754070144 00000100:00100000:0.0:1788639139.811230:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 283 00000100:00100000:0.0:1788639139.811237:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243958e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2405:x1875523754070144:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639139.811264:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243958e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2405:x1875523754070144:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 28us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639139.811281:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 283 00000100:00080000:1.0:1788639139.811590:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788639139.811594:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788639140.282942:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639141.044816:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243153800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773011968:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788639141.045027:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788639141.045668:0:8828:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 399840050114ns, next at 400840047806ns, rc = 0 00000100:00100000:3.0:1788639141.045702:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3461b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773012096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788639141.045734:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639141.050880:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773011968 00000100:00100000:0.0:1788639141.050893:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773011968 00000100:00100000:0.0:1788639141.051206:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773012096 00000100:00100000:0.0:1788639141.051275:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773012096 00000100:00100000:0.0:1788639141.051305:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788639141.051315:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24395b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773011968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788639141.051373:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788639141.051529:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24395b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773011968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 214us (6501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639141.051538:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788639141.051889:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788639141.051897:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3461b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1875523773012096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788639141.051910:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788639141.051992:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3461b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1875523773012096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (6257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639141.051998:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:0.0:1788639141.052035:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788639141.052084:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243153800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773011968:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788639141.053018:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3461b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773012096:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788639141.301125:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788639142.071782:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000001:00080000:1.0:1788639142.071850:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:1.0:1788639142.071876:0:6494:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ae3498cb540 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1788639142.071881:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ae24314dc00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ae3498cbb40 00000020:00080000:1.0:1788639142.071894:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ae24314d300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ae348fbce00 00000020:00080000:1.0:1788639142.071913:0:6494:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1788639142.071946:0:6548:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1788639142.072048:0:6548:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:2.0:1788639142.072083:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:1.0:1788639142.073356:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3461b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773012224:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788639142.073422:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639142.073581:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773012224 00000100:00100000:2.0:1788639142.073594:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773012224 00010000:00010000:0.0:1788639142.073600:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262cab8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639142.073654:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262cab8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639142.073662:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262cab8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639142.073678:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef4000 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639142.073683:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262cab8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639142.073691:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262cab8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639142.073708:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ae34af01600) 00010000:00010000:0.0:1788639142.073711:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639142.073716:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262cab8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639142.073721:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262cab8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788639142.074249:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:3.0:1788639142.074259:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000100:00100000:2.0:1788639142.074578:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788639142.074591:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243958700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773012224:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788639142.075761:0:8430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788639142.075768:0:8430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1788639135 -> 1788639135 00002000:00010000:2.0:1788639142.075770:0:8430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 1788639135 -> 1788639135 00002000:00010000:2.0:1788639142.075772:0:8430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1788639135 -> 1788639135 00002000:00010000:2.0:1788639142.075775:0:8430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788639142.076065:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243958700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1875523773012224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1475us (2641us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1788639142.076076:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788639142.076246:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1788639142.076252:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ae243991f80, transno 4294967310 00000004:00080000:1.0:1788639142.076273:0:3641:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1788639142.076297:0:3641:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9ae3461b5f80 x1875523773012224/t4294967313(4294967313) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788639158 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788639142.076309:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ae3461b5f80/2, rc 0, transno 4294967313 00000100:00100000:1.0:1788639142.076313:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3461b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773012224:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1788639142.325007:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639142.975262:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639142.975419:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754070272 00000100:00100000:0.0:1788639142.975429:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754070272 00000100:00100000:0.0:1788639142.975549:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 147 00000100:00100000:0.0:1788639142.975561:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243398e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+13:11103:x1875523754070272:12345-192.168.206.18@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788639142.975714:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243398e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+13:11103:x1875523754070272:12345-192.168.206.18@tcp:60:lhsmtool_posix.0 Request processed in 155us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639142.975721:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 147 00000100:00080000:1.0:1788639142.975976:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788639142.981802:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639142.981912:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754070400 00000100:00100000:3.0:1788639142.981921:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754070400 00000100:00100000:3.0:1788639142.982056:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 148 00000100:00100000:3.0:1788639142.982067:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243399f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+5:11103:x1875523754070400:12345-192.168.206.18@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788639142.982172:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243399f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+5:11103:x1875523754070400:12345-192.168.206.18@tcp:60:lhsmtool_posix.0 Request processed in 107us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639142.982180:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 148 00000100:00080000:1.0:1788639142.982510:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788639142.992386:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639142.992573:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754070656 00000100:00100000:0.0:1788639142.992587:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754070656 00000100:00100000:0.0:1788639142.992691:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 35 00000100:00100000:0.0:1788639142.992703:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3461b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+13:11103:x1875523754070656:12345-192.168.206.18@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788639142.992950:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3461b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+14:11103:x1875523754070656:12345-192.168.206.18@tcp:35:lhsmtool_posix.0 Request processed in 249us (577us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1788639142.992971:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 35 00000100:00100000:2.0:1788639143.207431:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639143.207533:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754070784 00000100:00100000:3.0:1788639143.207547:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754070784 00000100:00100000:3.0:1788639143.207793:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 149 00000100:00100000:3.0:1788639143.207807:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243399500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:11916:x1875523754070784:12345-192.168.206.18@tcp:101:lsof.0 00010000:00010000:3.0:1788639143.207834:0:11314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1788639143.209540:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788639143.209557:0:11314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262cb44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85676 expref: -99 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639143.209659:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9400/0x25c454990262cb4b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639143.209727:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9400/0x25c454990262cb4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639143.209748:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9400/0x25c454990262cb4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788639143.209903:0:11314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788639143.209908:0:11314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788639143.209954:0:11314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9400/0x25c454990262cb4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639143.209981:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262cb44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85676 expref: 7 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639143.211002:0:11314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9400/0x25c454990262cb4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85676 expref: 6 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639143.211016:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae362514000) 00010000:00010000:3.0:1788639143.211018:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788639143.211022:0:11314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f9400, rc 0) 00000100:00100000:3.0:1788639143.211093:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243399500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+6:11916:x1875523754070784:12345-192.168.206.18@tcp:101:lsof.0 Request processed in 3288us (3674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639143.211102:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 149 00010000:00010000:3.0:1788639143.352547:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639143.604980:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24395ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773012608:0@lo:400:kworker.0 00000100:00100000:3.0:1788639143.605087:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523773012480:0@lo:400:kworker.0 00000100:00100000:3.0:1788639143.605170:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639143.605241:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243959500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875523773012992:0@lo:400:kworker.0 00000100:00100000:3.0:1788639143.605265:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639143.605297:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2433a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875523773013504:0@lo:400:kworker.0 00000100:00100000:0.0:1788639143.605376:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243959f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875523773012736:0@lo:400:kworker.0 00000100:00100000:0.0:1788639143.605431:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639143.605449:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243959880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773013248:0@lo:400:kworker.0 00000100:00100000:0.0:1788639143.605472:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639143.605489:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773013760:0@lo:400:kworker.0 00000100:00100000:0.0:1788639143.605511:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639143.605532:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1788639143.605539:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243958a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523773012352:0@lo:400:kworker.0 00000100:00100000:0.0:1788639143.605577:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639143.605598:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243959180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773012864:0@lo:400:kworker.0 00000100:00100000:0.0:1788639143.605645:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639143.605670:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f785500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773013376:0@lo:400:kworker.0 00000100:00100000:3.0:1788639143.605816:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639143.605863:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773013248 00000100:00100000:3.0:1788639143.605872:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773013248 00000100:00100000:3.0:1788639143.605920:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773013760 00000100:00100000:3.0:1788639143.605923:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773013760 00000100:00100000:3.0:1788639143.605945:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788639143.605955:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243150a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773013248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639143.606006:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243150a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773013248:12345-0@lo:400:kworker.0 Request processed in 53us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639143.606013:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788639143.606146:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773012352 00000100:00100000:0.0:1788639143.606157:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639143.606158:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773012352 00000100:00100000:0.0:1788639143.606181:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242f0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773013888:0@lo:400:kworker.0 00000100:00100000:0.0:1788639143.606212:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639143.606227:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1788639143.606239:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370fff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+24:3641:x1875523773012352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639143.606251:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243959880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773013248:0@lo:400:kworker.0 00000100:00100000:0.0:1788639143.606290:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773012480 00000100:00100000:0.0:1788639143.606295:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773012480 00000100:00100000:2.0:1788639143.606346:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370fff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+24:3641:x1875523773012352:12345-0@lo:400:kworker.0 Request processed in 107us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639143.606352:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773012992 00000100:00100000:2.0:1788639143.606358:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1788639143.606358:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773012992 00000100:00100000:0.0:1788639143.606376:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773012736 00000100:00100000:0.0:1788639143.606381:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773012736 00000100:00100000:0.0:1788639143.606401:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773013504 00000100:00100000:0.0:1788639143.606404:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773013504 00000100:00100000:2.0:1788639143.606436:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773013376 00000100:00100000:2.0:1788639143.606443:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773013376 00000100:00100000:0.0:1788639143.606448:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788639143.606463:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3461b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523773012480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639143.606517:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3461b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523773012480:12345-0@lo:400:kworker.0 Request processed in 60us (1348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639143.606524:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788639143.606541:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788639143.606547:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3461b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875523773012992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639143.606575:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3461b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875523773012992:12345-0@lo:400:kworker.0 Request processed in 28us (1309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639143.606581:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788639143.606592:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788639143.606597:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243153800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875523773012736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639143.606644:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243153800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875523773012736:12345-0@lo:400:kworker.0 Request processed in 47us (1213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639143.606650:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788639143.606663:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1788639143.606669:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36d1ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875523773013504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639143.607549:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639143.607566:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773013888 00000100:00100000:3.0:1788639143.607572:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773013888 00000100:00100000:1.0:1788639143.607580:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24395aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875523773013120:0@lo:400:kworker.0 00000100:00100000:1.0:1788639143.607609:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639143.607611:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36d1ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875523773013504:12345-0@lo:400:kworker.0 Request processed in 26us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639143.607637:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1788639143.607650:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773013120 00000100:00100000:0.0:1788639143.607653:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773013120 00000100:00100000:0.0:1788639143.607671:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1788639143.607676:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243935c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875523773013120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639143.607725:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243935c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875523773013120:12345-0@lo:400:kworker.0 Request processed in 48us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639143.607739:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1788639143.607783:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243959500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875523773012992:0@lo:400:kworker.0 00000100:00100000:0.0:1788639143.607796:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2433a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875523773013504:0@lo:400:kworker.0 00000100:00100000:0.0:1788639143.607807:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523773012480:0@lo:400:kworker.0 00000100:00100000:0.0:1788639143.607855:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773012864 00000100:00100000:0.0:1788639143.607859:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773012864 00000100:00100000:0.0:1788639143.607882:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773012608 00000100:00100000:0.0:1788639143.607895:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773012608 00000100:00100000:0.0:1788639143.607912:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788639143.607918:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773012864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639143.607952:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773012864:12345-0@lo:400:kworker.0 Request processed in 34us (2311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639143.607958:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788639143.607970:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788639143.607975:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773012608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639143.608003:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773012608:12345-0@lo:400:kworker.0 Request processed in 28us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639143.608009:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788639143.608111:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243958a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523773012352:0@lo:400:kworker.0 00000100:00100000:0.0:1788639143.608122:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243959180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773012864:0@lo:400:kworker.0 00000100:00100000:0.0:1788639143.608133:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243959f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875523773012736:0@lo:400:kworker.0 00000100:00100000:0.0:1788639143.608159:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f816300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773014016:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788639143.608186:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639143.608222:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773014016 00000100:00100000:0.0:1788639143.608226:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773014016 00000100:00100000:0.0:1788639143.608250:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788639143.608257:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f814700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875523773014016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788639143.608277:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788639143.608319:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f814700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875523773014016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639143.608326:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00010000:00080000:1.0:1788639143.608338:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae24395aa00 x1875523773013120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639143.608349:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24395aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875523773013120:0@lo:400:kworker.0 00000100:00100000:0.0:1788639143.608353:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f816300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773014016:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788639143.608356:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2433a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875523773013632:0@lo:400:kworker.0 00000100:00100000:1.0:1788639143.608380:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639143.608411:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24395ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773012608:0@lo:400:kworker.0 00000100:00100000:1.0:1788639143.608430:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773013632 00000100:00100000:1.0:1788639143.608433:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773013632 00000100:00100000:1.0:1788639143.608459:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788639143.608465:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243937480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875523773013632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639143.608498:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243937480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875523773013632:12345-0@lo:400:kworker.0 Request processed in 34us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639143.608512:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00010000:00080000:1.0:1788639143.608539:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2433a5c00 x1875523773013632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639143.608549:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2433a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875523773013632:0@lo:400:kworker.0 00000100:00100000:2.0:1788639143.609741:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788639143.609768:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae360687b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773013760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639143.609793:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788639143.609811:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1875523773013376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639143.609879:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1875523773013376:12345-0@lo:400:kworker.0 Request processed in 76us (4184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639143.609999:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788639143.610068:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae360687b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773013760:12345-0@lo:400:kworker.0 Request processed in 313us (4554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639143.610208:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788639143.610222:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f817480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773013888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639143.610265:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f817480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773013888:12345-0@lo:400:kworker.0 Request processed in 48us (4055us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639143.610272:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:0.0:1788639143.610322:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788639143.610328:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788639143.610331:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788639143.610333:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788639143.610455:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f785500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773013376:0@lo:400:kworker.0 00000100:00100000:0.0:1788639143.610467:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:0.0:1788639143.610471:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ae243958380, transno 4294967305 00000100:00100000:0.0:1788639143.610483:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242f0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773013888:0@lo:400:kworker.0 00000100:00100000:0.0:1788639143.610495:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773013760:0@lo:400:kworker.0 00000100:00100000:2.0:1788639143.618875:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000040:00080000:1.0:1788639143.989545:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788639144.117143:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788639144.117166:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f816300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773014144:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788639144.117245:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639144.117430:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773014144 00000100:00100000:0.0:1788639144.117438:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773014144 00000100:00100000:0.0:1788639144.117518:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788639144.117742:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773014144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788639144.117775:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788639144.117839:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773014144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639144.117932:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f816300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773014144:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788639144.117962:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773014272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788639144.118005:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639144.118072:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773014272 00000100:00100000:2.0:1788639144.118082:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773014272 00000100:00100000:2.0:1788639144.118151:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788639144.118160:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243935500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773014272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788639144.118186:0:13805:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788639144.118260:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243935500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773014272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639144.118267:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788639144.118324:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773014272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788639144.121666:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00010000:00010000:1.0:1788639144.372967:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788639144.564906:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788639144.564915:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788639144.564993:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1788639144.565006:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788639144.629299:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788639144.629343:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24339b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773014400:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788639144.629446:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639144.629498:0:12414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773014400 00000100:00100000:0.0:1788639144.629513:0:12414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773014400 00000100:00100000:0.0:1788639144.629769:0:12414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788639144.629781:0:12414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773014400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788639144.629819:0:12414:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788639144.629948:0:12414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773014400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 169us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639144.629955:0:12414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788639144.630037:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24339b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773014400:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788639144.939703:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639144.939742:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639144.939842:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754070912 00000100:00100000:0.0:1788639144.939852:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754070912 00000100:00100000:0.0:1788639144.939907:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 382 00000100:00100000:0.0:1788639144.939916:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+13:2405:x1875523754070912:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639144.939988:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+13:2405:x1875523754070912:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 73us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639144.939997:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 382 00000100:00100000:1.0:1788639144.940009:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754071040 00000100:00100000:1.0:1788639144.940015:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754071040 00000100:00100000:1.0:1788639144.940076:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 290 00000100:00100000:1.0:1788639144.940085:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24339b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+14:2405:x1875523754071040:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:1.0:1788639144.940123:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24339b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+14:2405:x1875523754071040:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 40us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639144.940142:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 290 00000100:00080000:0.0:1788639144.940478:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788639144.949082:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639144.949175:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639144.949210:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639144.949279:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754071424 00000100:00100000:0.0:1788639144.949290:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754071424 00000100:00080000:2.0:1788639144.949374:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788639144.949385:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 124 00000100:00100000:0.0:1788639144.949397:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f829c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2405:x1875523754071424:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639144.949468:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f829c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2405:x1875523754071424:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 73us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639144.949490:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 124 00000100:00100000:1.0:1788639144.949863:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639144.949902:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639144.949947:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754071296 00000100:00100000:2.0:1788639144.949952:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754071296 00000100:00100000:2.0:1788639144.950000:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 125 00000100:00100000:2.0:1788639144.950008:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2405:x1875523754071296:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639144.950047:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2405:x1875523754071296:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 40us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639144.950061:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 125 00000100:00080000:2.0:1788639144.950116:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788639144.950566:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754071168 00000100:00100000:3.0:1788639144.950572:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754071168 00000100:00100000:3.0:1788639144.950636:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754071680 00000100:00100000:3.0:1788639144.950640:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754071680 00000100:00100000:3.0:1788639144.950667:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 291 00000100:00100000:3.0:1788639144.950674:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243935880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2405:x1875523754071168:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639144.950715:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243935880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2405:x1875523754071168:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 42us (1746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639144.950722:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 291 00000100:00100000:3.0:1788639144.950736:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 292 00000100:00100000:3.0:1788639144.950742:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f82b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2405:x1875523754071680:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639144.950774:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f82b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2405:x1875523754071680:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 31us (1562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639144.950794:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 292 00000100:00100000:3.0:1788639144.950806:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754071552 00000100:00100000:3.0:1788639144.950809:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754071552 00000100:00100000:3.0:1788639144.950824:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 293 00000100:00100000:3.0:1788639144.950830:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+6:2405:x1875523754071552:12345-192.168.206.18@tcp:400:kworker.0 00000100:00080000:2.0:1788639144.950933:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788639144.952759:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+6:2405:x1875523754071552:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 1920us (2848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639144.952773:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 293 00010000:00010000:2.0:1788639145.396869:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788639146.099499:0:14559:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 16:12:25 (1788639145) 00000100:00100000:1.0:1788639146.165222:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788639146.165246:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3505d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773014528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788639146.165337:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639146.165565:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773014528 00000100:00100000:3.0:1788639146.165573:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773014528 00000100:00100000:3.0:1788639146.165651:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788639146.165663:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875523773014528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788639146.165688:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788639146.165735:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875523773014528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639146.165742:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:0.0:1788639146.165928:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788639146.166240:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3505d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773014528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788639146.166356:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3505d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773014656:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788639146.166388:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639146.166458:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773014656 00000100:00100000:0.0:1788639146.166463:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773014656 00000100:00100000:0.0:1788639146.166502:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788639146.166509:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773014656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788639146.166523:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788639146.168555:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773014656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2037us (2157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639146.168567:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:0.0:1788639146.168602:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788639146.168746:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3505d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773014656:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788639146.421184:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639147.228348:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639147.228996:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754071936 00000100:00100000:0.0:1788639147.229008:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754071936 00000100:00100000:0.0:1788639147.229094:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 150 00000100:00100000:0.0:1788639147.229104:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+14:12182:x1875523754071936:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788639147.229123:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639147.229143:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262cb52 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e8567d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639147.229212:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262cb59 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639147.229226:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262cb59 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639147.229239:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262cb59 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639147.229327:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5200/0x25c454990262cb60 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639147.229336:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5200/0x25c454990262cb60 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639147.229344:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5200/0x25c454990262cb60 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639147.229437:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5400/0x25c454990262cb67 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639147.229446:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5400/0x25c454990262cb67 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639147.229453:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5400/0x25c454990262cb67 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788639147.229462:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788639147.229549:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262cb59 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639147.229556:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262cb59 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639147.229563:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262cb59 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639147.229569:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef5a00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639147.229573:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262cb59 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639147.229591:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262cb59 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639147.229602:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ae242359200) 00010000:00010000:0.0:1788639147.229605:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639147.229610:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262cb59 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639147.229656:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262cb59 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639147.229686:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5200/0x25c454990262cb60 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639147.229693:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5200/0x25c454990262cb60 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639147.229699:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5200/0x25c454990262cb60 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639147.229703:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef5200 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639147.229706:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5200/0x25c454990262cb60 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639147.229712:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5200/0x25c454990262cb60 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639147.229720:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9ae2430f5a00) 00010000:00010000:0.0:1788639147.229722:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639147.229725:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5200/0x25c454990262cb60 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639147.229741:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5200/0x25c454990262cb60 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639147.230014:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262cb52 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8567d expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639147.230032:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5400/0x25c454990262cb67 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8567d expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639147.230040:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ae34af01b00) 00010000:00010000:0.0:1788639147.230042:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639147.230045:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375ef5400, rc 0) 00000100:00100000:0.0:1788639147.230104:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+16:12182:x1875523754071936:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 1001us (1765us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1788639147.230111:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 150 00000100:00080000:2.0:1788639147.230380:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1788639147.237744:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967418 is committed 00000100:00100000:1.0:1788639147.237754:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000020:00080000:3.0:1788639147.237766:0:6494:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1788639147.237839:0:6548:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1788639147.237849:0:6548:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1788639147.240694:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639147.240818:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754072192 00000100:00100000:0.0:1788639147.240828:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754072192 00000100:00100000:0.0:1788639147.240902:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 151 00000100:00100000:0.0:1788639147.240912:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243952a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+14:12182:x1875523754072192:12345-192.168.206.18@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788639147.241222:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243952a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+14:12182:x1875523754072192:12345-192.168.206.18@tcp:59:lhsmtool_posix.0 Request processed in 310us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639147.241230:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 151 00000100:00100000:2.0:1788639147.241856:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754072064 00000100:00100000:2.0:1788639147.241863:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754072064 00000100:00100000:2.0:1788639147.241909:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 10 00000100:00100000:2.0:1788639147.241918:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243950000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+14:2406:x1875523754072064:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788639147.241929:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788639147.241951:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5400/0x25c454990262cb67 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8567d expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639147.241973:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ae34af01b00) 00010000:00010000:2.0:1788639147.241978:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788639147.242012:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243950000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+13:2406:x1875523754072064:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 96us (4671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639147.242019:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 10 00000100:00100000:1.0:1788639147.245533:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639147.246600:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754072320 00000100:00100000:3.0:1788639147.246612:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754072320 00000100:00100000:3.0:1788639147.246712:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 152 00000100:00100000:3.0:1788639147.246725:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243953800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+5:12182:x1875523754072320:12345-192.168.206.18@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788639147.246822:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243953800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+5:12182:x1875523754072320:12345-192.168.206.18@tcp:59:lhsmtool_posix.0 Request processed in 101us (1302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639147.246859:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 152 00000100:00080000:2.0:1788639147.246971:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788639147.446927:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788639147.636820:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788639147.636829:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788639147.636848:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1788639147.636854:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788639148.085248:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:0.0:1788639148.220228:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00010000:00010000:2.0:1788639148.469821:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639148.724887:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae37f815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773014784:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788639148.724979:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639148.725090:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773014784 00000100:00100000:0.0:1788639148.725097:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773014784 00000100:00100000:0.0:1788639148.725164:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788639148.725174:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242176680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773014784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788639148.725202:0:13805:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788639148.725251:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242176680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773014784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639148.725258:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788639148.725312:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae37f815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773014784:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788639148.725363:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788639148.725766:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242174380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773015168:0@lo:400:kworker.0 00000100:00100000:1.0:1788639148.725798:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639148.725823:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242174a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875523773015680:0@lo:400:kworker.0 00000100:00100000:1.0:1788639148.725846:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639148.725862:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242175180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875523773016192:0@lo:400:kworker.0 00000100:00100000:1.0:1788639148.725882:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639148.725900:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788639148.725904:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875523773015040:0@lo:400:kworker.0 00000100:00100000:1.0:1788639148.725922:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639148.725937:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242174700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875523773015552:0@lo:400:kworker.0 00000100:00100000:1.0:1788639148.725955:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639148.725969:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242177100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875523773016064:0@lo:400:kworker.0 00000100:00100000:1.0:1788639148.725994:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639148.726023:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773015680 00000100:00100000:1.0:1788639148.726028:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773015680 00000100:00100000:1.0:1788639148.726053:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773016192 00000100:00100000:1.0:1788639148.726056:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773016192 00000100:00100000:1.0:1788639148.726067:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773015040 00000100:00100000:1.0:1788639148.726069:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773015040 00000100:00100000:1.0:1788639148.726079:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773015552 00000100:00100000:1.0:1788639148.726081:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773015552 00000100:00100000:1.0:1788639148.726089:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773016064 00000100:00100000:1.0:1788639148.726215:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773016064 00000100:00100000:1.0:1788639148.726236:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1788639148.726242:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242174e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875523773015680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639148.726297:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242174e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875523773015680:12345-0@lo:400:kworker.0 Request processed in 41us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639148.726304:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1788639148.726316:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1788639148.726321:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242175f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875523773016192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639148.726344:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242175f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875523773016192:12345-0@lo:400:kworker.0 Request processed in 23us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639148.726349:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1788639148.726356:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1788639148.726361:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242175500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875523773015040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639148.726382:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242175500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875523773015040:12345-0@lo:400:kworker.0 Request processed in 21us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639148.726387:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1788639148.726396:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1788639148.726401:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242177800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875523773015552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639148.726423:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242177800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875523773015552:12345-0@lo:400:kworker.0 Request processed in 22us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639148.726434:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1788639148.726445:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1788639148.726451:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875523773016064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639148.726487:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875523773016064:12345-0@lo:400:kworker.0 Request processed in 36us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639148.726493:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00080000:1.0:1788639148.726514:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788639148.726517:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788639148.726529:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242175c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01f1eef9-e690-4065-bf99-bf821af7b626:3642:1875523773014912:0@lo:400:kworker.0 00000100:00100000:1.0:1788639148.726537:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875523773015040:0@lo:400:kworker.0 00000100:00100000:1.0:1788639148.726546:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242174700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875523773015552:0@lo:400:kworker.0 00000100:00100000:1.0:1788639148.726554:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242177100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875523773016064:0@lo:400:kworker.0 00000100:00100000:3.0:1788639148.726565:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639148.726660:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773015168 00000100:00100000:0.0:1788639148.726665:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773015168 00000100:00100000:2.0:1788639148.726708:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773014912 00000100:00100000:2.0:1788639148.726712:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773014912 00000100:00100000:2.0:1788639148.726739:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1788639148.726745:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+24:3642:x1875523773014912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639148.726949:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788639148.726957:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242176300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773015168:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1788639148.728234:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae242174a80 x1875523773015680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639148.728250:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242174a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875523773015680:0@lo:400:kworker.0 00010000:00080000:1.0:1788639148.728266:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae242175180 x1875523773016192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639148.728275:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242175180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875523773016192:0@lo:400:kworker.0 00000100:00100000:1.0:1788639148.728443:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242175880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875523773015296:0@lo:400:kworker.0 00000100:00100000:3.0:1788639148.728450:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242174000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773015424:0@lo:400:kworker.0 00000100:00100000:1.0:1788639148.728486:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639148.728487:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639148.728507:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242177b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773015936:0@lo:400:kworker.0 00000100:00100000:1.0:1788639148.728507:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242176d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773015808:0@lo:400:kworker.0 00000100:00100000:1.0:1788639148.728528:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639148.728545:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639148.728545:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773016320:0@lo:400:kworker.0 00000100:00100000:1.0:1788639148.728574:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639148.728587:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773015296 00000100:00100000:3.0:1788639148.728591:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773015296 00000100:00100000:3.0:1788639148.728644:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1788639148.728652:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875523773015296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639148.728691:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875523773015296:12345-0@lo:400:kworker.0 Request processed in 41us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639148.728698:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1788639148.728719:0:12414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773015424 00000100:00100000:3.0:1788639148.728722:0:12414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773015424 00000100:00100000:3.0:1788639148.728737:0:12414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788639148.728742:0:12414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773015424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639148.728774:0:12414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773015424:12345-0@lo:400:kworker.0 Request processed in 31us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639148.728780:0:12414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788639148.728805:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773015808 00000100:00100000:3.0:1788639148.728808:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773015808 00000100:00100000:3.0:1788639148.728838:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773015936 00000100:00100000:3.0:1788639148.728841:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773015936 00000100:00100000:3.0:1788639148.728853:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773016320 00000100:00100000:3.0:1788639148.728855:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773016320 00000100:00100000:3.0:1788639148.728869:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788639148.728875:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773015808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639148.728906:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773015808:12345-0@lo:400:kworker.0 Request processed in 31us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639148.728912:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788639148.728923:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788639148.728928:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773015936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639148.728952:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773015936:12345-0@lo:400:kworker.0 Request processed in 24us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639148.728957:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788639148.728967:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788639148.728972:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773016320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639148.728997:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773016320:12345-0@lo:400:kworker.0 Request processed in 25us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639148.729003:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788639148.729032:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242174000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773015424:0@lo:400:kworker.0 00000100:00100000:3.0:1788639148.729040:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:3.0:1788639148.729044:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ae3461b5f80, transno 4294967313 00000100:00100000:3.0:1788639148.729053:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242177b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773015936:0@lo:400:kworker.0 00000100:00080000:3.0:1788639148.729069:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788639148.729078:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788639148.729199:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242175880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875523773015296:0@lo:400:kworker.0 00000100:00100000:3.0:1788639148.729208:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242176d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773015808:0@lo:400:kworker.0 00000100:00100000:3.0:1788639148.729216:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773016320:0@lo:400:kworker.0 00000100:00100000:2.0:1788639148.729414:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+24:3642:x1875523773014912:12345-0@lo:400:kworker.0 Request processed in 2668us (2846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639148.729424:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1788639148.731722:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242176300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773015168:12345-0@lo:400:kworker.0 Request processed in 4758us (5914us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639148.731737:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788639148.731830:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242174380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773015168:0@lo:400:kworker.0 00000100:00100000:3.0:1788639148.732255:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242175c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01f1eef9-e690-4065-bf99-bf821af7b626:3642:1875523773014912:0@lo:400:kworker.0 00000100:00100000:2.0:1788639149.081418:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639149.083273:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754072448 00000100:00100000:3.0:1788639149.083294:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754072448 00000100:00100000:3.0:1788639149.083366:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 153 00000100:00100000:3.0:1788639149.083377:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24339a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+13:12225:x1875523754072448:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:3.0:1788639149.083394:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639149.083413:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262cb75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85684 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.083469:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262cb7c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.083483:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262cb7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.083494:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262cb7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.083507:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8000/0x25c454990262cb83 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.083514:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8000/0x25c454990262cb83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.083521:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8000/0x25c454990262cb83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.083566:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262cb7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.083573:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262cb7c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.083580:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262cb7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.083586:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f9800 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639149.083590:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262cb7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.083597:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262cb7c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.083607:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae362514000) 00010000:00010000:3.0:1788639149.083610:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639149.083644:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262cb7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.083652:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262cb7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.083664:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8000/0x25c454990262cb83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.083670:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8000/0x25c454990262cb83 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.083676:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8000/0x25c454990262cb83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.083687:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f8000 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639149.083690:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8000/0x25c454990262cb83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.083697:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8000/0x25c454990262cb83 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.083706:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ae242374e00) 00010000:00010000:3.0:1788639149.083708:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639149.083711:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8000/0x25c454990262cb83 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.083717:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8000/0x25c454990262cb83 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.083746:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262cb75 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85684 expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.083755:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae362514000) 00010000:00010000:3.0:1788639149.083758:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639149.083762:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262cb75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85684 expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.083770:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f8a00, rc 0) 00000100:00100000:3.0:1788639149.083910:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24339a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+13:12225:x1875523754072448:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 535us (2499us total) trans 0 rc 301/301 00000100:00100000:3.0:1788639149.083918:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 153 00000100:00080000:0.0:1788639149.084019:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788639149.091033:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639149.091103:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754072704 00000100:00100000:1.0:1788639149.091110:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754072704 00000100:00100000:1.0:1788639149.091175:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 154 00000100:00100000:1.0:1788639149.091187:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f815c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+13:12225:x1875523754072704:12345-192.168.206.18@tcp:36:lfs.0 00010000:00010000:1.0:1788639149.091307:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788639149.091334:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262c4c9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854a8 expref: 13 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639149.091351:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae362514000) 00010000:00010000:1.0:1788639149.091356:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788639149.091416:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cb8a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639149.091431:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9400/0x25c454990262cb4b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85676 expref: 5 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639149.091441:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cb8a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639149.091474:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9400/0x25c454990262cb4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85676 expref: 5 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639149.091488:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9400/0x25c454990262cb4b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85676 expref: 5 pid: 11314 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639149.091503:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a00a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1875523773016448:192.168.206.18@tcp:104: 00000100:00100000:1.0:1788639149.091593:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae342c52600 going to sleep for 11 seconds 00000100:00100000:1.0:1788639149.094002:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639149.094110:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a00a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1875523773016448:192.168.206.18@tcp:104: 00010000:00010000:3.0:1788639149.094140:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cb8a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639149.094575:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754072832 00000100:00100000:0.0:1788639149.094583:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754072832 00010000:00010000:0.0:1788639149.094659:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9400/0x25c454990262cb4b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85676 expref: 6 pid: 11314 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788639149.094680:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788639149.094703:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 81 00000100:00100000:0.0:1788639149.094715:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+6:2407:x1875523754072832:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788639149.094741:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788639149.094749:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9400/0x25c454990262cb4b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85676 expref: 6 pid: 11314 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639149.094762:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9400/0x25c454990262cb4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85676 expref: 6 pid: 11314 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639149.094782:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9400/0x25c454990262cb4b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85676 expref: 6 pid: 11314 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639149.094796:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae362514000) 00010000:00010000:0.0:1788639149.094801:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cb8a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639149.094820:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cb8a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639149.094828:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cb8a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639149.094855:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788639149.094875:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cb8a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.094882:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cb8a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.094904:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9a00/0x25c454990262cb91 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639149.094904:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2407:x1875523754072832:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 191us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639149.094912:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 81 00010000:00010000:3.0:1788639149.094914:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9a00/0x25c454990262cb91 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.094921:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9a00/0x25c454990262cb91 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.095543:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262cb98 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.095557:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262cb98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.095565:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262cb98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788639149.095589:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ac8749fd reply state 00000000f0233668 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262cb98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.095599:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262cb98 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.095688:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ae242374600) 00010000:00010000:3.0:1788639149.095691:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788639149.095695:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788639149.095701:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788639149.095710:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cb8a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.095717:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cb8a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.095723:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cb8a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.095728:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fa600 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639149.095733:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cb8a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.095741:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cb8a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.095752:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae362514000) 00010000:00010000:3.0:1788639149.095755:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639149.095758:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cb8a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.095764:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cb8a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788639149.095780:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ac8749fd reply state 00000000f0233668 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9a00/0x25c454990262cb91 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.095808:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9a00/0x25c454990262cb91 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.095814:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ae242374e00) 00010000:00010000:3.0:1788639149.095817:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788639149.095819:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788639149.096404:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f815c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+14:12225:x1875523754072704:12345-192.168.206.18@tcp:36:lfs.0 Request processed in 5217us (5377us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1788639149.096414:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 154 00000100:00100000:1.0:1788639149.181845:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639149.185277:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754072960 00000100:00100000:3.0:1788639149.185303:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754072960 00000100:00100000:2.0:1788639149.185453:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 155 00000100:00100000:2.0:1788639149.185464:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+14:12233:x1875523754072960:12345-192.168.206.18@tcp:101:lctl.0 00010000:00010000:2.0:1788639149.185486:0:11314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639149.185510:0:11314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ae00/0x25c454990262cb9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e8568b expref: -99 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.185574:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a400/0x25c454990262cba6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.185588:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a400/0x25c454990262cba6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.185599:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a400/0x25c454990262cba6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788639149.185667:0:11314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788639149.185672:0:11314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788639149.185696:0:11314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a400/0x25c454990262cba6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.185721:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ae00/0x25c454990262cb9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8568b expref: 16 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.185745:0:11314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a400/0x25c454990262cba6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8568b expref: 15 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.185774:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae242358200) 00010000:00010000:2.0:1788639149.185777:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788639149.185780:0:11314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78a400, rc 0) 00000100:00100000:2.0:1788639149.185846:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+15:12233:x1875523754072960:12345-192.168.206.18@tcp:101:lctl.0 Request processed in 384us (4010us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639149.185853:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 155 00000100:00100000:0.0:1788639149.236868:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773016576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788639149.236936:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639149.237151:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773016576 00000100:00100000:1.0:1788639149.237159:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773016576 00000100:00100000:3.0:1788639149.237320:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788639149.237322:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788639149.237330:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3461b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773016704:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788639149.237333:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f816300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773016576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788639149.237353:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788639149.237359:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639149.237392:0:12414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773016704 00000100:00100000:3.0:1788639149.237395:0:12414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773016704 00000100:00100000:1.0:1788639149.237395:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f816300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773016576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639149.237401:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788639149.237956:0:12414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788639149.237966:0:12414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f78d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773016704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788639149.237994:0:12414:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788639149.238100:0:12414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f78d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773016704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 136us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639149.238107:0:12414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788639149.238170:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773016576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788639149.238323:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3461b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773016704:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788639149.248089:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639149.249528:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754073088 00000100:00100000:3.0:1788639149.249542:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754073088 00000100:00100000:3.0:1788639149.249646:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 156 00000100:00100000:3.0:1788639149.249656:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+15:12239:x1875523754073088:12345-192.168.206.18@tcp:101:bash.0 00010000:00010000:3.0:1788639149.249690:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639149.249710:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8000/0x25c454990262cbad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85692 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.249778:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262cbb4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.249793:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262cbb4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.249806:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262cbb4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.249818:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262cbbb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.249826:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262cbbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.249833:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262cbbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.250054:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9000/0x25c454990262cbc2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.250064:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9000/0x25c454990262cbc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.250072:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9000/0x25c454990262cbc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788639149.250102:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788639149.250111:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788639149.250130:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9000/0x25c454990262cbc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.250142:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262cbb4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.250148:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262cbb4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.250155:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262cbb4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.250160:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f9800 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639149.250164:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262cbb4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.250172:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262cbb4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.250183:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae242358200) 00010000:00010000:3.0:1788639149.250185:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639149.250190:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262cbb4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.250196:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262cbb4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.250209:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262cbbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.250215:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262cbbb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.250230:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262cbbb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.250235:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f9600 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639149.250238:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262cbbb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.250244:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262cbbb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.250252:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ae242374e00) 00010000:00010000:3.0:1788639149.250254:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639149.250257:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262cbbb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.250262:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262cbbb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.250300:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8000/0x25c454990262cbad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85692 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.250315:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9000/0x25c454990262cbc2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85692 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.250322:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ae242374600) 00010000:00010000:3.0:1788639149.250324:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788639149.250327:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f9000, rc 0) 00000100:00100000:3.0:1788639149.250391:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+16:12239:x1875523754073088:12345-192.168.206.18@tcp:101:bash.0 Request processed in 736us (2309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639149.250406:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 156 00000100:00100000:0.0:1788639149.253541:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639149.253671:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754073344 00000100:00100000:3.0:1788639149.253680:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754073344 00000100:00100000:3.0:1788639149.253737:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 157 00000100:00100000:3.0:1788639149.253746:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+16:12239:x1875523754073344:12345-192.168.206.18@tcp:101:bash.0 00010000:00010000:3.0:1788639149.253763:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639149.253781:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9e00/0x25c454990262cbc9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85699 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.254039:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262cbd0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.254054:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262cbd0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.254065:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262cbd0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.254173:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8e00/0x25c454990262cbd7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.254182:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8e00/0x25c454990262cbd7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.254189:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8e00/0x25c454990262cbd7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788639149.254546:0:6516:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:3.0:1788639149.255242:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262cbde lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.255268:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262cbde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.255276:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262cbde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.255324:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262cbd0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.255331:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262cbd0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.255338:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262cbd0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.255345:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f8400 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639149.255349:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262cbd0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.255356:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262cbd0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.255368:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ae242374600) 00010000:00010000:3.0:1788639149.255371:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639149.255375:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262cbd0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.255381:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262cbd0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788639149.255394:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007bb6c7d1 reply state 000000001acd002d transno 4294967420 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8e00/0x25c454990262cbd7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.255410:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8e00/0x25c454990262cbd7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.255416:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ae242374100) 00010000:00010000:3.0:1788639149.255418:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788639149.255421:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788639149.255455:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9e00/0x25c454990262cbc9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85699 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.255471:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262cbde lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85699 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.255478:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242374200) 00010000:00010000:3.0:1788639149.255480:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788639149.255482:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f9c00, rc 0) 00000100:00100000:3.0:1788639149.255799:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+19:12239:x1875523754073344:12345-192.168.206.18@tcp:101:bash.0 Request processed in 2052us (2265us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1788639149.255808:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 157 00000100:00100000:1.0:1788639149.261658:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639149.261755:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754073472 00000100:00100000:3.0:1788639149.261765:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754073472 00000100:00100000:3.0:1788639149.261904:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 55 00000100:00100000:3.0:1788639149.261916:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2407:x1875523754073472:12345-192.168.206.18@tcp:101:bash.0 00010000:00010000:3.0:1788639149.261934:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639149.261954:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020dc9e51/0x25c454990262cbec lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e856a0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788639149.261977:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788639149.262011:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=408s v=(0 0) 00010000:00010000:3.0:1788639149.262016:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639149.262026:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020dc9e51/0x25c454990262cbec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856a0 expref: 6 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.262044:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000020dc9e51/0x25c454990262cbec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856a0 expref: 6 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.262057:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f8000, rc 0) 00000100:00100000:3.0:1788639149.262119:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2407:x1875523754073472:12345-192.168.206.18@tcp:101:bash.0 Request processed in 206us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639149.262125:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 55 00000100:00080000:0.0:1788639149.262183:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788639149.270790:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639149.270953:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754073600 00000100:00100000:2.0:1788639149.270964:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754073600 00000100:00100000:2.0:1788639149.271029:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 56 00000100:00100000:2.0:1788639149.271039:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+6:12239:x1875523754073600:12345-192.168.206.18@tcp:101:bash.0 00010000:00010000:2.0:1788639149.271057:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639149.271073:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c41d79f5/0x25c454990262cbf3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e856a7 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.271102:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000020dc9e51/0x25c454990262cbec lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856a0 expref: 7 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.271111:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788639149.271115:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788639149.271119:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c41d79f5/0x25c454990262cbf3 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856a7 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.271151:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000020dc9e51/0x25c454990262cbec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856a0 expref: 7 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.271184:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000020dc9e51/0x25c454990262cbec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856a0 expref: 7 pid: 8431 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639149.272117:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243399c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8432:1875523773016832:192.168.206.18@tcp:104: 00000100:00100000:2.0:1788639149.272916:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2431a4300 going to sleep for 11 seconds 00000100:00100000:1.0:1788639149.278752:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639149.278970:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754073728 00000100:00100000:3.0:1788639149.278979:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754073728 00010000:00010000:3.0:1788639149.279018:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000020dc9e51/0x25c454990262cbec lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856a0 expref: 8 pid: 8431 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639149.279053:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 82 00000100:00100000:3.0:1788639149.279062:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+8:2407:x1875523754073728:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788639149.279077:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639149.279098:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000020dc9e51/0x25c454990262cbec lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856a0 expref: 8 pid: 8431 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.279111:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000020dc9e51/0x25c454990262cbec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856a0 expref: 8 pid: 8431 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.279167:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639149.279172:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639149.279180:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c41d79f5/0x25c454990262cbf3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856a7 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.279191:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c41d79f5/0x25c454990262cbf3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856a7 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.279227:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c41d79f5/0x25c454990262cbf3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856a7 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639149.279240:0:6502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6502:1875523773016960:192.168.206.18@tcp:105: 00000100:00100000:3.0:1788639149.279327:0:6502:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235a300 going to sleep for 11 seconds 00010000:00010000:2.0:1788639149.280599:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020dc9e51/0x25c454990262cbec lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856a0 expref: 8 pid: 8431 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639149.280641:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243399c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8432:1875523773016832:192.168.206.18@tcp:104: 00010000:00010000:2.0:1788639149.280666:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c41d79f5/0x25c454990262cbf3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856a7 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.280679:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78ae00, rc 0) 00000100:00100000:2.0:1788639149.280733:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+7:12239:x1875523754073600:12345-192.168.206.18@tcp:101:bash.0 Request processed in 9696us (10120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639149.280742:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 56 00000100:00100000:3.0:1788639149.285439:0:6502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6502:1875523773016960:192.168.206.18@tcp:105: 00010000:00010000:3.0:1788639149.285471:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639149.285529:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2407:x1875523754073728:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 6467us (6786us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639149.285541:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 82 00000100:00100000:1.0:1788639149.291715:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639149.291902:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754073984 00000100:00100000:2.0:1788639149.291912:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754073984 00000100:00100000:2.0:1788639149.291972:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 36 00000100:00100000:2.0:1788639149.291983:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+19:12239:x1875523754073984:12345-192.168.206.18@tcp:35:bash.0 00000100:00100000:2.0:1788639149.292263:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+20:12239:x1875523754073984:12345-192.168.206.18@tcp:35:bash.0 Request processed in 280us (555us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1788639149.292271:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 36 00000100:00100000:1.0:1788639149.383556:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639149.383881:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754074240 00000100:00100000:2.0:1788639149.383891:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754074240 00000100:00100000:2.0:1788639149.383990:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 158 00000100:00100000:2.0:1788639149.384318:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+20:12249:x1875523754074240:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:2.0:1788639149.384346:0:11314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639149.384367:0:11314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262cbfa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e856ae expref: -99 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788639149.384471:0:11314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788639149.384570:0:11314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262cbfa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856ae expref: 22 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.384584:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae242358200) 00010000:00010000:2.0:1788639149.384587:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788639149.384593:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262cbfa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856ae expref: 22 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.384661:0:11314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78b200, rc 0) 00000100:00100000:2.0:1788639149.384773:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+21:12249:x1875523754074240:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 774us (1224us total) trans 4294967422 rc 301/301 00000100:00100000:2.0:1788639149.384781:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 158 00000100:00100000:1.0:1788639149.388359:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639149.391142:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754074496 00000100:00100000:2.0:1788639149.391158:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754074496 00000100:00100000:2.0:1788639149.391242:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 37 00000100:00100000:2.0:1788639149.391253:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+21:12249:x1875523754074496:12345-192.168.206.18@tcp:35:lfs.0 00000100:00100000:2.0:1788639149.391516:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+22:12249:x1875523754074496:12345-192.168.206.18@tcp:35:lfs.0 Request processed in 263us (3165us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1788639149.391534:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 37 00010000:00010000:1.0:1788639149.493019:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639149.501118:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639149.501222:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754074624 00000100:00100000:3.0:1788639149.501250:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754074624 00000100:00100000:3.0:1788639149.501355:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 159 00000100:00100000:3.0:1788639149.501367:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+22:12255:x1875523754074624:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:3.0:1788639149.501390:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639149.501409:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9e00/0x25c454990262cc08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e856b5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.501491:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262cc0f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.501505:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262cc0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.501516:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262cc0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788639149.501559:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788639149.501563:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788639149.501581:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262cc0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.501665:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9e00/0x25c454990262cc08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856b5 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.501686:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262cc0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856b5 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.501695:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ae242374600) 00010000:00010000:3.0:1788639149.501698:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788639149.501702:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f8400, rc 0) 00000100:00100000:3.0:1788639149.501755:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+23:12255:x1875523754074624:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 391us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639149.501762:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 159 00000100:00100000:1.0:1788639149.510070:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639149.510326:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754074880 00000100:00100000:3.0:1788639149.510336:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754074880 00000100:00100000:3.0:1788639149.510409:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 160 00000100:00100000:3.0:1788639149.510418:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+23:12255:x1875523754074880:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:3.0:1788639149.510438:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639149.510458:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9e00/0x25c454990262cc16 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e856bc expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.510560:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262cc1d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.510574:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262cc1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.510585:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262cc1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788639149.510595:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788639149.511457:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9e00/0x25c454990262cc16 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856bc expref: 26 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.511480:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262cc1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856bc expref: 25 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.511489:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242374200) 00010000:00010000:3.0:1788639149.511493:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788639149.511496:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f9600, rc 0) 00000100:00100000:3.0:1788639149.511653:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+25:12255:x1875523754074880:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 1196us (1562us total) trans 4294967424 rc 0/0 00000100:00100000:3.0:1788639149.511662:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 160 00000100:00100000:0.0:1788639149.517373:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639149.517417:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639149.517499:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754075136 00000100:00100000:2.0:1788639149.517508:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754075136 00000100:00100000:2.0:1788639149.517569:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 161 00000100:00100000:2.0:1788639149.517579:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f785500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+25:12255:x1875523754075136:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:2.0:1788639149.517603:0:11314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639149.517658:0:11314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262cc2b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e856c3 expref: -99 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.517770:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262cc32 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.517795:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262cc32 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.517807:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262cc32 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788639149.517820:0:11314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00000100:00100000:1.0:1788639149.517903:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754075264 00000100:00100000:1.0:1788639149.517908:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754075264 00000100:00100000:1.0:1788639149.517941:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 11 00000100:00100000:1.0:1788639149.517949:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2433a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+27:2405:x1875523754075264:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788639149.517958:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788639149.517974:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262cc1d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856bc expref: 27 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639149.517990:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242374200) 00010000:00010000:1.0:1788639149.518010:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788639149.518063:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2433a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+27:2405:x1875523754075264:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 113us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639149.518071:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 11 00010000:00010000:2.0:1788639149.518096:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262cc2b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856c3 expref: 27 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.518118:0:11314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262cc32 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856c3 expref: 26 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.518198:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242374200) 00010000:00010000:2.0:1788639149.518201:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788639149.518204:0:11314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78a600, rc 0) 00000100:00100000:2.0:1788639149.518235:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f785500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+26:12255:x1875523754075136:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 658us (870us total) trans 4294967425 rc 0/0 00000100:00100000:2.0:1788639149.518242:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 161 00000100:00100000:2.0:1788639149.525079:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639149.525532:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754075392 00000100:00100000:3.0:1788639149.525559:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754075392 00000100:00100000:3.0:1788639149.525704:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 57 00000100:00100000:3.0:1788639149.525717:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243399c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2407:x1875523754075392:12345-192.168.206.18@tcp:1:lfs.0 00010000:00010000:3.0:1788639149.525759:0:8829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bcbc5836/0x25c454990262cc40 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.525780:0:8829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c41d79f5/0x25c454990262cbf3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856a7 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.525788:0:8829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639149.525792:0:8829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788639149.525797:0:8829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bcbc5836/0x25c454990262cc40 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.525829:0:8829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c41d79f5/0x25c454990262cbf3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856a7 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.525921:0:8829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c41d79f5/0x25c454990262cbf3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856a7 expref: 6 pid: 8432 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639149.525938:0:8829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8829:1875523773017088:192.168.206.18@tcp:104: 00000100:00100000:3.0:1788639149.526027:0:8829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235a900 going to sleep for 11 seconds 00000100:00100000:3.0:1788639149.530010:0:8829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8829:1875523773017088:192.168.206.18@tcp:104: 00010000:00010000:3.0:1788639149.530050:0:8829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bcbc5836/0x25c454990262cc40 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639149.532369:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639149.533096:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754075520 00000100:00100000:0.0:1788639149.533107:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754075520 00002000:00100000:0.0:1788639149.533468:0:8436:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9ae24339b480 x1875523754075520/t0(0) o4->5deb128c-4fe3-4f51-b21e-f30846e08445@192.168.206.18@tcp:370/0 lens 504/0 e 0 to 0 dl 1788639160 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788639149.533480:0:8436:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae24339b480 with x1875523754075520 ext(0->12) 00010000:00010000:0.0:1788639149.533490:0:8436:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c41d79f5/0x25c454990262cbf3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856a7 expref: 7 pid: 8432 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639149.533506:0:8436:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c41d79f5/0x25c454990262cbf3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856a7 expref: 7 pid: 8432 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788639149.533515:0:8436:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ae24339b480 00000100:00100000:0.0:1788639149.533929:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 2 00000100:00100000:0.0:1788639149.533943:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24339b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+7:2406:x1875523754075520:12345-192.168.206.18@tcp:4:lfs.0 00000100:00100000:0.0:1788639149.535561:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24339b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+9:2406:x1875523754075520:12345-192.168.206.18@tcp:4:lfs.0 Request processed in 1615us (3194us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788639149.535572:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 2 00002000:00100000:0.0:1788639149.535582:0:8436:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9ae24339b480 x1875523754075520/t4294967306(0) o4->5deb128c-4fe3-4f51-b21e-f30846e08445@192.168.206.18@tcp:370/0 lens 504/448 e 0 to 0 dl 1788639160 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788639149.535591:0:8436:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae24339b480 with x1875523754075520 ext(0->12) 00010000:00010000:0.0:1788639149.535600:0:8436:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c41d79f5/0x25c454990262cbf3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856a7 expref: 9 pid: 8432 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639149.535750:0:8436:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c41d79f5/0x25c454990262cbf3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856a7 expref: 9 pid: 8432 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788639149.535758:0:8436:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ae24339b480 00000100:00100000:2.0:1788639149.538338:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639149.538451:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754075648 00000100:00100000:3.0:1788639149.538461:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754075648 00010000:00010000:3.0:1788639149.538501:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c41d79f5/0x25c454990262cbf3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856a7 expref: 9 pid: 8432 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639149.538589:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 83 00000100:00100000:3.0:1788639149.538600:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243398380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+9:2408:x1875523754075648:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788639149.538656:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788639149.538672:0:6502:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788639149.538675:0:6502:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788639150 00002000:00010000:3.0:1788639149.538678:0:6502:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788639150 00002000:00010000:3.0:1788639149.538681:0:6502:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788639150 00002000:00010000:3.0:1788639149.538683:0:6502:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788639149.538690:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c41d79f5/0x25c454990262cbf3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856a7 expref: 9 pid: 8432 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.538704:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c41d79f5/0x25c454990262cbf3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856a7 expref: 9 pid: 8432 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.538726:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c41d79f5/0x25c454990262cbf3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856a7 expref: 9 pid: 8432 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.538760:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788639149.538764:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788639149.538770:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bcbc5836/0x25c454990262cc40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.538796:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bcbc5836/0x25c454990262cc40 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.538830:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639149.538888:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243398380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+8:2408:x1875523754075648:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 290us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639149.538896:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 83 00010000:00010000:2.0:1788639149.539147:0:8829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bcbc5836/0x25c454990262cc40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.539157:0:8829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bcbc5836/0x25c454990262cc40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.539177:0:8829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bcbc5836/0x25c454990262cc40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.539185:0:8829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bcbc5836/0x25c454990262cc40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.539192:0:8829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bcbc5836/0x25c454990262cc40 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.539198:0:8829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f9e00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:2.0:1788639149.539203:0:8829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bcbc5836/0x25c454990262cc40 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.539212:0:8829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bcbc5836/0x25c454990262cc40 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.539236:0:8829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bcbc5836/0x25c454990262cc40 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.539245:0:8829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bcbc5836/0x25c454990262cc40 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639149.539314:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243399c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+7:2407:x1875523754075392:12345-192.168.206.18@tcp:1:lfs.0 Request processed in 13601us (14253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639149.539322:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 57 00000100:00100000:2.0:1788639149.544522:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639149.544666:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754075904 00000100:00100000:0.0:1788639149.544676:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754075904 00000100:00100000:0.0:1788639149.544845:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 38 00000100:00100000:0.0:1788639149.544868:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ef2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+26:12255:x1875523754075904:12345-192.168.206.18@tcp:35:lfs.0 00000004:00010000:0.0:1788639149.544934:0:6519:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262cc32 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856c3 expref: 26 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788639149.545135:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1788639149.545174:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:0.0:1788639149.545483:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00010000:00010000:0.0:1788639149.545518:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5800/0x25c454990262cc47 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639149.545533:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262cbde lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85699 expref: 30 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639149.545542:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5800/0x25c454990262cc47 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639149.545575:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262cbde lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85699 expref: 30 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639149.545590:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262cbde lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85699 expref: 30 pid: 6516 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639149.545644:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2433a6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6519:1875523773017216:192.168.206.18@tcp:104: 00000100:00100000:0.0:1788639149.545736:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae360f4fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788639149.551106:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639149.551296:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754076032 00000100:00100000:2.0:1788639149.551307:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754076032 00010000:00010000:2.0:1788639149.551348:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262cbde lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85699 expref: 31 pid: 6516 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639149.551396:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 84 00000100:00100000:2.0:1788639149.551407:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243958380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+31:2408:x1875523754076032:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788639149.551421:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788639149.551429:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262cbde lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85699 expref: 31 pid: 6516 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.551446:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262cbde lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85699 expref: 31 pid: 6516 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639149.551464:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2433a6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6519:1875523773017216:192.168.206.18@tcp:104: 00010000:00010000:2.0:1788639149.551466:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262cbde lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85699 expref: 31 pid: 6516 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639149.551487:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5800/0x25c454990262cc47 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.551494:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242374200) 00010000:00010000:2.0:1788639149.551499:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5800/0x25c454990262cc47 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.553132:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5800/0x25c454990262cc47 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.553141:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5800/0x25c454990262cc47 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.553652:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788639149.553899:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5800/0x25c454990262cc47 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639149.553909:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5800/0x25c454990262cc47 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788639149.554030:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:2.0:1788639149.554307:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243958380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+31:2408:x1875523754076032:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 2825us (3133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639149.554318:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 84 00000001:00080000:1.0:1788639149.554408:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:1.0:1788639149.554498:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a01c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6519:1875523773017344:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788639149.554551:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639149.554593:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae342c52000 going to sleep for 11 seconds 00000100:00100000:0.0:1788639149.554843:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773017344 00000100:00100000:0.0:1788639149.554852:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773017344 00000100:00100000:0.0:1788639149.554902:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788639149.554910:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6519:x1875523773017344:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788639149.554994:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6519:x1875523773017344:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 85us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639149.555002:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788639149.555103:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a01c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6519:1875523773017344:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788639149.555217:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00000100:00100000:1.0:1788639149.555934:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a01c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6519:1875523773017472:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788639149.555977:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639149.555998:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36e182c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788639149.556048:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773017472 00000100:00100000:0.0:1788639149.556054:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773017472 00000100:00100000:0.0:1788639149.556092:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788639149.556101:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6519:x1875523773017472:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788639149.556253:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6519:x1875523773017472:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 152us (275us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788639149.556260:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788639149.556378:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a01c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6519:1875523773017472:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788639149.556419:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:1.0:1788639149.556450:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5800/0x25c454990262cc47 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639149.556474:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5800/0x25c454990262cc47 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639149.556482:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5800/0x25c454990262cc47 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639149.556488:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef5800 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639149.556492:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5800/0x25c454990262cc47 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639149.556499:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5800/0x25c454990262cc47 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639149.556514:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242374200) 00010000:00010000:1.0:1788639149.556517:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788639149.556522:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5800/0x25c454990262cc47 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639149.556528:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5800/0x25c454990262cc47 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788639149.556842:0:6519:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788639149.556905:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:1.0:1788639149.556918:0:6519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 408351301313ns, next at 409351298315ns, rc = 0 00000001:00080000:1.0:1788639149.556925:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967433 00010000:00010000:1.0:1788639149.556950:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242374200) 00010000:00010000:1.0:1788639149.556953:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788639149.556961:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262cc32 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856c3 expref: 34 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639149.557113:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ef2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+33:12255:x1875523754075904:12345-192.168.206.18@tcp:35:lfs.0 Request processed in 12248us (12603us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1788639149.557122:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 38 00000020:00080000:1.0:1788639149.557126:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788639149.563648:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639149.563727:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754076160 00000100:00100000:3.0:1788639149.563737:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754076160 00000100:00100000:3.0:1788639149.563959:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 162 00000100:00100000:3.0:1788639149.563970:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24395ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+33:12255:x1875523754076160:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:3.0:1788639149.563994:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639149.564014:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262cc4e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e856ca expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.564074:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262cc4e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856ca expref: 34 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.564089:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262cc4e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856ca expref: 34 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.564108:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242374b00) 00010000:00010000:3.0:1788639149.564112:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788639149.564116:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f9800, rc 0) 00000100:00100000:3.0:1788639149.564186:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24395ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+34:12255:x1875523754076160:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 217us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639149.564212:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 162 00000100:00100000:0.0:1788639149.573937:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639149.574213:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754076416 00000100:00100000:2.0:1788639149.574224:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754076416 00000100:00100000:2.0:1788639149.574360:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 39 00000100:00100000:2.0:1788639149.574371:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24395aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+34:12255:x1875523754076416:12345-192.168.206.18@tcp:35:lfs.0 00000100:00100000:2.0:1788639149.574605:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24395aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+35:12255:x1875523754076416:12345-192.168.206.18@tcp:35:lfs.0 Request processed in 235us (677us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1788639149.574613:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 39 00000100:00100000:2.0:1788639149.715418:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639149.717041:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754076672 00000100:00100000:3.0:1788639149.717066:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754076672 00000100:00100000:3.0:1788639149.717148:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 163 00000100:00100000:3.0:1788639149.717160:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243399880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+35:12265:x1875523754076672:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:3.0:1788639149.717184:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639149.717205:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8c00/0x25c454990262cc55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e856d1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788639149.717310:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788639149.717408:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8c00/0x25c454990262cc55 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856d1 expref: 37 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.717423:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae242358200) 00010000:00010000:3.0:1788639149.717426:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788639149.717431:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8c00/0x25c454990262cc55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856d1 expref: 37 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.717445:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f8c00, rc 0) 00000100:00100000:3.0:1788639149.717510:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243399880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+36:12265:x1875523754076672:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 353us (2102us total) trans 4294967436 rc 301/301 00000100:00100000:3.0:1788639149.717517:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 163 00000100:00100000:1.0:1788639149.728907:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639149.729033:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754076800 00000100:00100000:2.0:1788639149.729044:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754076800 00000100:00100000:2.0:1788639149.730007:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 164 00000100:00100000:2.0:1788639149.730022:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+36:12265:x1875523754076800:12345-192.168.206.18@tcp:34:lfs.0 00010000:00010000:2.0:1788639149.730134:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ac00/0x25c454990262cc63 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.730152:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ac00/0x25c454990262cc63 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.730164:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ac00/0x25c454990262cc63 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.730175:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262cc6a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.730182:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262cc6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.730189:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262cc6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.730266:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262cc71 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.730275:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262cc71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.730293:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262cc71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788639149.730340:0:10169:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262cc71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.730353:0:10169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ac00/0x25c454990262cc63 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.730600:0:10169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ac00/0x25c454990262cc63 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.730607:0:10169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ac00/0x25c454990262cc63 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.730613:0:10169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78ac00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639149.730637:0:10169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ac00/0x25c454990262cc63 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.730646:0:10169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ac00/0x25c454990262cc63 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.730657:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ae242374600) 00010000:00010000:2.0:1788639149.730660:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639149.730664:0:10169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ac00/0x25c454990262cc63 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.730671:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ac00/0x25c454990262cc63 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.730700:0:10169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262cc6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.730707:0:10169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262cc6a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.730712:0:10169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262cc6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.730717:0:10169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78a200 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639149.730727:0:10169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262cc6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.730733:0:10169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262cc6a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.730741:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ae242374100) 00010000:00010000:2.0:1788639149.730744:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639149.730747:0:10169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262cc6a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.730753:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262cc6a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.730765:0:10169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262cc71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.730771:0:10169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262cc71 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.730777:0:10169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262cc71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.730977:0:10169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78a800 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639149.730980:0:10169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262cc71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.730987:0:10169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262cc71 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.730996:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242374b00) 00010000:00010000:2.0:1788639149.730999:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639149.731009:0:10169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262cc71 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.731015:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262cc71 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639149.731174:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+36:12265:x1875523754076800:12345-192.168.206.18@tcp:34:lfs.0 Request processed in 1153us (2273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639149.731183:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 164 00000100:00100000:0.0:1788639149.738381:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639149.738718:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754077056 00000100:00100000:1.0:1788639149.738728:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754077056 00000100:00100000:1.0:1788639149.738791:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 40 00000100:00100000:1.0:1788639149.738803:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243959f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+36:12265:x1875523754077056:12345-192.168.206.18@tcp:35:lfs.0 00000100:00100000:1.0:1788639149.739037:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243959f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+37:12265:x1875523754077056:12345-192.168.206.18@tcp:35:lfs.0 Request processed in 236us (685us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1788639149.739046:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 40 00000100:00100000:0.0:1788639149.748971:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788639149.748994:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24339a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773017600:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788639149.749066:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639149.749397:0:12414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773017600 00000100:00100000:2.0:1788639149.749406:0:12414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773017600 00000100:00100000:2.0:1788639149.749462:0:12414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788639149.749472:0:12414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243959180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523773017600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788639149.749507:0:12414:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788639149.749963:0:12414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243959180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523773017600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 491us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639149.749972:0:12414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788639149.763579:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24339a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773017600:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788639149.824209:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639149.824310:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754077312 00000100:00100000:3.0:1788639149.824320:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754077312 00000100:00100000:3.0:1788639149.824437:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 165 00000100:00100000:3.0:1788639149.824464:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243958a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+37:12268:x1875523754077312:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:3.0:1788639149.824486:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639149.824505:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9200/0x25c454990262cc78 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e856d8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.824583:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8c00/0x25c454990262cc7f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.824598:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8c00/0x25c454990262cc7f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.824610:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8c00/0x25c454990262cc7f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.824666:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262cc86 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.824673:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262cc86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.824680:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262cc86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.824814:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262cc8d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.824823:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262cc8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.824830:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262cc8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788639149.824851:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788639149.824929:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8c00/0x25c454990262cc7f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.824937:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8c00/0x25c454990262cc7f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.824944:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8c00/0x25c454990262cc7f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.824950:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f8c00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639149.824954:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8c00/0x25c454990262cc7f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.824962:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8c00/0x25c454990262cc7f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.824973:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ae242374600) 00010000:00010000:3.0:1788639149.824976:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639149.824980:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8c00/0x25c454990262cc7f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.824986:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8c00/0x25c454990262cc7f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.824999:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262cc86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.825004:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262cc86 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.825019:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262cc86 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.825024:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f8800 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639149.825027:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262cc86 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.825033:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262cc86 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.825042:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ae242374100) 00010000:00010000:3.0:1788639149.825044:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639149.825047:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262cc86 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.825053:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262cc86 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.825089:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9200/0x25c454990262cc78 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856d8 expref: 40 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.825102:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262cc8d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856d8 expref: 39 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639149.825110:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242374b00) 00010000:00010000:3.0:1788639149.825112:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788639149.825115:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f8200, rc 0) 00000100:00100000:3.0:1788639149.825164:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243958a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+39:12268:x1875523754077312:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 703us (964us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1788639149.825179:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 165 00000100:00100000:3.0:1788639149.831901:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639149.832346:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754077440 00000100:00100000:2.0:1788639149.832366:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754077440 00000100:00100000:2.0:1788639149.832435:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 166 00000100:00100000:2.0:1788639149.832445:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+39:12268:x1875523754077440:12345-192.168.206.18@tcp:54:lfs.0 00010000:00010000:2.0:1788639149.832514:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262cc9b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.832531:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262cc9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.832543:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262cc9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.832597:0:11314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262cc9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.832604:0:11314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262cc9b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.832611:0:11314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262cc9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.832644:0:11314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78a800 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639149.832649:0:11314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262cc9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.832656:0:11314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262cc9b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.832667:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242374b00) 00010000:00010000:2.0:1788639149.832671:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788639149.832675:0:11314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262cc9b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639149.832681:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262cc9b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639149.832952:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+39:12268:x1875523754077440:12345-192.168.206.18@tcp:54:lfs.0 Request processed in 507us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639149.832960:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 166 00000100:00100000:0.0:1788639149.836722:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639149.836824:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754077696 00000100:00100000:1.0:1788639149.836833:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754077696 00000100:00100000:1.0:1788639149.836887:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 41 00000100:00100000:1.0:1788639149.836896:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243958000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+39:12268:x1875523754077696:12345-192.168.206.18@tcp:35:lfs.0 00000100:00100000:1.0:1788639149.837148:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243958000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+40:12268:x1875523754077696:12345-192.168.206.18@tcp:35:lfs.0 Request processed in 253us (433us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1788639149.837156:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 41 00000100:00100000:0.0:1788639150.051134:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639150.051174:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639150.051210:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639150.051258:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639150.051299:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639150.051422:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754078336 00000100:00100000:3.0:1788639150.051431:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754078336 00000100:00100000:3.0:1788639150.051496:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754077952 00000100:00100000:3.0:1788639150.051500:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754077952 00000100:00100000:3.0:1788639150.051519:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754078208 00000100:00100000:3.0:1788639150.051522:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754078208 00000100:00100000:3.0:1788639150.051538:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 300 00000100:00100000:3.0:1788639150.051547:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243959880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2408:x1875523754078336:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639150.051663:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243959880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2408:x1875523754078336:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 67us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639150.051672:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 300 00000100:00100000:3.0:1788639150.051690:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 301 00000100:00100000:3.0:1788639150.051697:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2408:x1875523754077952:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639150.051723:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2408:x1875523754077952:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 27us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639150.051729:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 301 00000100:00100000:3.0:1788639150.051740:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 302 00000100:00100000:3.0:1788639150.051746:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2408:x1875523754078208:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639150.051770:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2408:x1875523754078208:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 24us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639150.051776:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 302 00000100:00100000:2.0:1788639150.051933:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754077824 00000100:00100000:2.0:1788639150.051938:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754077824 00000100:00100000:2.0:1788639150.051974:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 384 00000100:00100000:2.0:1788639150.051989:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae369901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+13:2408:x1875523754077824:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639150.052016:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae369901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+13:2408:x1875523754077824:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 28us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639150.052023:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 384 00000100:00100000:1.0:1788639150.052156:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754078080 00000100:00100000:1.0:1788639150.052160:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754078080 00000100:00100000:1.0:1788639150.052201:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 129 00000100:00100000:1.0:1788639150.052208:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243959500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2408:x1875523754078080:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:1.0:1788639150.052238:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243959500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2408:x1875523754078080:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 30us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639150.052251:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 129 00000100:00080000:0.0:1788639150.052409:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788639150.052413:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788639150.087490:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639150.087589:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754078592 00000100:00100000:3.0:1788639150.087599:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754078592 00000100:00100000:3.0:1788639150.087745:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 167 00000100:00100000:3.0:1788639150.087763:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24339a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+40:12299:x1875523754078592:12345-192.168.206.18@tcp:101:cat.0 00010000:00010000:3.0:1788639150.087785:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639150.087804:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9200/0x25c454990262cca2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e856df expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.087914:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262cca9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.087930:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262cca9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.087942:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262cca9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788639150.087953:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788639150.088060:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9200/0x25c454990262cca2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856df expref: 43 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.088078:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262cca9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856df expref: 42 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.088087:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242374b00) 00010000:00010000:3.0:1788639150.088090:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788639150.088094:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f8800, rc 0) 00000100:00100000:3.0:1788639150.088162:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24339a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+42:12299:x1875523754078592:12345-192.168.206.18@tcp:101:cat.0 Request processed in 408us (681us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1788639150.088169:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 167 00000100:00100000:0.0:1788639150.091673:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639150.091840:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639150.092071:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754078976 00000100:00100000:1.0:1788639150.092082:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754078976 00000100:00100000:1.0:1788639150.092147:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 42 00000100:00100000:1.0:1788639150.092158:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243314700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+42:12299:x1875523754078976:12345-192.168.206.18@tcp:35:cat.0 00000100:00100000:1.0:1788639150.092401:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243314700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+43:12299:x1875523754078976:12345-192.168.206.18@tcp:35:cat.0 Request processed in 244us (560us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1788639150.092408:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 42 00000100:00100000:3.0:1788639150.096457:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754078720 00000100:00100000:3.0:1788639150.096487:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754078720 00000100:00100000:3.0:1788639150.096568:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 12 00000100:00100000:3.0:1788639150.096579:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b60e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+43:2407:x1875523754078720:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788639150.096596:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639150.096638:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262cca9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856df expref: 43 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.096657:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242374b00) 00010000:00010000:3.0:1788639150.096662:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639150.096725:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b60e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+42:2407:x1875523754078720:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 148us (5061us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639150.096733:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 12 00000100:00100000:0.0:1788639150.140542:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639150.141033:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754079232 00000100:00100000:3.0:1788639150.141044:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754079232 00000100:00100000:3.0:1788639150.141111:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 168 00000100:00100000:3.0:1788639150.141122:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243314a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+42:12305:x1875523754079232:12345-192.168.206.18@tcp:101:dd.0 00010000:00010000:3.0:1788639150.141145:0:10169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639150.141148:0:10169:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788639150.141173:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262cc0f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856b5 expref: 42 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.141193:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ae242374600) 00010000:00010000:3.0:1788639150.141198:0:10169:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788639150.141211:0:10169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262ccb7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e856e6 expref: -99 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.141498:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9200/0x25c454990262ccbe lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.141518:0:10169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262cc8d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856d8 expref: 42 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.141526:0:10169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9200/0x25c454990262ccbe lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.141557:0:10169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262cc8d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856d8 expref: 42 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.141571:0:10169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262cc8d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856d8 expref: 42 pid: 6518 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639150.141585:0:10169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10169:1875523773017728:192.168.206.18@tcp:104: 00000100:00100000:3.0:1788639150.141898:0:10169:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235a900 going to sleep for 11 seconds 00000100:00100000:2.0:1788639150.147651:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639150.147753:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754079360 00000100:00100000:0.0:1788639150.147762:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754079360 00010000:00010000:0.0:1788639150.147812:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262cc8d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856d8 expref: 43 pid: 6518 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639150.147900:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 85 00000100:00100000:0.0:1788639150.147910:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243398380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+43:2408:x1875523754079360:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788639150.147926:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788639150.147934:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262cc8d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856d8 expref: 43 pid: 6518 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.147946:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262cc8d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856d8 expref: 43 pid: 6518 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.147967:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242374b00) 00010000:00010000:0.0:1788639150.147972:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9200/0x25c454990262ccbe lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.147982:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9200/0x25c454990262ccbe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.148003:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9200/0x25c454990262ccbe lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.148021:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788639150.148081:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243398380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+43:2408:x1875523754079360:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 172us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639150.148089:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 85 00010000:00010000:3.0:1788639150.148539:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262cc8d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856d8 expref: 42 pid: 6518 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639150.148558:0:10169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10169:1875523773017728:192.168.206.18@tcp:104: 00010000:00010000:3.0:1788639150.148596:0:10169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9200/0x25c454990262ccbe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.148606:0:10169:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9200/0x25c454990262ccbe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.148611:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9200/0x25c454990262ccbe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788639150.148855:0:10169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788639150.149005:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262ccb7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856e6 expref: 43 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.149023:0:10169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9200/0x25c454990262ccbe lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856e6 expref: 42 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.149031:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242374b00) 00010000:00010000:3.0:1788639150.149034:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788639150.149036:0:10169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f9200, rc 0) 00000100:00100000:3.0:1788639150.149079:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243314a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+42:12305:x1875523754079232:12345-192.168.206.18@tcp:101:dd.0 Request processed in 7960us (8548us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1788639150.149087:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 168 00000100:00100000:2.0:1788639150.155484:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639150.155570:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754079488 00000100:00100000:1.0:1788639150.155580:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754079488 00000100:00100000:1.0:1788639150.155778:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 169 00000100:00100000:1.0:1788639150.155787:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3461b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+42:12305:x1875523754079488:12345-192.168.206.18@tcp:101:dd.0 00010000:00010000:1.0:1788639150.155807:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639150.155826:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262cccc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e856ed expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639150.155858:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262ccd3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639150.155871:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262ccd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639150.155882:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262ccd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639150.156057:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262cccc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856ed expref: 44 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639150.156088:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262ccd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856ed expref: 43 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639150.156097:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242374b00) 00010000:00010000:1.0:1788639150.156100:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788639150.156104:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fa600, rc 0) 00000100:00100000:1.0:1788639150.156292:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3461b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+43:12305:x1875523754079488:12345-192.168.206.18@tcp:101:dd.0 Request processed in 505us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639150.156300:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 169 00000100:00100000:3.0:1788639150.159155:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639150.159262:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754079744 00000100:00100000:0.0:1788639150.159271:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754079744 00000100:00100000:0.0:1788639150.159353:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 170 00000100:00100000:0.0:1788639150.159368:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+43:12305:x1875523754079744:12345-192.168.206.18@tcp:36:dd.0 00010000:00010000:0.0:1788639150.160024:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5400/0x25c454990262ccda lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.160043:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5400/0x25c454990262ccda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.160055:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5400/0x25c454990262ccda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788639150.160170:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1788639150.160199:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002a9895a0 reply state 0000000093dd6920 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5400/0x25c454990262ccda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.160213:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5400/0x25c454990262ccda lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.160221:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242374b00) 00010000:00010000:0.0:1788639150.160224:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788639150.160245:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788639150.160413:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+46:12305:x1875523754079744:12345-192.168.206.18@tcp:36:dd.0 Request processed in 1045us (1264us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1788639150.160420:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 170 00000020:00080000:0.0:1788639150.160425:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788639150.413263:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639150.413345:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754079872 00000100:00100000:3.0:1788639150.413355:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754079872 00000100:00100000:3.0:1788639150.413413:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 171 00000100:00100000:3.0:1788639150.413424:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243316d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+46:12319:x1875523754079872:12345-192.168.206.18@tcp:101:stat.0 00010000:00010000:3.0:1788639150.413445:0:10169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639150.413463:0:10169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262cce1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e856f4 expref: -99 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.413525:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262cce8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.413538:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262cce8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.413586:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262cce8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.413651:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262ccef lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.413659:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262ccef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.413667:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262ccef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.413737:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8c00/0x25c454990262ccf6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.413749:0:10169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9200/0x25c454990262ccbe lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856e6 expref: 47 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.413758:0:10169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8c00/0x25c454990262ccf6 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.413808:0:10169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9200/0x25c454990262ccbe lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856e6 expref: 47 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.413821:0:10169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9200/0x25c454990262ccbe lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856e6 expref: 47 pid: 10169 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639150.413940:0:10169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243950000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10169:1875523773017856:192.168.206.18@tcp:104: 00000100:00100000:3.0:1788639150.414050:0:10169:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235a900 going to sleep for 11 seconds 00000100:00100000:3.0:1788639150.418412:0:10169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243950000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10169:1875523773017856:192.168.206.18@tcp:104: 00010000:00010000:3.0:1788639150.418445:0:10169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8c00/0x25c454990262ccf6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639150.421443:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639150.421939:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754080128 00000100:00100000:1.0:1788639150.421948:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754080128 00000100:00100000:1.0:1788639150.422010:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 43 00000100:00100000:1.0:1788639150.422026:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243317b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+48:6174:x1875523754080128:12345-192.168.206.18@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788639150.422585:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243317b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+49:6174:x1875523754080128:12345-192.168.206.18@tcp:35:ldlm_bl.0 Request processed in 566us (1149us total) trans 4294967445 rc 0/0 00000100:00100000:1.0:1788639150.422594:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 43 00000100:00100000:2.0:1788639150.426898:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639150.427197:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754080256 00000100:00100000:1.0:1788639150.427210:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754080256 00010000:00010000:1.0:1788639150.427260:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9200/0x25c454990262ccbe lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856e6 expref: 49 pid: 10169 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639150.427356:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 86 00000100:00100000:1.0:1788639150.427369:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3461b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+49:2407:x1875523754080256:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788639150.427388:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788639150.427397:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9200/0x25c454990262ccbe lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856e6 expref: 49 pid: 10169 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639150.427432:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9200/0x25c454990262ccbe lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856e6 expref: 49 pid: 10169 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639150.427537:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9200/0x25c454990262ccbe lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856e6 expref: 49 pid: 10169 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639150.427557:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242374b00) 00010000:00010000:1.0:1788639150.427562:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8c00/0x25c454990262ccf6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639150.427573:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8c00/0x25c454990262ccf6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639150.427581:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8c00/0x25c454990262ccf6 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639150.427676:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788639150.427742:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3461b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+48:2407:x1875523754080256:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 375us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639150.427751:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 86 00010000:00010000:3.0:1788639150.427827:0:10169:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8c00/0x25c454990262ccf6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.427837:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8c00/0x25c454990262ccf6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788639150.427916:0:10169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788639150.427922:0:10169:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788639150.427955:0:10169:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8c00/0x25c454990262ccf6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.427983:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8c00/0x25c454990262ccf6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.427996:0:10169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262cce8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.428004:0:10169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262cce8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.428011:0:10169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262cce8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.428017:0:10169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f8200 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639150.428022:0:10169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262cce8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.428030:0:10169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262cce8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.428040:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ae242374600) 00010000:00010000:3.0:1788639150.428052:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639150.428057:0:10169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262cce8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.428064:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262cce8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.428076:0:10169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262ccef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.428081:0:10169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262ccef lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.428087:0:10169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262ccef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.428092:0:10169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f8400 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639150.428095:0:10169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262ccef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.428101:0:10169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262ccef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.428109:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ae242374100) 00010000:00010000:3.0:1788639150.428112:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639150.428115:0:10169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262ccef lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.428372:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262ccef lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.428413:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262cce1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856f4 expref: 48 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.428453:0:10169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8c00/0x25c454990262ccf6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856f4 expref: 47 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.428463:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242374b00) 00010000:00010000:3.0:1788639150.428465:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788639150.428468:0:10169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f8c00, rc 0) 00000100:00100000:3.0:1788639150.428510:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243316d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+47:12319:x1875523754079872:12345-192.168.206.18@tcp:101:stat.0 Request processed in 15088us (15256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639150.428517:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 171 00000100:00100000:3.0:1788639150.478756:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639150.478951:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754080512 00000100:00100000:1.0:1788639150.478966:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754080512 00000100:00100000:1.0:1788639150.479046:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 172 00000100:00100000:1.0:1788639150.479059:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+47:12325:x1875523754080512:12345-192.168.206.18@tcp:36:truncate.0 00010000:00010000:1.0:1788639150.479303:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788639150.479340:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8c00/0x25c454990262ccf6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856f4 expref: 47 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639150.479381:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242374b00) 00010000:00010000:1.0:1788639150.479387:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788639150.479605:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262ccfd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639150.479681:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262ccfd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639150.479694:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262ccfd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788639150.479745:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967446 00000004:00010000:1.0:1788639150.479770:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000066693e96 reply state 0000000060d5fdb6 transno 4294967447 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262ccfd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639150.480955:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262ccfd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639150.480966:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242374b00) 00010000:00010000:1.0:1788639150.480969:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788639150.480974:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788639150.485021:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+49:12325:x1875523754080512:12345-192.168.206.18@tcp:36:truncate.0 Request processed in 5949us (6262us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1788639150.485036:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 172 00000020:00080000:0.0:1788639150.485045:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788639150.516928:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639150.613253:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639150.614835:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754080640 00000100:00100000:0.0:1788639150.614852:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754080640 00000100:00100000:0.0:1788639150.614946:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 173 00000100:00100000:0.0:1788639150.614959:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243958380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+49:12339:x1875523754080640:12345-192.168.206.18@tcp:101:stat.0 00010000:00010000:0.0:1788639150.614992:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639150.615020:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5600/0x25c454990262cd04 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e856fb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.615110:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262cd0b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.615129:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262cd0b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.615144:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262cd0b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.615156:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262cd12 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.615187:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262cd12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.615195:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262cd12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.615319:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4a00/0x25c454990262cd19 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.615330:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4a00/0x25c454990262cd19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.615338:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4a00/0x25c454990262cd19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788639150.617547:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1788639150.617561:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788639150.617649:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4a00/0x25c454990262cd19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.617673:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4a00/0x25c454990262cd19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.617686:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262cd0b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.617694:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262cd0b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.617703:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262cd0b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.617730:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef4000 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639150.617736:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262cd0b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.617746:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262cd0b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.617765:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ae242374600) 00010000:00010000:0.0:1788639150.617768:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639150.617774:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262cd0b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.617781:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262cd0b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.617803:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262cd12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.617810:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262cd12 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.617816:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262cd12 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.617822:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef5000 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639150.617825:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262cd12 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.617831:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262cd12 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.617851:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ae242374100) 00010000:00010000:0.0:1788639150.617854:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639150.617857:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262cd12 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.617863:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262cd12 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.617914:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5600/0x25c454990262cd04 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856fb expref: 51 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.617931:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4a00/0x25c454990262cd19 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856fb expref: 50 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.617939:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242374b00) 00010000:00010000:0.0:1788639150.617942:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788639150.617945:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375ef4a00, rc 0) 00000100:00100000:0.0:1788639150.618057:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243958380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+50:12339:x1875523754080640:12345-192.168.206.18@tcp:101:stat.0 Request processed in 3098us (4814us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639150.618068:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 173 00000100:00100000:2.0:1788639150.694315:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639150.694493:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754080896 00000100:00100000:3.0:1788639150.694508:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754080896 00000100:00100000:3.0:1788639150.694688:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 174 00000100:00100000:3.0:1788639150.694701:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243991180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+50:12349:x1875523754080896:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:3.0:1788639150.694847:0:10169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639150.694878:0:10169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262cd20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85702 expref: -99 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788639150.695358:0:10169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788639150.695523:0:10169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262cd20 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85702 expref: 52 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.695542:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae242358200) 00010000:00010000:3.0:1788639150.695545:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788639150.695570:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262cd20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85702 expref: 52 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.695603:0:10169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f9c00, rc 0) 00000100:00100000:3.0:1788639150.695756:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243991180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+51:12349:x1875523754080896:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 1056us (1456us total) trans 4294967448 rc 301/301 00000100:00100000:3.0:1788639150.695765:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 174 00000100:00100000:3.0:1788639150.698127:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639150.698282:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754081152 00000100:00100000:2.0:1788639150.698296:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754081152 00000100:00100000:2.0:1788639150.698369:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 44 00000100:00100000:2.0:1788639150.698381:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ef2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+51:12349:x1875523754081152:12345-192.168.206.18@tcp:35:lfs.0 00000100:00100000:2.0:1788639150.698758:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ef2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+52:12349:x1875523754081152:12345-192.168.206.18@tcp:35:lfs.0 Request processed in 378us (644us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1788639150.698768:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 44 00000100:00100000:0.0:1788639150.744072:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639150.744312:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754081408 00000100:00100000:1.0:1788639150.744327:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754081408 00000100:00100000:1.0:1788639150.744477:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 175 00000100:00100000:1.0:1788639150.744491:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243317100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+52:12355:x1875523754081408:12345-192.168.206.18@tcp:101:bash.0 00010000:00010000:1.0:1788639150.744530:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639150.744559:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cd2e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85709 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639150.745201:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262cd35 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639150.745222:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4a00/0x25c454990262cd19 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856fb expref: 53 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639150.745233:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262cd35 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639150.745305:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4a00/0x25c454990262cd19 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856fb expref: 53 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639150.745322:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4a00/0x25c454990262cd19 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856fb expref: 53 pid: 6518 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639150.745338:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a01500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1875523773017984:192.168.206.18@tcp:104: 00000100:00100000:1.0:1788639150.745793:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36e182780 going to sleep for 11 seconds 00000100:00100000:0.0:1788639150.753901:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639150.754080:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754081536 00000100:00100000:2.0:1788639150.754092:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754081536 00010000:00010000:2.0:1788639150.754145:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4a00/0x25c454990262cd19 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856fb expref: 54 pid: 6518 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639150.754200:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 87 00000100:00100000:2.0:1788639150.754212:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243315180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+54:2407:x1875523754081536:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788639150.754231:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788639150.754239:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4a00/0x25c454990262cd19 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856fb expref: 54 pid: 6518 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639150.754292:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4a00/0x25c454990262cd19 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856fb expref: 54 pid: 6518 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639150.754324:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242374b00) 00010000:00010000:2.0:1788639150.754330:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262cd35 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639150.754343:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262cd35 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639150.754352:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262cd35 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639150.754378:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788639150.754443:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243315180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+54:2407:x1875523754081536:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 234us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639150.754451:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 87 00010000:00010000:1.0:1788639150.754583:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4a00/0x25c454990262cd19 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856fb expref: 53 pid: 6518 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639150.754602:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a01500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1875523773017984:192.168.206.18@tcp:104: 00010000:00010000:1.0:1788639150.754678:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262cd35 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639150.754689:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262cd35 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639150.754708:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262cd35 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788639150.754732:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1788639150.754908:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cd2e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85709 expref: 54 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639150.754927:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262cd35 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85709 expref: 53 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639150.754935:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242374b00) 00010000:00010000:1.0:1788639150.754939:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788639150.754942:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fa000, rc 0) 00000100:00100000:1.0:1788639150.754974:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243317100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+53:12355:x1875523754081408:12345-192.168.206.18@tcp:101:bash.0 Request processed in 10487us (10919us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1788639150.754981:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 175 00000100:00100000:3.0:1788639150.765146:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639150.765608:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754081792 00000100:00100000:0.0:1788639150.765649:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754081792 00000100:00100000:0.0:1788639150.765726:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 176 00000100:00100000:0.0:1788639150.765739:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24395aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+53:12355:x1875523754081792:12345-192.168.206.18@tcp:36:bash.0 00010000:00010000:0.0:1788639150.766393:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262cd43 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.766434:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262cd43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.766448:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262cd43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788639150.766502:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967451 00000004:00010000:0.0:1788639150.766524:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000071e74171 reply state 0000000029d1a6e0 transno 4294967452 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262cd43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.766538:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262cd43 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.766545:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242374b00) 00010000:00010000:0.0:1788639150.766548:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788639150.766552:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788639150.766921:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24395aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+56:12355:x1875523754081792:12345-192.168.206.18@tcp:36:bash.0 Request processed in 1182us (1793us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1788639150.766931:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 176 00000020:00080000:0.0:1788639150.766942:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788639150.787579:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639150.787955:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754081920 00000100:00100000:3.0:1788639150.787969:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754081920 00000100:00100000:3.0:1788639150.788182:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 177 00000100:00100000:3.0:1788639150.788195:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243316a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+56:12355:x1875523754081920:12345-192.168.206.18@tcp:101:bash.0 00010000:00010000:3.0:1788639150.788225:0:10169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639150.788250:0:10169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262cd4a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85710 expref: -99 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.788376:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262cd51 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.788393:0:10169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262cd35 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85709 expref: 57 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.788404:0:10169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262cd51 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.788446:0:10169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262cd35 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85709 expref: 57 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.788486:0:10169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262cd35 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85709 expref: 57 pid: 6516 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639150.788503:0:10169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243959f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10169:1875523773018112:192.168.206.18@tcp:104: 00000100:00100000:3.0:1788639150.790012:0:10169:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235a300 going to sleep for 11 seconds 00000100:00100000:2.0:1788639150.802837:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639150.803164:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754082048 00000100:00100000:1.0:1788639150.803177:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754082048 00010000:00010000:1.0:1788639150.803228:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262cd35 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85709 expref: 58 pid: 6516 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639150.803286:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 88 00000100:00100000:1.0:1788639150.803298:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243991f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+58:2408:x1875523754082048:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788639150.803315:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788639150.803324:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262cd35 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85709 expref: 58 pid: 6516 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639150.803362:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262cd35 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85709 expref: 58 pid: 6516 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639150.803391:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242374b00) 00010000:00010000:1.0:1788639150.803397:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262cd51 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639150.803410:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262cd51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639150.803418:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262cd51 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639150.803442:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788639150.803515:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243991f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+58:2408:x1875523754082048:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 218us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639150.803523:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 88 00010000:00010000:3.0:1788639150.804303:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262cd35 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85709 expref: 57 pid: 6516 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639150.804327:0:10169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243959f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10169:1875523773018112:192.168.206.18@tcp:104: 00010000:00010000:3.0:1788639150.804355:0:10169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262cd51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.804366:0:10169:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262cd51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.804372:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262cd51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788639150.804437:0:10169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788639150.804442:0:10169:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788639150.804467:0:10169:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262cd51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.804503:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262cd4a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85710 expref: 57 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.804518:0:10169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262cd51 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85710 expref: 56 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.804539:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242374b00) 00010000:00010000:3.0:1788639150.804542:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788639150.804546:0:10169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f8800, rc 0) 00000100:00100000:3.0:1788639150.804697:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243316a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+56:12355:x1875523754081920:12345-192.168.206.18@tcp:101:bash.0 Request processed in 16504us (17132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639150.804706:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 177 00000100:00100000:2.0:1788639150.815221:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639150.815462:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754082304 00000100:00100000:1.0:1788639150.815476:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754082304 00000100:00100000:1.0:1788639150.815546:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 45 00000100:00100000:1.0:1788639150.815557:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243990000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+56:12355:x1875523754082304:12345-192.168.206.18@tcp:35:bash.0 00000100:00100000:1.0:1788639150.815882:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243990000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+57:12355:x1875523754082304:12345-192.168.206.18@tcp:35:bash.0 Request processed in 325us (672us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1788639150.815891:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 45 00000100:00100000:0.0:1788639150.908510:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639150.910338:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754082560 00000100:00100000:1.0:1788639150.910424:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754082560 00000100:00100000:1.0:1788639150.910512:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 178 00000100:00100000:1.0:1788639150.910543:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243316300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+57:12365:x1875523754082560:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:1.0:1788639150.910574:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639150.910815:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262cd58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85717 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788639150.911151:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788639150.911428:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262cd58 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85717 expref: 59 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639150.911473:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae242358200) 00010000:00010000:1.0:1788639150.911476:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788639150.911484:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262cd58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85717 expref: 59 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639150.911501:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fa000, rc 0) 00000100:00100000:1.0:1788639150.911585:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243316300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+58:12365:x1875523754082560:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 1045us (3089us total) trans 4294967454 rc 301/301 00000100:00100000:1.0:1788639150.912297:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 178 00000100:00100000:3.0:1788639150.915877:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639150.916481:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754082688 00000100:00100000:0.0:1788639150.916498:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754082688 00000100:00100000:0.0:1788639150.916665:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 179 00000100:00100000:0.0:1788639150.916690:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243959f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+58:12365:x1875523754082688:12345-192.168.206.18@tcp:34:lfs.0 00010000:00010000:0.0:1788639150.916807:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5600/0x25c454990262cd66 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.916851:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5600/0x25c454990262cd66 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.916866:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5600/0x25c454990262cd66 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.916883:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262cd6d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.916891:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262cd6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.916898:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262cd6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.917014:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5200/0x25c454990262cd74 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.917024:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5200/0x25c454990262cd74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.917031:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5200/0x25c454990262cd74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788639150.917109:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5200/0x25c454990262cd74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.917134:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5600/0x25c454990262cd66 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.917142:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5600/0x25c454990262cd66 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.917161:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5600/0x25c454990262cd66 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.917168:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef5600 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639150.917173:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5600/0x25c454990262cd66 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.917181:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5600/0x25c454990262cd66 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.917196:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ae242374600) 00010000:00010000:0.0:1788639150.917204:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639150.917210:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5600/0x25c454990262cd66 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.917217:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5600/0x25c454990262cd66 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.917233:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262cd6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.917240:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262cd6d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.917246:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262cd6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.917252:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef5e00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639150.917255:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262cd6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.917282:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262cd6d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.917292:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ae242374100) 00010000:00010000:0.0:1788639150.917295:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639150.917298:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262cd6d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.917304:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262cd6d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.917315:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5200/0x25c454990262cd74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.917322:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5200/0x25c454990262cd74 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.917328:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5200/0x25c454990262cd74 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.917333:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef5200 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639150.917337:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5200/0x25c454990262cd74 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.917354:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5200/0x25c454990262cd74 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.917361:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242374b00) 00010000:00010000:0.0:1788639150.917363:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639150.917366:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5200/0x25c454990262cd74 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639150.917381:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5200/0x25c454990262cd74 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639150.917492:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243959f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+58:12365:x1875523754082688:12345-192.168.206.18@tcp:34:lfs.0 Request processed in 803us (1628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639150.917502:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 179 00000100:00100000:2.0:1788639150.923260:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639150.923369:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754082944 00000100:00100000:1.0:1788639150.923383:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754082944 00000100:00100000:1.0:1788639150.923451:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 46 00000100:00100000:1.0:1788639150.923463:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243993800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+58:12365:x1875523754082944:12345-192.168.206.18@tcp:35:lfs.0 00000100:00100000:1.0:1788639150.923925:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243993800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+59:12365:x1875523754082944:12345-192.168.206.18@tcp:35:lfs.0 Request processed in 462us (681us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1788639150.923942:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 46 00000100:00100000:1.0:1788639150.977703:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639150.977936:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754083200 00000100:00100000:3.0:1788639150.977949:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754083200 00000100:00100000:3.0:1788639150.978036:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 180 00000100:00100000:3.0:1788639150.978047:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+59:12368:x1875523754083200:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:3.0:1788639150.978077:0:10169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639150.978103:0:10169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262cd7b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e8571e expref: -99 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.978390:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262cd82 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.978408:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262cd82 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.978422:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262cd82 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.978435:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262cd89 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.978443:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262cd89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.978460:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262cd89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.978758:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9e00/0x25c454990262cd90 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.978769:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9e00/0x25c454990262cd90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.978777:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9e00/0x25c454990262cd90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788639150.978788:0:10169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788639150.978882:0:10169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262cd82 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.978890:0:10169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262cd82 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.978897:0:10169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262cd82 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.978904:0:10169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f8400 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639150.978909:0:10169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262cd82 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.978918:0:10169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262cd82 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.978932:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ae242374600) 00010000:00010000:3.0:1788639150.978936:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639150.978948:0:10169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262cd82 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.978955:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262cd82 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.979209:0:10169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262cd89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.979219:0:10169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262cd89 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.979224:0:10169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262cd89 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.979228:0:10169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f8200 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639150.979231:0:10169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262cd89 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.979238:0:10169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262cd89 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.979246:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ae242374100) 00010000:00010000:3.0:1788639150.979249:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639150.979251:0:10169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262cd89 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.979256:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262cd89 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.979535:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262cd7b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8571e expref: 62 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.979567:0:10169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9e00/0x25c454990262cd90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8571e expref: 61 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.979576:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242374b00) 00010000:00010000:3.0:1788639150.979579:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788639150.979582:0:10169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f9e00, rc 0) 00000100:00100000:3.0:1788639150.979719:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+61:12368:x1875523754083200:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 1673us (2030us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1788639150.979728:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 180 00000100:00100000:3.0:1788639150.988817:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639150.989085:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754083456 00000100:00100000:1.0:1788639150.989098:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754083456 00000100:00100000:1.0:1788639150.989195:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 181 00000100:00100000:1.0:1788639150.989208:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243958000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+61:12368:x1875523754083456:12345-192.168.206.18@tcp:54:lfs.0 00010000:00010000:1.0:1788639150.989324:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cd9e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639150.989347:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cd9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639150.989364:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cd9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639150.989409:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cd9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639150.989418:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cd9e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639150.989426:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cd9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639150.989432:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fac00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639150.989437:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cd9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639150.989446:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cd9e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639150.989459:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242374b00) 00010000:00010000:1.0:1788639150.989463:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788639150.989486:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cd9e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639150.989494:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cd9e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639150.989674:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243958000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+61:12368:x1875523754083456:12345-192.168.206.18@tcp:54:lfs.0 Request processed in 469us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639150.989683:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 181 00000100:00100000:0.0:1788639150.995685:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639150.995858:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754083328 00000100:00100000:3.0:1788639150.995872:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754083328 00000100:00100000:3.0:1788639150.995958:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 13 00000100:00100000:3.0:1788639150.995979:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243314e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+61:2408:x1875523754083328:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788639150.996722:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639150.996784:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9e00/0x25c454990262cd90 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8571e expref: 61 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639150.996812:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242374b00) 00010000:00010000:3.0:1788639150.996819:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639150.996897:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243314e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+60:2408:x1875523754083328:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 928us (1226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639150.996907:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 13 00000100:00100000:0.0:1788639151.003850:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639151.004064:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754083712 00000100:00100000:2.0:1788639151.004079:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754083712 00000100:00100000:2.0:1788639151.004166:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 47 00000100:00100000:2.0:1788639151.004180:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243315f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+60:12368:x1875523754083712:12345-192.168.206.18@tcp:35:lfs.0 00000100:00100000:2.0:1788639151.004476:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243315f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+61:12368:x1875523754083712:12345-192.168.206.18@tcp:35:lfs.0 Request processed in 300us (641us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1788639151.004484:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 47 00000100:00080000:0.0:1788639151.005488:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788639151.153944:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639151.154038:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754083968 00000100:00100000:0.0:1788639151.154061:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754083968 00000100:00100000:0.0:1788639151.154147:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 182 00000100:00100000:0.0:1788639151.154160:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+61:12386:x1875523754083968:12345-192.168.206.18@tcp:101:cat.0 00010000:00010000:0.0:1788639151.154193:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639151.154225:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262cda5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85725 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.154370:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5600/0x25c454990262cdac lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.154389:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5600/0x25c454990262cdac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.154403:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5600/0x25c454990262cdac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788639151.154416:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788639151.155506:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262cda5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85725 expref: 64 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.155563:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5600/0x25c454990262cdac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85725 expref: 63 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.155574:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242374b00) 00010000:00010000:0.0:1788639151.155577:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788639151.155581:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375ef5600, rc 0) 00000100:00100000:0.0:1788639151.155749:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+63:12386:x1875523754083968:12345-192.168.206.18@tcp:101:cat.0 Request processed in 1590us (1819us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1788639151.155758:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 182 00000100:00100000:2.0:1788639151.176414:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639151.176479:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754084096 00000100:00100000:3.0:1788639151.176500:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754084096 00000100:00100000:3.0:1788639151.176675:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 183 00000100:00100000:3.0:1788639151.176689:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243993480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+63:12387:x1875523754084096:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:3.0:1788639151.176721:0:10169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639151.176749:0:10169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9e00/0x25c454990262cdba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e8572c expref: -99 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.176858:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262cdc1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.176876:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262cdc1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.176890:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262cdc1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788639151.176945:0:10169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788639151.176950:0:10169:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788639151.176972:0:10169:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262cdc1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.177005:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9e00/0x25c454990262cdba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8572c expref: 65 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.177026:0:10169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262cdc1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8572c expref: 64 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.177036:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ae242374600) 00010000:00010000:3.0:1788639151.177039:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788639151.177043:0:10169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f9c00, rc 0) 00000100:00100000:3.0:1788639151.177132:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243993480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+64:12387:x1875523754084096:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 447us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639151.177140:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 183 00000100:00100000:3.0:1788639151.180755:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639151.180872:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754084480 00000100:00100000:2.0:1788639151.180885:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754084480 00000100:00100000:2.0:1788639151.180955:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 48 00000100:00100000:2.0:1788639151.180966:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+64:12387:x1875523754084480:12345-192.168.206.18@tcp:35:lfs.0 00000100:00100000:2.0:1788639151.181571:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+65:12387:x1875523754084480:12345-192.168.206.18@tcp:35:lfs.0 Request processed in 602us (826us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1788639151.181582:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 48 00000100:00100000:2.0:1788639151.189246:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639151.190067:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754084608 00000100:00100000:0.0:1788639151.190083:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754084608 00000100:00100000:0.0:1788639151.190172:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 14 00000100:00100000:0.0:1788639151.190187:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243991880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+65:12387:x1875523754084608:12345-192.168.206.18@tcp:103:lfs.0 00010000:00010000:0.0:1788639151.190206:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788639151.190239:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262cd51 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85710 expref: 65 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.190266:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5600/0x25c454990262cdac lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85725 expref: 64 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.190293:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262cc4e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856ca expref: 63 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.190305:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242374b00) 00010000:00010000:0.0:1788639151.191138:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788639151.191241:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243991880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+62:12387:x1875523754084608:12345-192.168.206.18@tcp:103:lfs.0 Request processed in 1055us (2006us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639151.191251:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 14 00000100:00100000:0.0:1788639151.195424:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639151.195535:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754084736 00000100:00100000:3.0:1788639151.195549:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754084736 00000100:00100000:3.0:1788639151.195643:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 184 00000100:00100000:3.0:1788639151.195656:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243315500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+62:12387:x1875523754084736:12345-192.168.206.18@tcp:58:lfs.0 00010000:00010000:3.0:1788639151.195822:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9e00/0x25c454990262cdc8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.195844:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9e00/0x25c454990262cdc8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.195858:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9e00/0x25c454990262cdc8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788639151.196266:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1788639151.197238:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243315500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+62:12387:x1875523754084736:12345-192.168.206.18@tcp:58:lfs.0 Request processed in 1578us (1822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639151.197251:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 184 00000100:00100000:1.0:1788639151.225540:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639151.225889:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754084864 00000100:00100000:0.0:1788639151.225903:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754084864 00000100:00100000:1.0:1788639151.226409:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 185 00000100:00100000:1.0:1788639151.226425:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+62:12389:x1875523754084864:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:1.0:1788639151.226450:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639151.226476:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262cdcf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85733 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.226565:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262cdd6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.226584:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262cdd6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.226600:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262cdd6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.226613:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262cddd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.227443:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262cddd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.227475:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262cddd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.227585:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262cde4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.227596:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262cde4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.227603:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262cde4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788639151.227680:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788639151.227686:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788639151.227712:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262cde4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.227732:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262cde4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.227742:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262cdd6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.227748:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262cdd6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.227755:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262cdd6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.227761:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fa200 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639151.227766:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262cdd6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.227781:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262cdd6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.227795:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ae242374600) 00010000:00010000:1.0:1788639151.227799:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639151.227805:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262cdd6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.227811:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262cdd6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.227825:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262cddd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.227831:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262cddd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.227837:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262cddd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.227843:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fbe00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639151.227845:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262cddd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.227851:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262cddd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.227858:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ae242374100) 00010000:00010000:1.0:1788639151.227860:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639151.227863:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262cddd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.227877:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262cddd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.227918:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262cdcf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85733 expref: 64 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.227935:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262cde4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85733 expref: 63 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.228173:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242374b00) 00010000:00010000:1.0:1788639151.228176:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788639151.228179:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fb400, rc 0) 00000100:00100000:1.0:1788639151.228277:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+63:12389:x1875523754084864:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 1848us (2741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639151.228286:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 185 00000100:00100000:2.0:1788639151.285679:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773018240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788639151.285790:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639151.285846:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773018240 00000100:00100000:2.0:1788639151.285926:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788639151.285932:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773018240 00000100:00100000:2.0:1788639151.285935:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773018368:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788639151.285980:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639151.286023:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773018368 00000100:00100000:3.0:1788639151.286028:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773018368 00000100:00100000:0.0:1788639151.286050:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788639151.286068:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243992a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773018240:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788639151.286073:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788639151.286113:0:13805:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788639151.286235:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788639151.286245:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773018368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788639151.286260:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788639151.286328:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773018368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639151.286346:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788639151.286720:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243992a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773018240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 656us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639151.286727:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788639151.287141:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773018368:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788639151.287160:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773018240:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788639151.541404:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788639151.737095:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788639151.737108:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788639151.737144:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:1.0:1788639151.737151:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788639151.737335:0:13794:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a02300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1875523773018496:192.168.206.18@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788639151.737460:0:13794:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344398780 going to sleep for 11 seconds 00000100:00100000:1.0:1788639151.742295:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639151.742405:0:13794:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a02300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1875523773018496:192.168.206.18@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788639151.746258:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754084992 00000100:00100000:0.0:1788639151.746293:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754084992 00000100:00100000:0.0:1788639151.746380:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 186 00000100:00100000:0.0:1788639151.746392:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+63:12400:x1875523754084992:12345-192.168.206.18@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788639151.746435:0:10169:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788639151.746929:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+63:12400:x1875523754084992:12345-192.168.206.18@tcp:53:lhsmtool_posix.0 Request processed in 538us (4657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639151.746938:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 186 00000100:00100000:3.0:1788639151.752758:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639151.753090:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754085120 00000100:00100000:0.0:1788639151.753104:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754085120 00000100:00100000:0.0:1788639151.753179:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 187 00000100:00100000:0.0:1788639151.753192:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+63:12400:x1875523754085120:12345-192.168.206.18@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788639151.753321:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4600/0x25c454990262cdeb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.753346:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4600/0x25c454990262cdeb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.753362:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4600/0x25c454990262cdeb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.766868:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4800/0x25c454990262cdf2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.766890:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4800/0x25c454990262cdf2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.766904:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4800/0x25c454990262cdf2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.766944:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4c00/0x25c454990262cdf9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.766954:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4c00/0x25c454990262cdf9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.766960:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4c00/0x25c454990262cdf9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788639151.767015:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788639151.767020:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788639151.767036:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4c00/0x25c454990262cdf9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.767048:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4600/0x25c454990262cdeb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.767055:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4600/0x25c454990262cdeb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.767062:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4600/0x25c454990262cdeb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.767161:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef4600 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639151.767166:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4600/0x25c454990262cdeb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.767175:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4600/0x25c454990262cdeb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.767188:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ae34af01b00) 00010000:00010000:0.0:1788639151.767190:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639151.767195:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4600/0x25c454990262cdeb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.767202:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4600/0x25c454990262cdeb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.767227:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4800/0x25c454990262cdf2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.767233:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4800/0x25c454990262cdf2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.767238:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4800/0x25c454990262cdf2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.767243:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef4800 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639151.767246:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4800/0x25c454990262cdf2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.767252:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4800/0x25c454990262cdf2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.767282:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9ae2430f5a00) 00010000:00010000:0.0:1788639151.767285:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639151.767288:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4800/0x25c454990262cdf2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.767294:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4800/0x25c454990262cdf2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.767310:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4c00/0x25c454990262cdf9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.767316:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4c00/0x25c454990262cdf9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.767322:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4c00/0x25c454990262cdf9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.767326:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef4c00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639151.767339:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4c00/0x25c454990262cdf9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.767346:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4c00/0x25c454990262cdf9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.767353:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242374b00) 00010000:00010000:0.0:1788639151.767355:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639151.767358:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4c00/0x25c454990262cdf9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.767364:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4c00/0x25c454990262cdf9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639151.768018:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+63:12400:x1875523754085120:12345-192.168.206.18@tcp:34:lhsmtool_posix.0 Request processed in 14822us (15269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639151.768035:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 187 00000100:00100000:2.0:1788639151.777175:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639151.777352:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754085376 00000100:00100000:3.0:1788639151.777365:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754085376 00000100:00100000:3.0:1788639151.777446:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 188 00000100:00100000:3.0:1788639151.777459:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+63:12400:x1875523754085376:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788639151.777491:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639151.777519:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262ce00 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e8573a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.777766:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262ce07 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.777787:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262ce07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.777802:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262ce07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788639151.777816:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788639151.777982:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262ce07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.777991:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262ce07 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.777997:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262ce07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.778020:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f8400 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639151.778026:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262ce07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.778034:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262ce07 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.778049:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242374b00) 00010000:00010000:3.0:1788639151.778052:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788639151.778057:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262ce07 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.778063:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262ce07 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.778188:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262ce00 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8573a expref: 65 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.778200:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ae34af01b00) 00010000:00010000:3.0:1788639151.778202:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788639151.778206:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262ce00 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8573a expref: 65 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.778215:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f8200, rc 0) 00000100:00100000:3.0:1788639151.778308:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+64:12400:x1875523754085376:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 851us (1147us total) trans 4294967460 rc 301/301 00000100:00100000:3.0:1788639151.778316:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 188 00000100:00100000:1.0:1788639151.783372:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639151.785787:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754085504 00000100:00100000:0.0:1788639151.785807:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754085504 00000100:00100000:0.0:1788639151.785900:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 189 00000100:00100000:0.0:1788639151.785914:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+64:12400:x1875523754085504:12345-192.168.206.18@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788639151.785967:0:10169:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788639151.786791:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+64:12400:x1875523754085504:12345-192.168.206.18@tcp:53:lhsmtool_posix.0 Request processed in 874us (3427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639151.786803:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 189 00000100:00100000:0.0:1788639151.792858:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639151.793188:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754085760 00000100:00100000:3.0:1788639151.793218:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754085760 00000100:00100000:3.0:1788639151.793309:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 190 00000100:00100000:3.0:1788639151.793322:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243317800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+64:12400:x1875523754085760:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788639151.793351:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639151.793355:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788639151.793396:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262cdc1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8572c expref: 64 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.793422:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ae242374600) 00010000:00010000:3.0:1788639151.793428:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788639151.793446:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262ce15 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85741 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788639151.794759:0:6517:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:3.0:1788639151.795212:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262ce1c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.795232:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262ce1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.795245:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262ce1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.795335:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262ce15 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85741 expref: 66 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.795357:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262ce1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85741 expref: 65 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.795382:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ae242374800) 00010000:00010000:3.0:1788639151.795386:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788639151.795390:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f8400, rc 0) 00000100:00100000:3.0:1788639151.795541:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243317800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+65:12400:x1875523754085760:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 2220us (2703us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788639151.795551:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 190 00000100:00100000:2.0:1788639151.803952:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639151.812226:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754086016 00000100:00100000:0.0:1788639151.812246:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754086016 00000100:00100000:0.0:1788639151.812348:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 191 00000100:00100000:0.0:1788639151.812361:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+65:12400:x1875523754086016:12345-192.168.206.18@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788639151.812437:0:11314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788639151.812473:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262ce1c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85741 expref: 65 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.812497:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ae242374800) 00010000:00010000:0.0:1788639151.812512:0:11314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788639151.812543:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4c00/0x25c454990262ce2a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.812571:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4c00/0x25c454990262ce2a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.812593:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4c00/0x25c454990262ce2a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.823503:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262ce31 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x9376868d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.823530:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262ce31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x9376868d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.823552:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262ce31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x9376868d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.824318:0:11314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4c00/0x25c454990262ce2a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.824785:0:11314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4c00/0x25c454990262ce2a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.824796:0:11314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4c00/0x25c454990262ce2a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.824802:0:11314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef4c00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639151.824806:0:11314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4c00/0x25c454990262ce2a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.824815:0:11314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4c00/0x25c454990262ce2a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.824829:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ae242374600) 00010000:00010000:1.0:1788639151.824832:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639151.824836:0:11314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4c00/0x25c454990262ce2a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.824842:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4c00/0x25c454990262ce2a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.824870:0:11314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262ce31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x9376868d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.824876:0:11314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262ce31 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x9376868d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.824882:0:11314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262ce31 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x9376868d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.824887:0:11314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fac00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639151.824889:0:11314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262ce31 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x9376868d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.824895:0:11314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262ce31 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x9376868d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.824902:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x9376868d (ffff9ae362514a00) 00010000:00010000:1.0:1788639151.824904:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639151.824906:0:11314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262ce31 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x9376868d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.824911:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262ce31 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x9376868d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639151.825006:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+64:12400:x1875523754086016:12345-192.168.206.18@tcp:36:lhsmtool_posix.0 Request processed in 12644us (21068us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788639151.825015:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 191 00000100:00100000:1.0:1788639151.832114:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639151.832682:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754086144 00000100:00100000:0.0:1788639151.832691:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754086144 00000100:00100000:0.0:1788639151.832867:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 192 00000100:00100000:0.0:1788639151.832877:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae343062680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+64:12400:x1875523754086144:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788639151.832897:0:10169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639151.832921:0:10169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4600/0x25c454990262ce38 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85748 expref: -99 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.832960:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4400/0x25c454990262ce3f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.832986:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4400/0x25c454990262ce3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.832998:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4400/0x25c454990262ce3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.833118:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4600/0x25c454990262ce38 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85748 expref: 66 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.833136:0:10169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4400/0x25c454990262ce3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85748 expref: 65 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.833144:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ae2430f5a00) 00010000:00010000:0.0:1788639151.833147:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788639151.834280:0:10169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375ef4400, rc 0) 00000100:00100000:1.0:1788639151.834533:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae343062680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+65:12400:x1875523754086144:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 1591us (2854us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639151.834551:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 192 00000100:00100000:1.0:1788639151.840827:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639151.840985:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754086400 00000100:00100000:0.0:1788639151.840995:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754086400 00000100:00100000:0.0:1788639151.841048:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 193 00000100:00100000:0.0:1788639151.841058:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2433a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+65:12400:x1875523754086400:12345-192.168.206.18@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788639151.841137:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5c00/0x25c454990262ce46 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.841231:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5c00/0x25c454990262ce46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.841246:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5c00/0x25c454990262ce46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788639151.841505:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:0.0:1788639151.841517:0:6517:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 410635900064ns, next at 411635897298ns, rc = 0 00000004:00010000:0.0:1788639151.841879:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b3d8cf8a reply state 00000000d2adf4dc transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5c00/0x25c454990262ce46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.841894:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5c00/0x25c454990262ce46 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.841903:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ae2430f5a00) 00010000:00010000:0.0:1788639151.841907:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788639151.841912:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788639151.842079:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2433a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+67:12400:x1875523754086400:12345-192.168.206.18@tcp:36:lhsmtool_posix.0 Request processed in 1018us (1470us total) trans 4294967462 rc 0/0 00000100:00100000:1.0:1788639151.842087:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 193 00000100:00100000:1.0:1788639151.855171:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639151.855342:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754086528 00000100:00100000:0.0:1788639151.855364:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754086528 00000100:00100000:0.0:1788639151.855443:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 194 00000100:00100000:0.0:1788639151.855454:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2433a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+67:12400:x1875523754086528:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788639151.855481:0:11314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639151.855518:0:11314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4600/0x25c454990262ce4d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e8574f expref: -99 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.855584:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4600/0x25c454990262ce4d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8574f expref: 68 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.855598:0:11314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4600/0x25c454990262ce4d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8574f expref: 68 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639151.855703:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ae2430f5a00) 00010000:00010000:0.0:1788639151.855707:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788639151.855713:0:11314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375ef4600, rc 0) 00000100:00100000:0.0:1788639151.855789:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2433a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+68:12400:x1875523754086528:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 336us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639151.855797:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 194 00000100:00100000:0.0:1788639151.863543:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639151.864070:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754086656 00000100:00100000:3.0:1788639151.864176:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754086656 00000100:00100000:3.0:1788639151.864278:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 58 00000100:00100000:3.0:1788639151.864294:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243316680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2408:x1875523754086656:12345-192.168.206.18@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788639151.864607:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243316680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+7:2408:x1875523754086656:12345-192.168.206.18@tcp:2:lhsmtool_posix.0 Request processed in 318us (1142us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788639151.864666:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 58 00000100:00100000:0.0:1788639151.872639:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639151.873325:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754086912 00000100:00100000:1.0:1788639151.873345:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754086912 00000100:00100000:1.0:1788639151.873426:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 49 00000100:00100000:1.0:1788639151.873440:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243315c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+68:12400:x1875523754086912:12345-192.168.206.18@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788639151.873812:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243315c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+69:12400:x1875523754086912:12345-192.168.206.18@tcp:35:lhsmtool_posix.0 Request processed in 374us (1206us total) trans 4294967463 rc 0/0 00000100:00100000:1.0:1788639151.873822:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 49 00000100:00100000:0.0:1788639151.879374:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639151.880297:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754087168 00000100:00100000:1.0:1788639151.880309:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754087168 00000100:00100000:1.0:1788639151.880381:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 195 00000100:00100000:1.0:1788639151.880396:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+69:12400:x1875523754087168:12345-192.168.206.18@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788639151.880518:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+69:12400:x1875523754087168:12345-192.168.206.18@tcp:57:lhsmtool_posix.0 Request processed in 125us (1153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639151.880527:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 195 00000100:00100000:1.0:1788639151.882991:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639151.883067:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754087296 00000100:00100000:3.0:1788639151.883093:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754087296 00000100:00100000:3.0:1788639151.883172:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 196 00000100:00100000:3.0:1788639151.883184:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242175c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+69:12400:x1875523754087296:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788639151.883209:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639151.883239:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262ce54 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85756 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.883350:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262ce5b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.883369:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262ce5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.883393:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262ce5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788639151.883452:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788639151.883478:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262ce5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.883511:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262ce54 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85756 expref: 71 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.883532:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262ce5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85756 expref: 70 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.883555:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ae2430f5a00) 00010000:00010000:3.0:1788639151.883565:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788639151.883570:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f9c00, rc 0) 00000100:00100000:3.0:1788639151.883684:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242175c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+70:12400:x1875523754087296:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 501us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639151.883695:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 196 00000100:00100000:3.0:1788639151.897282:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639151.897355:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754087424 00000100:00100000:1.0:1788639151.897369:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754087424 00000100:00100000:1.0:1788639151.897438:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 59 00000100:00100000:1.0:1788639151.897449:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+7:2407:x1875523754087424:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788639151.897476:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639151.897498:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ecbfdf9e/0x25c454990262ce62 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e8575d expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788639151.897525:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c77b0, blocks: 0x0 00010000:00010000:1.0:1788639151.897544:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=410s v=(0 0) 00010000:00010000:1.0:1788639151.897549:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639151.897559:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecbfdf9e/0x25c454990262ce62 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8575d expref: 8 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.897577:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ecbfdf9e/0x25c454990262ce62 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8575d expref: 8 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.897589:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fac00, rc 0) 00000100:00100000:1.0:1788639151.897694:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+8:2407:x1875523754087424:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 248us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639151.897701:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 59 00000100:00100000:0.0:1788639151.905226:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639151.905303:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754087680 00000100:00100000:1.0:1788639151.905313:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754087680 00000100:00100000:1.0:1788639151.905376:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 197 00000100:00100000:1.0:1788639151.905386:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+70:12400:x1875523754087680:12345-192.168.206.18@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788639151.905493:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+70:12400:x1875523754087680:12345-192.168.206.18@tcp:57:lhsmtool_posix.0 Request processed in 108us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639151.905501:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 197 00000100:00100000:3.0:1788639151.915580:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639151.915636:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754087808 00000100:00100000:3.0:1788639151.915646:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754087808 00000100:00100000:3.0:1788639151.915698:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 60 00000100:00100000:3.0:1788639151.915708:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+8:12400:x1875523754087808:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788639151.915725:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639151.915742:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021ec1855/0x25c454990262ce69 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85764 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.915783:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ecbfdf9e/0x25c454990262ce62 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8575d expref: 9 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.915792:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639151.915796:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639151.915801:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021ec1855/0x25c454990262ce69 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85764 expref: 9 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.915836:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ecbfdf9e/0x25c454990262ce62 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8575d expref: 9 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.915850:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ecbfdf9e/0x25c454990262ce62 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8575d expref: 9 pid: 8430 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639151.915862:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b14700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1875523773018624:192.168.206.18@tcp:104: 00000100:00100000:3.0:1788639151.915954:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae343f44900 going to sleep for 11 seconds 00000100:00100000:3.0:1788639151.926097:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639151.926134:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754087936 00000100:00100000:3.0:1788639151.926142:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754087936 00010000:00010000:3.0:1788639151.926183:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ecbfdf9e/0x25c454990262ce62 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8575d expref: 10 pid: 8430 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639151.926219:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 89 00000100:00100000:3.0:1788639151.926228:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b60d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+10:2407:x1875523754087936:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788639151.926254:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639151.926287:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ecbfdf9e/0x25c454990262ce62 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8575d expref: 10 pid: 8430 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.926301:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ecbfdf9e/0x25c454990262ce62 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8575d expref: 10 pid: 8430 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.926324:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639151.926328:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639151.926337:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000021ec1855/0x25c454990262ce69 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85764 expref: 10 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.926348:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021ec1855/0x25c454990262ce69 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85764 expref: 10 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.926385:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000021ec1855/0x25c454990262ce69 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85764 expref: 10 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639151.926399:0:6502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b14a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6502:1875523773018752:192.168.206.18@tcp:105: 00000100:00100000:3.0:1788639151.926478:0:6502:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae343f44f00 going to sleep for 11 seconds 00010000:00010000:1.0:1788639151.926957:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ecbfdf9e/0x25c454990262ce62 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8575d expref: 10 pid: 8430 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639151.926978:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b14700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1875523773018624:192.168.206.18@tcp:104: 00010000:00010000:1.0:1788639151.927003:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000021ec1855/0x25c454990262ce69 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85764 expref: 9 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.927015:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f8200, rc 0) 00000100:00100000:1.0:1788639151.927050:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+9:12400:x1875523754087808:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 11343us (11477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639151.927058:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 60 00000100:00100000:0.0:1788639151.935668:0:6502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b14a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6502:1875523773018752:192.168.206.18@tcp:105: 00010000:00010000:0.0:1788639151.935693:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788639151.935807:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b60d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+8:2407:x1875523754087936:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 9579us (9718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639151.935817:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 89 00000100:00100000:2.0:1788639151.941686:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639151.941757:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754088064 00000100:00100000:3.0:1788639151.941766:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754088064 00002000:00100000:3.0:1788639151.941817:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9ae2438cca80 x1875523754088064/t0(0) o4->5deb128c-4fe3-4f51-b21e-f30846e08445@192.168.206.18@tcp:372/0 lens 504/0 e 0 to 0 dl 1788639162 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788639151.941828:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae2438cca80 with x1875523754088064 ext(0->8) 00002000:00010000:3.0:1788639151.941840:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ae2438cca80 00000100:00100000:3.0:1788639151.941874:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 4 00000100:00100000:3.0:1788639151.941883:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+8:2408:x1875523754088064:12345-192.168.206.18@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788639151.942709:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+10:2408:x1875523754088064:12345-192.168.206.18@tcp:4:lhsmtool_posix.0 Request processed in 824us (1029us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788639151.942719:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 4 00002000:00100000:3.0:1788639151.942727:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9ae2438cca80 x1875523754088064/t4294967315(0) o4->5deb128c-4fe3-4f51-b21e-f30846e08445@192.168.206.18@tcp:372/0 lens 504/448 e 0 to 0 dl 1788639162 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788639151.942736:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae2438cca80 with x1875523754088064 ext(0->8) 00002000:00010000:3.0:1788639151.942740:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ae2438cca80 00000100:00100000:3.0:1788639151.944486:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639151.944565:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754088192 00000100:00100000:2.0:1788639151.944574:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754088192 00000100:00100000:2.0:1788639151.944648:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 198 00000100:00100000:2.0:1788639151.944659:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+70:12400:x1875523754088192:12345-192.168.206.18@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788639151.950426:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967463 is committed 00000004:00080000:3.0:1788639151.950443:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00010000:00010000:1.0:1788639151.950471:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9a00/0x25c454990262cb91 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.950485:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9a00/0x25c454990262cb91 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.950494:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9a00/0x25c454990262cb91 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788639151.950499:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00010000:00010000:1.0:1788639151.950501:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f9a00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639151.950508:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9a00/0x25c454990262cb91 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788639151.950516:0:6494:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ae36e1829c0 refcount 2 committed 0 result 0 batchid 5 00010000:00010000:1.0:1788639151.950518:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9a00/0x25c454990262cb91 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788639151.950523:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ae3750def00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ae36e182d80 00000020:00080000:3.0:1788639151.950530:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ae3750deb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ae3414a0e00 00010000:00010000:1.0:1788639151.950542:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ae242374e00) 00010000:00010000:1.0:1788639151.950546:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639151.950564:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9a00/0x25c454990262cb91 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788639151.950729:0:6548:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1788639151.950795:0:6548:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1788639151.950814:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773018880:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788639151.950882:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639151.950921:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788639151.950928:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773019008:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788639151.950952:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639151.951000:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773018880 00000100:00100000:3.0:1788639151.951008:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773018880 00000100:00100000:3.0:1788639151.951049:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773019008 00000100:00100000:3.0:1788639151.951052:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773019008 00010000:00010000:1.0:1788639151.951081:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9a00/0x25c454990262cb91 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639151.951088:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788639151.951101:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523773018880:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1788639151.951111:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262cb98 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.951119:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262cb98 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.951125:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262cb98 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.951131:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f8a00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639151.951134:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262cb98 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.951141:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262cb98 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.951151:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ae242374600) 00010000:00010000:1.0:1788639151.951154:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639151.951158:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262cb98 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.951164:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262cb98 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.951179:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8e00/0x25c454990262cbd7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.951185:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8e00/0x25c454990262cbd7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.951197:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8e00/0x25c454990262cbd7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.951202:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f8e00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639151.951212:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8e00/0x25c454990262cbd7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.951218:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8e00/0x25c454990262cbd7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.951227:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ae242374100) 00010000:00010000:1.0:1788639151.951229:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639151.951232:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8e00/0x25c454990262cbd7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.951238:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8e00/0x25c454990262cbd7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.951254:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5400/0x25c454990262ccda lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.951261:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5400/0x25c454990262ccda lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.951278:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5400/0x25c454990262ccda lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.951282:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef5400 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639151.951285:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5400/0x25c454990262ccda lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.951301:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5400/0x25c454990262ccda lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.951309:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242374b00) 00010000:00010000:1.0:1788639151.951311:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639151.951313:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5400/0x25c454990262ccda lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.951329:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5400/0x25c454990262ccda lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.951344:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262ccfd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.951349:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262ccfd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.951354:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262ccfd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.951359:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fb600 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639151.951362:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262ccfd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.951367:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262ccfd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.951374:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242374b00) 00010000:00010000:1.0:1788639151.951376:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639151.951378:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262ccfd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.951396:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262ccfd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.951408:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262cd43 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.951414:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262cd43 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.951420:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262cd43 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.951424:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef4000 already unused, calling callback (ffffffffc192f4f0) 00002000:00010000:3.0:1788639151.951425:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00010000:00010000:1.0:1788639151.951428:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262cd43 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788639151.951432:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788639152 00002000:00010000:3.0:1788639151.951439:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00010000:00010000:1.0:1788639151.951441:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262cd43 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788639151.951442:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788639152 -> 1788639152 00002000:00010000:3.0:1788639151.951449:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788639151.951459:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242374b00) 00010000:00010000:1.0:1788639151.951462:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639151.951466:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262cd43 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.951472:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262cd43 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.951483:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5c00/0x25c454990262ce46 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.951490:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5c00/0x25c454990262ce46 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.951500:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5c00/0x25c454990262ce46 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639151.951505:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1875523773018880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 405us (621us total) trans 4294967316 rc 0/0 00010000:00010000:1.0:1788639151.951508:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef5c00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639151.951516:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5c00/0x25c454990262ce46 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639151.951518:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00010000:1.0:1788639151.951527:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5c00/0x25c454990262ce46 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.951538:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ae2430f5a00) 00010000:00010000:1.0:1788639151.951541:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788639151.951544:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5c00/0x25c454990262ce46 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.951550:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5c00/0x25c454990262ce46 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639151.951589:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788639151.951598:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1875523773019008:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788639151.951630:0:8430:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:1.0:1788639151.951666:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9c77ae, atime: 0x6a9c77ae, ctime: 0x6a9c77ae, blocks: 0x8 00010000:00010000:1.0:1788639151.951673:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecbfdf9e/0x25c454990262ce70 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.951687:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=410s v=(0 0) 00010000:00010000:1.0:1788639151.951692:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639151.951698:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecbfdf9e/0x25c454990262ce70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788639151.951728:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ae243b17b80/2, rc 0, transno 4294967316 00010000:00010000:1.0:1788639151.951730:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ecbfdf9e/0x25c454990262ce70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639151.951738:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773018880:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1788639151.951745:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecbfdf9e/0x25c454990262ce70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.951754:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ecbfdf9e/0x25c454990262ce70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639151.951783:0:8430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788639151.951820:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788639151.951827:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ecbfdf9e/0x25c454990262ce70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.951836:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fac00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:3.0:1788639151.951840:0:8446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecbfdf9e/0x25c454990262ce70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.951849:0:8446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecbfdf9e/0x25c454990262ce70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.951863:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ecbfdf9e/0x25c454990262ce70 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.951876:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ecbfdf9e/0x25c454990262ce70 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.951893:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639151.951901:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639151.951904:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639151.951908:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3643:x1875523773019008:12345-0@lo:6:osp-syn-1-0.0 Request processed in 311us (954us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788639151.951916:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1788639151.951937:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1788639151.952287:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ae243b17100/2, rc 0, transno 4294967308 00000100:00100000:0.0:1788639151.952294:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773019008:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788639151.952540:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+19:12400:x1875523754088192:12345-192.168.206.18@tcp:44:lhsmtool_posix.0 Request processed in 7881us (8059us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639151.952557:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 198 00000100:00100000:2.0:1788639151.955491:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639151.955923:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754088320 00000100:00100000:3.0:1788639151.955933:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754088320 00000100:00100000:2.0:1788639151.956082:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 63 00000100:00100000:2.0:1788639151.956093:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+10:2407:x1875523754088320:12345-192.168.206.18@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788639151.958861:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:3.0:1788639151.958872:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:2.0:1788639151.958999:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+7:2407:x1875523754088320:12345-192.168.206.18@tcp:16:lhsmtool_posix.0 Request processed in 2904us (3512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639151.959009:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 63 00000100:00100000:0.0:1788639151.964431:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639151.965026:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754088576 00000100:00100000:3.0:1788639151.965036:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754088576 00000100:00100000:3.0:1788639151.965285:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 199 00000100:00100000:3.0:1788639151.965297:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+19:12400:x1875523754088576:12345-192.168.206.18@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788639151.965356:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639151.965382:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262ce5b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85756 expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.965397:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ae2430f5a00) 00010000:00010000:3.0:1788639151.965402:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788639151.965429:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262ce77 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.965443:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262ce77 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.965453:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262ce77 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788639151.965575:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aece47ac reply state 00000000896b5a19 transno 4294967464 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262ce77 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.965590:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262ce77 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.965596:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ae2430f5a00) 00010000:00010000:3.0:1788639151.965599:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788639151.965601:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788639151.965715:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+20:12400:x1875523754088576:12345-192.168.206.18@tcp:36:lhsmtool_posix.0 Request processed in 420us (1292us total) trans 4294967464 rc 0/0 00000100:00100000:3.0:1788639151.965723:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 199 00000100:00100000:3.0:1788639151.970757:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639151.970933:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754088704 00000100:00100000:1.0:1788639151.970944:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754088704 00000100:00100000:1.0:1788639151.971005:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 64 00000100:00100000:1.0:1788639151.971015:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+7:2408:x1875523754088704:12345-192.168.206.18@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788639151.971169:0:8430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788639151.971173:0:8430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1788639152 -> 1788639151 00002000:00010000:1.0:1788639151.971176:0:8430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788639150 00002000:00010000:1.0:1788639151.971179:0:8430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788639152 -> 1788639151 00002000:00010000:1.0:1788639151.971181:0:8430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788639151.971237:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+8:2408:x1875523754088704:12345-192.168.206.18@tcp:2:lhsmtool_posix.0 Request processed in 223us (488us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1788639151.971254:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 64 00000100:00100000:1.0:1788639151.981046:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639151.981151:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754088960 00000100:00100000:3.0:1788639151.981161:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754088960 00000100:00100000:3.0:1788639151.981251:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 200 00000100:00100000:3.0:1788639151.981262:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242174380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+20:12400:x1875523754088960:12345-192.168.206.18@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788639151.981348:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262ce7e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.981365:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4400/0x25c454990262ce3f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85748 expref: 20 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.981375:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262ce7e lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.981408:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4400/0x25c454990262ce3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85748 expref: 20 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.981434:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4400/0x25c454990262ce3f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85748 expref: 20 pid: 10169 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639151.981449:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b14e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1875523773019136:192.168.206.18@tcp:104: 00000100:00100000:3.0:1788639151.981539:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae343f44900 going to sleep for 11 seconds 00000100:00100000:3.0:1788639151.992773:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b14e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1875523773019136:192.168.206.18@tcp:104: 00000100:00100000:0.0:1788639151.992778:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00010000:00010000:3.0:1788639151.992806:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262ce7e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639151.992813:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754089088 00000100:00100000:0.0:1788639151.992821:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754089088 00010000:00010000:0.0:1788639151.992858:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4400/0x25c454990262ce3f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85748 expref: 21 pid: 10169 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639151.992901:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 90 00000100:00100000:3.0:1788639151.994573:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243314e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+21:2408:x1875523754089088:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788639151.994592:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639151.994603:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4400/0x25c454990262ce3f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85748 expref: 21 pid: 10169 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.994641:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4400/0x25c454990262ce3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85748 expref: 21 pid: 10169 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.994664:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4400/0x25c454990262ce3f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85748 expref: 21 pid: 10169 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.994678:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ae2430f5a00) 00010000:00010000:3.0:1788639151.994682:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262ce7e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.994702:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262ce7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.994709:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262ce7e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639151.994741:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639151.994799:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243314e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+20:2408:x1875523754089088:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 238us (2035us total) trans 0 rc 0/0 00010000:00010000:2.0:1788639152.001434:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262ce7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639152.001450:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262ce7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639152.001492:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262ce7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639152.001500:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262ce7e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639152.001507:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262ce7e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639152.001512:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f9c00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639152.001517:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262ce7e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639152.001525:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262ce7e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639152.001558:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ae2430f5a00) 00010000:00010000:2.0:1788639152.001561:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788639152.001566:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262ce7e lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639152.001573:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262ce7e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788639152.003439:0:14706:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788639152.003449:0:14706:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788639152.003483:0:14706:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:1.0:1788639152.003489:0:14706:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788639152.005459:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242174380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+20:12400:x1875523754088960:12345-192.168.206.18@tcp:55:lhsmtool_posix.0 Request processed in 24189us (24412us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788639152.005473:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 200 00000100:00100000:3.0:1788639152.006291:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 90 00000100:00100000:0.0:1788639152.011245:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639152.011320:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754089216 00000100:00100000:3.0:1788639152.011338:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754089216 00000100:00100000:3.0:1788639152.011410:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 65 00000100:00100000:3.0:1788639152.011421:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243314700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+8:2408:x1875523754089216:12345-192.168.206.18@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788639152.011462:0:8829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000020dc9e51/0x25c454990262ce85 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639152.011481:0:8829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000021ec1855/0x25c454990262ce69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85764 expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639152.011490:0:8829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639152.011494:0:8829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788639152.011499:0:8829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020dc9e51/0x25c454990262ce85 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639152.011533:0:8829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000021ec1855/0x25c454990262ce69 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85764 expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639152.011561:0:8829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000021ec1855/0x25c454990262ce69 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85764 expref: 8 pid: 8431 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639152.011575:0:8829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b14e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8829:1875523773019264:192.168.206.18@tcp:104: 00000100:00100000:3.0:1788639152.011670:0:8829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae343f44900 going to sleep for 11 seconds 00000100:00080000:0.0:1788639152.011763:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788639152.024408:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639152.024448:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754089344 00000100:00100000:2.0:1788639152.024456:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754089344 00010000:00010000:2.0:1788639152.024493:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000021ec1855/0x25c454990262ce69 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85764 expref: 9 pid: 8431 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639152.024532:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 91 00000100:00100000:2.0:1788639152.024543:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+9:2405:x1875523754089344:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788639152.024558:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788639152.024579:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000021ec1855/0x25c454990262ce69 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85764 expref: 9 pid: 8431 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639152.024593:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000021ec1855/0x25c454990262ce69 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85764 expref: 9 pid: 8431 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639152.024634:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788639152.024646:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788639152.024652:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000020dc9e51/0x25c454990262ce85 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639152.024662:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020dc9e51/0x25c454990262ce85 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639152.024684:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788639152.024730:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+9:2405:x1875523754089344:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 189us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639152.024738:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 91 00010000:00010000:0.0:1788639152.024968:0:8829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021ec1855/0x25c454990262ce69 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85764 expref: 8 pid: 8431 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639152.024983:0:8829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b14e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8829:1875523773019264:192.168.206.18@tcp:104: 00010000:00010000:0.0:1788639152.025005:0:8829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000020dc9e51/0x25c454990262ce85 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639152.025016:0:8829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000020dc9e51/0x25c454990262ce85 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639152.025024:0:8829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020dc9e51/0x25c454990262ce85 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639152.025043:0:8829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000020dc9e51/0x25c454990262ce85 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639152.025051:0:8829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020dc9e51/0x25c454990262ce85 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639152.025072:0:8829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020dc9e51/0x25c454990262ce85 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639152.025080:0:8829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f8000 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639152.025084:0:8829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020dc9e51/0x25c454990262ce85 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639152.025095:0:8829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020dc9e51/0x25c454990262ce85 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639152.025107:0:8829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020dc9e51/0x25c454990262ce85 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639152.025115:0:8829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020dc9e51/0x25c454990262ce85 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639152.025176:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243314700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+7:2408:x1875523754089216:12345-192.168.206.18@tcp:1:lhsmtool_posix.0 Request processed in 13757us (13939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639152.025183:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 65 00000100:00100000:2.0:1788639152.046954:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639152.047036:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754089600 00000100:00100000:3.0:1788639152.047046:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754089600 00000100:00100000:3.0:1788639152.047103:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 201 00000100:00100000:3.0:1788639152.047113:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+19:12400:x1875523754089600:12345-192.168.206.18@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788639152.047185:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9400/0x25c454990262ce8c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639152.047201:0:10169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262ccd3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856ed expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639152.047210:0:10169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9400/0x25c454990262ce8c lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639152.047242:0:10169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262ccd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856ed expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639152.047256:0:10169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262ccd3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856ed expref: 19 pid: 6516 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639152.047277:0:10169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b15f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10169:1875523773019392:192.168.206.18@tcp:104: 00000100:00100000:3.0:1788639152.047370:0:10169:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae343f44900 going to sleep for 11 seconds 00000100:00100000:3.0:1788639152.052061:0:10169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b15f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10169:1875523773019392:192.168.206.18@tcp:104: 00010000:00010000:3.0:1788639152.052102:0:10169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9400/0x25c454990262ce8c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639152.052299:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639152.052365:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754089728 00000100:00100000:3.0:1788639152.052372:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754089728 00010000:00010000:3.0:1788639152.052403:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262ccd3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856ed expref: 20 pid: 6516 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639152.052441:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 92 00000100:00100000:3.0:1788639152.052459:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243317b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+20:2407:x1875523754089728:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788639152.052476:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639152.052483:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262ccd3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856ed expref: 20 pid: 6516 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639152.052496:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262ccd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856ed expref: 20 pid: 6516 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639152.052518:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262ccd3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e856ed expref: 20 pid: 6516 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639152.052532:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242374b00) 00010000:00010000:3.0:1788639152.052537:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9400/0x25c454990262ce8c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639152.052548:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9400/0x25c454990262ce8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639152.052570:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9400/0x25c454990262ce8c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639152.052600:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639152.052668:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243317b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+19:2407:x1875523754089728:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 218us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639152.052676:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 92 00010000:00010000:1.0:1788639152.052844:0:10169:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9400/0x25c454990262ce8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639152.052853:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9400/0x25c454990262ce8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639152.053050:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262ce93 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639152.053063:0:10169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4600/0x25c454990262ce4d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8574f expref: 19 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639152.053072:0:10169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262ce93 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639152.053112:0:10169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4600/0x25c454990262ce4d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8574f expref: 19 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639152.053127:0:10169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4600/0x25c454990262ce4d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8574f expref: 19 pid: 11314 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639152.053139:0:10169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242176a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10169:1875523773019520:192.168.206.18@tcp:104: 00000100:00100000:1.0:1788639152.053199:0:10169:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3471f0840 going to sleep for 11 seconds 00000100:00100000:0.0:1788639152.056447:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639152.056520:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754089856 00000100:00100000:3.0:1788639152.056528:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754089856 00010000:00010000:3.0:1788639152.056566:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4600/0x25c454990262ce4d lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8574f expref: 20 pid: 11314 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639152.056608:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 93 00000100:00100000:3.0:1788639152.056645:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243398380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+20:2407:x1875523754089856:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788639152.056658:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639152.056665:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4600/0x25c454990262ce4d lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8574f expref: 20 pid: 11314 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639152.056679:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4600/0x25c454990262ce4d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8574f expref: 20 pid: 11314 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639152.056699:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ae2430f5a00) 00010000:00010000:3.0:1788639152.056704:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262ce93 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639152.056714:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262ce93 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639152.056734:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262ce93 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639152.056755:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639152.056805:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243398380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+20:2407:x1875523754089856:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 188us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639152.056813:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 93 00010000:00010000:1.0:1788639152.063483:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4600/0x25c454990262ce4d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8574f expref: 19 pid: 11314 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639152.063509:0:10169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242176a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10169:1875523773019520:192.168.206.18@tcp:104: 00010000:00010000:1.0:1788639152.063534:0:10169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262ce93 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639152.063544:0:10169:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262ce93 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639152.063551:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262ce93 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788639152.063672:0:10169:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:1.0:1788639152.063779:0:10169:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000001:00080000:1.0:1788639152.063817:0:10169:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:1.0:1788639152.063895:0:10169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242176a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10169:1875523773019648:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788639152.063951:0:10169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639152.063992:0:10169:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d325e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788639152.064061:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773019648 00000100:00100000:3.0:1788639152.064068:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773019648 00000100:00100000:3.0:1788639152.064121:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788639152.064128:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242176d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10169:x1875523773019648:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788639152.064201:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242176d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10169:x1875523773019648:12345-0@lo:1000:mdt00_003.0 Request processed in 73us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639152.064207:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788639152.064799:0:10169:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:1.0:1788639152.064805:0:10169:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ae243b17b80, transno 4294967316 00000100:00100000:1.0:1788639152.064825:0:10169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242176a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10169:1875523773019648:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1788639152.064942:0:10169:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00000100:00100000:1.0:1788639152.064990:0:10169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242176a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10169:1875523773019776:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788639152.065028:0:10169:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639152.065054:0:10169:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2430666c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788639152.065073:0:12414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773019776 00000100:00100000:3.0:1788639152.065078:0:12414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773019776 00000100:00100000:3.0:1788639152.065115:0:12414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788639152.065124:0:12414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242175880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:10169:x1875523773019776:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788639152.065220:0:12414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242175880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:10169:x1875523773019776:12345-0@lo:1000:mdt00_003.0 Request processed in 98us (191us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788639152.065226:0:12414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788639152.066068:0:10169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242176a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10169:1875523773019776:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1788639152.066109:0:10169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262ce93 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639152.066131:0:10169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262ce93 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639152.066139:0:10169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262ce93 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639152.066146:0:10169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fa200 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639152.066151:0:10169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262ce93 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639152.066161:0:10169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262ce93 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639152.066177:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ae2430f5a00) 00010000:00010000:0.0:1788639152.066180:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788639152.066184:0:10169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262ce93 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639152.066191:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262ce93 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639152.066289:0:10169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9e00/0x25c454990262cdc8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639152.066296:0:10169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9e00/0x25c454990262cdc8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639152.066303:0:10169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9e00/0x25c454990262cdc8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639152.066308:0:10169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f9e00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639152.066319:0:10169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9e00/0x25c454990262cdc8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639152.066326:0:10169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9e00/0x25c454990262cdc8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639152.066398:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242374b00) 00010000:00010000:0.0:1788639152.066401:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788639152.066405:0:10169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9e00/0x25c454990262cdc8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639152.066411:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9e00/0x25c454990262cdc8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639152.066439:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4a00/0x25c454990262ce9a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639152.066454:0:10169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262cde4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85733 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639152.066464:0:10169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4a00/0x25c454990262ce9a lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639152.066498:0:10169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262cde4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85733 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639152.066514:0:10169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262cde4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85733 expref: 22 pid: 6516 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639152.066527:0:10169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3461b5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10169:1875523773019904:192.168.206.18@tcp:104: 00000100:00100000:0.0:1788639152.066829:0:10169:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae342bb2540 going to sleep for 11 seconds 00000100:00100000:0.0:1788639152.071182:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639152.071256:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754089984 00000100:00100000:3.0:1788639152.071275:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754089984 00010000:00010000:3.0:1788639152.071313:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262cde4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85733 expref: 23 pid: 6516 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639152.071353:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 94 00000100:00100000:3.0:1788639152.071370:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243991f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+23:2408:x1875523754089984:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788639152.071383:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639152.071390:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262cde4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85733 expref: 23 pid: 6516 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639152.071402:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262cde4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85733 expref: 23 pid: 6516 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639152.071420:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242374b00) 00010000:00010000:3.0:1788639152.071425:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4a00/0x25c454990262ce9a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639152.071434:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4a00/0x25c454990262ce9a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639152.071441:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4a00/0x25c454990262ce9a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639152.071457:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639152.071501:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243991f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+23:2408:x1875523754089984:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 133us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639152.071508:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 94 00010000:00010000:1.0:1788639152.071542:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262cde4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85733 expref: 22 pid: 6516 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639152.071573:0:10169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3461b5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10169:1875523773019904:192.168.206.18@tcp:104: 00010000:00010000:1.0:1788639152.071595:0:10169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4a00/0x25c454990262ce9a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639152.071605:0:10169:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4a00/0x25c454990262ce9a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639152.071611:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4a00/0x25c454990262ce9a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639152.071640:0:10169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4a00/0x25c454990262ce9a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639152.071647:0:10169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4a00/0x25c454990262ce9a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639152.071654:0:10169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4a00/0x25c454990262ce9a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639152.071660:0:10169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef4a00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639152.071664:0:10169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4a00/0x25c454990262ce9a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639152.071672:0:10169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4a00/0x25c454990262ce9a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639152.071681:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242374b00) 00010000:00010000:1.0:1788639152.071684:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639152.071688:0:10169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4a00/0x25c454990262ce9a lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639152.071701:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4a00/0x25c454990262ce9a lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639152.071713:0:10169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9400/0x25c454990262ce8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639152.071719:0:10169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9400/0x25c454990262ce8c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639152.071725:0:10169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9400/0x25c454990262ce8c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639152.071731:0:10169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f9400 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639152.071736:0:10169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9400/0x25c454990262ce8c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639152.071742:0:10169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9400/0x25c454990262ce8c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639152.071751:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242374b00) 00010000:00010000:1.0:1788639152.071753:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788639152.071756:0:10169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9400/0x25c454990262ce8c lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639152.071764:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9400/0x25c454990262ce8c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639152.071891:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+21:12400:x1875523754089600:12345-192.168.206.18@tcp:57:lhsmtool_posix.0 Request processed in 24778us (24943us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1788639152.071900:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 201 00000020:00080000:1.0:1788639152.071910:0:10169:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788639152.073495:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788639152.073503:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788639152.074074:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788639152.074082:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788639152.081581:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639152.081914:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754090240 00000100:00100000:3.0:1788639152.081925:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754090240 00000100:00100000:3.0:1788639152.081996:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 50 00000100:00100000:3.0:1788639152.082016:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+21:12400:x1875523754090240:12345-192.168.206.18@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788639152.083087:0:6520:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788639152.083122:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967470 00010000:00010000:3.0:1788639152.083159:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8000/0x25c454990262cea1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639152.083253:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8000/0x25c454990262cea1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639152.083278:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8000/0x25c454990262cea1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639152.083288:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8000/0x25c454990262cea1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639152.083294:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8000/0x25c454990262cea1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639152.083301:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8000/0x25c454990262cea1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639152.083327:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788639152.083429:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ef3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+23:12400:x1875523754090240:12345-192.168.206.18@tcp:35:lhsmtool_posix.0 Request processed in 1413us (1854us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1788639152.083438:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 50 00000020:00080000:3.0:1788639152.083443:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788639152.083785:0:9519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788639152.083794:0:9519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8000/0x25c454990262cea1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639152.083810:0:9519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f8000 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:1.0:1788639152.083815:0:9519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8000/0x25c454990262cea1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639152.083824:0:9519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8000/0x25c454990262cea1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639152.083836:0:9519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ae2430f5a00) 00010000:00010000:1.0:1788639152.083839:0:9519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788639152.083843:0:9519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8000/0x25c454990262cea1 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639152.083849:0:9519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8000/0x25c454990262cea1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639152.083861:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639152.083863:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639152.083865:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639152.566147:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788639153.205550:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788639153.589765:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788639153.822052:0:14757:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788639153.822062:0:14757:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788639153.822094:0:14757:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:2.0:1788639153.822100:0:14757:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788639153.844794:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523773020032:0@lo:400:kworker.0 00000100:00100000:3.0:1788639153.844859:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639153.844894:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773020544:0@lo:400:kworker.0 00000100:00100000:3.0:1788639153.844935:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639153.844953:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773021056:0@lo:400:kworker.0 00000100:00100000:3.0:1788639153.844972:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639153.844985:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773021568:0@lo:400:kworker.0 00000100:00100000:3.0:1788639153.844999:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639153.845016:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788639153.845020:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875523773020160:0@lo:400:kworker.0 00000100:00100000:3.0:1788639153.845037:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639153.845049:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875523773020672:0@lo:400:kworker.0 00000100:00100000:3.0:1788639153.845063:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639153.845074:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875523773021184:0@lo:400:kworker.0 00000100:00100000:3.0:1788639153.845088:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639153.845107:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773020288:0@lo:400:kworker.0 00000100:00100000:3.0:1788639153.845124:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639153.845135:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875523773020800:0@lo:400:kworker.0 00000100:00100000:3.0:1788639153.845150:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639153.845159:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875523773021312:0@lo:400:kworker.0 00000100:00100000:3.0:1788639153.845172:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639153.845184:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788639153.845188:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875523773020416:0@lo:400:kworker.0 00000100:00100000:1.0:1788639153.845303:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773021056 00000100:00100000:1.0:1788639153.845310:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773021056 00000100:00100000:1.0:1788639153.845355:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773021568 00000100:00100000:1.0:1788639153.845358:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773021568 00000100:00100000:3.0:1788639153.845372:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639153.845380:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788639153.845385:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773020928:0@lo:400:kworker.0 00000100:00100000:1.0:1788639153.845388:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24400b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1875523773021056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639153.845405:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639153.845415:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243315f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773021440:0@lo:400:kworker.0 00000100:00100000:3.0:1788639153.845439:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639153.845443:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24400b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1875523773021056:12345-0@lo:400:kworker.0 Request processed in 57us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639153.845450:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788639153.845460:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773020544 00000100:00100000:1.0:1788639153.845462:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773020928 00000100:00100000:3.0:1788639153.845463:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773020544 00000100:00100000:1.0:1788639153.845464:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773020928 00000100:00100000:1.0:1788639153.845476:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773021440 00000100:00100000:1.0:1788639153.845478:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773021440 00000100:00100000:3.0:1788639153.845487:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773020288 00000100:00100000:3.0:1788639153.845489:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773020288 00000100:00100000:1.0:1788639153.845490:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788639153.845495:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3641:x1875523773021568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639153.845502:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788639153.845507:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24400bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773020544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639153.845521:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3641:x1875523773021568:12345-0@lo:400:kworker.0 Request processed in 26us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639153.845527:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788639153.845533:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24400bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773020544:12345-0@lo:400:kworker.0 Request processed in 26us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639153.845537:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788639153.845539:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788639153.845543:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244009c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773020928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639153.845548:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788639153.845553:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244009f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773020288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639153.845570:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244009c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773020928:12345-0@lo:400:kworker.0 Request processed in 28us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639153.845576:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244009f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773020288:12345-0@lo:400:kworker.0 Request processed in 23us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639153.845577:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788639153.845581:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788639153.845587:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788639153.845592:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24400b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773021440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639153.845598:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773020160 00000100:00100000:3.0:1788639153.845601:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773020160 00000100:00100000:1.0:1788639153.845636:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24400b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773021440:12345-0@lo:400:kworker.0 Request processed in 44us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639153.845637:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773020672 00000100:00100000:3.0:1788639153.845639:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773020672 00000100:00100000:1.0:1788639153.845643:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788639153.845651:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773021184 00000100:00100000:3.0:1788639153.845654:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773021184 00000100:00100000:1.0:1788639153.845659:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773020800 00000100:00100000:1.0:1788639153.845661:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773020800 00000100:00100000:3.0:1788639153.845664:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773021312 00000100:00100000:3.0:1788639153.845666:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773021312 00000100:00100000:1.0:1788639153.845674:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773020416 00000100:00100000:3.0:1788639153.845677:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1788639153.845677:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773020416 00000100:00100000:3.0:1788639153.845682:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24400aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875523773020160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639153.845687:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1788639153.845699:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24400a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875523773020672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639153.845710:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24400aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875523773020160:12345-0@lo:400:kworker.0 Request processed in 28us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639153.845715:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1788639153.845723:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24400a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875523773020672:12345-0@lo:400:kworker.0 Request processed in 25us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639153.845728:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1788639153.845731:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1788639153.845737:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244008e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875523773021184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639153.845737:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1788639153.845741:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875523773020800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639153.845850:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773020032 00000100:00100000:2.0:1788639153.845854:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773020032 00000100:00100000:2.0:1788639153.845881:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1788639153.845887:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae369903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+24:3641:x1875523773020032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639153.845930:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244008e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875523773021184:12345-0@lo:400:kworker.0 Request processed in 193us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639153.845936:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1788639153.845947:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1788639153.845952:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24400b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875523773021312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639153.845978:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24400b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875523773021312:12345-0@lo:400:kworker.0 Request processed in 26us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639153.845983:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1788639153.845993:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1788639153.845999:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24400a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875523773020416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639153.846023:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24400a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875523773020416:12345-0@lo:400:kworker.0 Request processed in 25us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639153.846028:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1788639153.846050:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243991880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523773021696:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788639153.846075:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639153.846107:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773021696 00000100:00100000:3.0:1788639153.846111:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773021696 00000100:00100000:3.0:1788639153.846134:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788639153.846140:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523773021696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788639153.846159:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788639153.846194:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523773021696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639153.846217:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788639153.846277:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243991880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523773021696:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788639153.846421:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875523773020416:0@lo:400:kworker.0 00000100:00100000:3.0:1788639153.846433:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773020928:0@lo:400:kworker.0 00000100:00100000:3.0:1788639153.846441:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243315f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773021440:0@lo:400:kworker.0 00000100:00100000:3.0:1788639153.846452:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773020288:0@lo:400:kworker.0 00010000:00080000:3.0:1788639153.846462:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae243b14e00 x1875523773020800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639153.846472:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875523773020800:0@lo:400:kworker.0 00010000:00080000:3.0:1788639153.846482:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2432cb480 x1875523773021312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639153.846491:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875523773021312:0@lo:400:kworker.0 00000100:00100000:3.0:1788639153.846529:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875523773020160:0@lo:400:kworker.0 00000100:00100000:3.0:1788639153.846539:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875523773020672:0@lo:400:kworker.0 00000100:00100000:3.0:1788639153.846549:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875523773021184:0@lo:400:kworker.0 00000100:00100000:3.0:1788639153.846559:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773020544:0@lo:400:kworker.0 00000100:00100000:3.0:1788639153.846569:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773021056:0@lo:400:kworker.0 00000100:00100000:3.0:1788639153.846579:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773021568:0@lo:400:kworker.0 00000100:00100000:1.0:1788639153.847352:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875523773020800:12345-0@lo:400:kworker.0 Request processed in 1605us (2196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639153.847375:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00080000:1.0:1788639153.847404:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788639153.847411:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae369903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+24:3641:x1875523773020032:12345-0@lo:400:kworker.0 Request processed in 1523us (2551us total) trans 0 rc 0/0 00000100:00080000:1.0:1788639153.847413:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788639153.847416:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788639153.847419:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00080000:1.0:1788639153.847419:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788639153.847836:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523773020032:0@lo:400:kworker.0 00000100:00100000:3.0:1788639153.930075:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639153.930121:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754090496 00000100:00100000:3.0:1788639153.930130:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754090496 00000100:00100000:3.0:1788639153.930200:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 202 00000100:00100000:3.0:1788639153.930210:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+23:12418:x1875523754090496:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:3.0:1788639153.930234:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639153.930253:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262cea8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e8576b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639153.930362:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262ceaf lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639153.930376:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262ceaf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639153.930387:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262ceaf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788639153.930398:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788639153.930494:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262cea8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8576b expref: 26 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639153.930512:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262ceaf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8576b expref: 25 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639153.930520:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ae242374600) 00010000:00010000:3.0:1788639153.930523:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788639153.930527:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f9c00, rc 0) 00000100:00100000:3.0:1788639153.930576:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+25:12418:x1875523754090496:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 368us (511us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1788639153.930596:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 202 00000100:00080000:1.0:1788639153.931235:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788639153.939225:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639153.939273:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754090624 00000100:00100000:1.0:1788639153.939282:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754090624 00000100:00100000:1.0:1788639153.939330:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 203 00000100:00100000:1.0:1788639153.939415:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242177b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+25:12418:x1875523754090624:12345-192.168.206.18@tcp:34:lfs.0 00010000:00010000:1.0:1788639153.939487:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cebd lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639153.939504:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cebd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639153.939516:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cebd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639153.939531:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262cec4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639153.939763:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262cec4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639153.939773:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262cec4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639153.940180:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262cecb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639153.940190:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262cecb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639153.940198:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262cecb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788639153.940242:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262cecb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639153.940266:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cebd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639153.940274:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cebd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639153.940282:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cebd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639153.940288:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fa600 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639153.940292:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cebd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639153.940301:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cebd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639153.940319:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ae242374600) 00010000:00010000:1.0:1788639153.940322:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639153.940326:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cebd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639153.940402:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cebd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639153.940417:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262cec4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639153.940424:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262cec4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639153.940431:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262cec4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639153.940436:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fbe00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639153.940440:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262cec4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639153.940447:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262cec4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639153.940455:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ae362514600) 00010000:00010000:1.0:1788639153.940457:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639153.940460:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262cec4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639153.941073:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262cec4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639153.941167:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262cecb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639153.941174:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262cecb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639153.941180:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262cecb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639153.941185:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fb000 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639153.941189:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262cecb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639153.941195:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262cecb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639153.941205:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae362514200) 00010000:00010000:1.0:1788639153.941208:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639153.941212:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262cecb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639153.941218:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262cecb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639153.941400:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242177b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+25:12418:x1875523754090624:12345-192.168.206.18@tcp:34:lfs.0 Request processed in 1921us (2114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639153.941411:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 203 00000100:00100000:1.0:1788639153.979662:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639153.979756:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754090880 00000100:00100000:2.0:1788639153.979819:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754090880 00000100:00100000:2.0:1788639153.979967:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 204 00000100:00100000:2.0:1788639153.979978:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242174000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+25:12421:x1875523754090880:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:2.0:1788639153.980012:0:10169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639153.980033:0:10169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262ced2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85772 expref: -99 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639153.980099:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ae00/0x25c454990262ced9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639153.980124:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ae00/0x25c454990262ced9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639153.980136:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ae00/0x25c454990262ced9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639153.980151:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262cee0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639153.980159:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262cee0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639153.980166:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262cee0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639153.980276:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262cee7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639153.980284:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262cee7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639153.980291:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262cee7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788639153.980300:0:10169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788639153.980379:0:10169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ae00/0x25c454990262ced9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639153.980387:0:10169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ae00/0x25c454990262ced9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639153.980393:0:10169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ae00/0x25c454990262ced9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639153.980399:0:10169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78ae00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639153.980404:0:10169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ae00/0x25c454990262ced9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639153.980412:0:10169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ae00/0x25c454990262ced9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639153.980423:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ae242374600) 00010000:00010000:2.0:1788639153.980427:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639153.980430:0:10169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ae00/0x25c454990262ced9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639153.980437:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ae00/0x25c454990262ced9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639153.980451:0:10169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262cee0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639153.980456:0:10169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262cee0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639153.980462:0:10169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262cee0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639153.980477:0:10169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78a600 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639153.980480:0:10169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262cee0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639153.980486:0:10169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262cee0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639153.980493:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ae242359e00) 00010000:00010000:2.0:1788639153.980495:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639153.980498:0:10169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262cee0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639153.980503:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262cee0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639153.980537:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262ced2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85772 expref: 28 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639153.980554:0:10169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262cee7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85772 expref: 27 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639153.980562:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242359a00) 00010000:00010000:2.0:1788639153.980564:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788639153.980566:0:10169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78b200, rc 0) 00000100:00100000:2.0:1788639153.980650:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242174000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+27:12421:x1875523754090880:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 675us (1041us total) trans 4294967473 rc 0/0 00000100:00100000:2.0:1788639153.980658:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 204 00000100:00100000:3.0:1788639153.983689:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639153.983770:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754091008 00000100:00100000:0.0:1788639153.983779:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754091008 00000100:00100000:0.0:1788639153.983838:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 205 00000100:00100000:0.0:1788639153.983849:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+27:12421:x1875523754091008:12345-192.168.206.18@tcp:54:lfs.0 00010000:00010000:0.0:1788639153.983913:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4200/0x25c454990262cef5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639153.983930:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4200/0x25c454990262cef5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639153.983942:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4200/0x25c454990262cef5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639153.983975:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4200/0x25c454990262cef5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639153.983982:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4200/0x25c454990262cef5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639153.983989:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4200/0x25c454990262cef5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639153.984008:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef4200 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639153.984013:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4200/0x25c454990262cef5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639153.984021:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4200/0x25c454990262cef5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639153.984042:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242359a00) 00010000:00010000:0.0:1788639153.984045:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788639153.984066:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4200/0x25c454990262cef5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639153.984083:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4200/0x25c454990262cef5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639153.984155:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+27:12421:x1875523754091008:12345-192.168.206.18@tcp:54:lfs.0 Request processed in 307us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639153.984163:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 205 00000100:00100000:1.0:1788639153.986126:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639153.986229:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754091264 00000100:00100000:2.0:1788639153.986249:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754091264 00000100:00100000:2.0:1788639153.986308:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 51 00000100:00100000:2.0:1788639153.986318:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242175180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+27:12421:x1875523754091264:12345-192.168.206.18@tcp:35:lfs.0 00000100:00100000:2.0:1788639153.986530:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242175180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+28:12421:x1875523754091264:12345-192.168.206.18@tcp:35:lfs.0 Request processed in 213us (411us total) trans 4294967474 rc 0/0 00000100:00100000:2.0:1788639153.986538:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 51 00000100:00100000:1.0:1788639154.021543:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639154.021703:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754091520 00000100:00100000:2.0:1788639154.021713:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754091520 00000100:00100000:2.0:1788639154.021774:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 206 00000100:00100000:2.0:1788639154.021784:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242174a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+28:11946:x1875523754091520:12345-192.168.206.18@tcp:101:bash.0 00010000:00010000:2.0:1788639154.021811:0:11314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639154.021832:0:11314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262cefc lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85779 expref: -99 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639154.021952:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262cf03 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639154.021967:0:11314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262cee7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85772 expref: 29 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639154.021977:0:11314:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262cf03 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639154.022009:0:11314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262cee7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85772 expref: 29 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639154.022022:0:11314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262cee7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85772 expref: 29 pid: 10169 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639154.022062:0:11314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cd180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11314:1875523773021824:192.168.206.18@tcp:104: 00000100:00100000:2.0:1788639154.022437:0:11314:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2431a40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788639154.028529:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639154.028593:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754091648 00000100:00100000:0.0:1788639154.028602:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754091648 00010000:00010000:0.0:1788639154.028668:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262cee7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85772 expref: 30 pid: 10169 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639154.028703:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 95 00000100:00100000:0.0:1788639154.028712:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+30:2408:x1875523754091648:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788639154.028725:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788639154.028732:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262cee7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85772 expref: 30 pid: 10169 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639154.028746:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262cee7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85772 expref: 30 pid: 10169 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639154.028767:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242359a00) 00010000:00010000:0.0:1788639154.028772:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262cf03 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639154.028781:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262cf03 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639154.028808:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262cf03 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639154.028825:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788639154.028965:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+30:2408:x1875523754091648:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 253us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639154.028971:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 95 00010000:00010000:1.0:1788639154.029342:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262cee7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85772 expref: 29 pid: 10169 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639154.029368:0:11314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cd180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11314:1875523773021824:192.168.206.18@tcp:104: 00010000:00010000:1.0:1788639154.029388:0:11314:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262cf03 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.029397:0:11314:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262cf03 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.029402:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262cf03 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788639154.029420:0:11314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788639154.029551:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262cefc lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85779 expref: 30 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.029569:0:11314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262cf03 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85779 expref: 29 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.029577:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242359a00) 00010000:00010000:1.0:1788639154.029580:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788639154.029583:0:11314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78a600, rc 0) 00000100:00100000:1.0:1788639154.029612:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242174a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+29:11946:x1875523754091520:12345-192.168.206.18@tcp:101:bash.0 Request processed in 7830us (8080us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1788639154.031594:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 206 00000100:00100000:0.0:1788639154.032536:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639154.032707:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754091776 00000100:00100000:2.0:1788639154.032716:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754091776 00000100:00100000:2.0:1788639154.032798:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 207 00000100:00100000:2.0:1788639154.032810:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243991880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+29:11946:x1875523754091776:12345-192.168.206.18@tcp:101:bash.0 00010000:00010000:2.0:1788639154.032834:0:10169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639154.032869:0:10169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262cf11 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85780 expref: -99 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639154.032905:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ac00/0x25c454990262cf18 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639154.032920:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ac00/0x25c454990262cf18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639154.032933:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ac00/0x25c454990262cf18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639154.033070:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262cf11 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85780 expref: 31 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639154.033095:0:10169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ac00/0x25c454990262cf18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85780 expref: 30 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639154.033105:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242359a00) 00010000:00010000:2.0:1788639154.033114:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788639154.033118:0:10169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78ac00, rc 0) 00000100:00100000:2.0:1788639154.033395:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243991880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+30:11946:x1875523754091776:12345-192.168.206.18@tcp:101:bash.0 Request processed in 587us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639154.033402:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 207 00000100:00100000:2.0:1788639154.037453:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639154.037577:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754092032 00000100:00100000:0.0:1788639154.037587:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754092032 00000100:00100000:0.0:1788639154.037727:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 208 00000100:00100000:0.0:1788639154.037737:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+30:11946:x1875523754092032:12345-192.168.206.18@tcp:36:bash.0 00010000:00010000:0.0:1788639154.038218:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4200/0x25c454990262cf1f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639154.038240:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4200/0x25c454990262cf1f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639154.038252:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4200/0x25c454990262cf1f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788639154.038309:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000004:00010000:0.0:1788639154.038334:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ac36757d reply state 00000000804de73c transno 4294967477 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4200/0x25c454990262cf1f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639154.038347:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4200/0x25c454990262cf1f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639154.038353:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242359a00) 00010000:00010000:0.0:1788639154.038371:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788639154.038375:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788639154.038417:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967477 00000100:00100000:0.0:1788639154.038698:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+34:11946:x1875523754092032:12345-192.168.206.18@tcp:36:bash.0 Request processed in 960us (1253us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1788639154.038706:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 208 00000020:00080000:0.0:1788639154.038712:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788639154.041919:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639154.042009:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754092160 00000100:00100000:1.0:1788639154.042019:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754092160 00000100:00100000:1.0:1788639154.042083:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 209 00000100:00100000:1.0:1788639154.042118:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+34:11946:x1875523754092160:12345-192.168.206.18@tcp:101:bash.0 00010000:00010000:1.0:1788639154.042140:0:11314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639154.042160:0:11314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262cf26 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85787 expref: -99 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.042216:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262cf26 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85787 expref: 35 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.042231:0:11314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262cf26 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85787 expref: 35 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.042249:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242359a00) 00010000:00010000:1.0:1788639154.042252:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788639154.042268:0:11314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fa000, rc 0) 00000100:00100000:1.0:1788639154.042323:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+35:11946:x1875523754092160:12345-192.168.206.18@tcp:101:bash.0 Request processed in 209us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639154.042331:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 209 00000100:00100000:3.0:1788639154.047762:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639154.048358:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754092288 00000100:00100000:0.0:1788639154.048368:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754092288 00000100:00100000:0.0:1788639154.048527:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 66 00000100:00100000:0.0:1788639154.048547:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244008700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+7:11946:x1875523754092288:12345-192.168.206.18@tcp:101:bash.0 00010000:00010000:0.0:1788639154.048564:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639154.048584:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af174682/0x25c454990262cf2d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e8578e expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788639154.048607:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9c77af, atime: 0x6a9c77ae, ctime: 0x6a9c77af, blocks: 0x8 00010000:00010000:0.0:1788639154.048673:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=412s v=(0 0) 00010000:00010000:0.0:1788639154.048678:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788639154.048688:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af174682/0x25c454990262cf2d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8578e expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639154.048705:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000af174682/0x25c454990262cf2d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8578e expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639154.048719:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375ef4800, rc 0) 00000100:00100000:0.0:1788639154.048778:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244008700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+8:11946:x1875523754092288:12345-192.168.206.18@tcp:101:bash.0 Request processed in 242us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639154.048803:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 66 00000100:00080000:1.0:1788639154.049426:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788639154.050957:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639154.051021:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754092416 00000100:00100000:0.0:1788639154.051031:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754092416 00002000:00010000:0.0:1788639154.051071:0:8436:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1788639154.051076:0:8436:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae2438cdf80 with x1875523754092416 ext(0->18446744073709551615) 00002000:00010000:0.0:1788639154.051087:0:8436:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ae2438cdf80. 00000100:00100000:0.0:1788639154.051119:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 5 00000100:00100000:0.0:1788639154.051129:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+8:2408:x1875523754092416:12345-192.168.206.18@tcp:10:bash.0 00002000:00010000:0.0:1788639154.051732:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788639154.051738:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1788639151 -> 1788639154 00002000:00010000:0.0:1788639154.051740:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1788639150 -> 1788639150 00002000:00010000:0.0:1788639154.051742:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788639151 -> 1788639154 00002000:00010000:0.0:1788639154.051744:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1788639154.051859:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+9:2408:x1875523754092416:12345-192.168.206.18@tcp:10:bash.0 Request processed in 730us (907us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1788639154.051868:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 5 00002000:00010000:0.0:1788639154.051873:0:8436:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1788639154.051876:0:8436:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae2438cdf80 with x1875523754092416 ext(0->18446744073709551615) 00002000:00010000:0.0:1788639154.051881:0:8436:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ae2438cdf80. 00000040:00080000:3.0:1788639154.101568:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788639154.101578:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788639154.101710:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788639154.101718:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788639154.129058:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639154.132291:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754092544 00000100:00100000:1.0:1788639154.132305:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754092544 00000100:00100000:1.0:1788639154.132378:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 210 00000100:00100000:1.0:1788639154.132389:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+35:12435:x1875523754092544:12345-192.168.206.18@tcp:34:lfs.0 00010000:00010000:1.0:1788639154.132461:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262cf34 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.132477:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262cf34 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.132508:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262cf34 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.132525:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cf3b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.132532:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cf3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.132538:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cf3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.132603:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cf42 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.132634:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cf42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.132643:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cf42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788639154.132689:0:10169:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cf42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.132699:0:10169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262cf34 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.132705:0:10169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262cf34 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.132711:0:10169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262cf34 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.132727:0:10169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fb600 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639154.132731:0:10169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262cf34 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.132738:0:10169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262cf34 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.132750:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ae242374600) 00010000:00010000:1.0:1788639154.132753:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639154.132757:0:10169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262cf34 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.132764:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262cf34 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.132778:0:10169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cf3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.132783:0:10169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cf3b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.132789:0:10169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cf3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.132794:0:10169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fac00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639154.132796:0:10169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cf3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.132802:0:10169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cf3b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.132821:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ae362514200) 00010000:00010000:1.0:1788639154.132823:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639154.132826:0:10169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cf3b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.132832:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cf3b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.132847:0:10169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cf42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.132853:0:10169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cf42 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.132858:0:10169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cf42 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.132863:0:10169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fa600 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639154.132866:0:10169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cf42 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.132872:0:10169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cf42 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.132879:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242359a00) 00010000:00010000:1.0:1788639154.132881:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639154.132884:0:10169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cf42 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.132889:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cf42 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639154.132983:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+35:12435:x1875523754092544:12345-192.168.206.18@tcp:34:lfs.0 Request processed in 595us (3934us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639154.132992:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 210 00000100:00100000:3.0:1788639154.186750:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639154.186919:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754092800 00000100:00100000:1.0:1788639154.186929:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754092800 00000100:00100000:1.0:1788639154.188149:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 211 00000100:00100000:1.0:1788639154.188165:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+35:12439:x1875523754092800:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:1.0:1788639154.188186:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639154.188207:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cf49 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85795 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.188290:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cf50 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.188303:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cf50 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.188313:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cf50 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.188328:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262cf57 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.188334:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262cf57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.188340:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262cf57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.188460:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262cf5e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.188469:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262cf5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.188475:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262cf5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788639154.188484:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788639154.188555:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cf50 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.188562:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cf50 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.188568:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cf50 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.188574:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fac00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639154.188577:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cf50 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.188584:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cf50 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.188595:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ae242374600) 00010000:00010000:1.0:1788639154.188597:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639154.188601:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cf50 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.188633:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cf50 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.188648:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262cf57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.188653:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262cf57 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.188658:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262cf57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.188664:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fb600 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639154.188667:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262cf57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.188674:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262cf57 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.188682:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ae362514200) 00010000:00010000:1.0:1788639154.188684:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639154.188687:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262cf57 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.188693:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262cf57 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.188730:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cf49 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85795 expref: 38 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.188743:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262cf5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85795 expref: 37 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.188756:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242359a00) 00010000:00010000:1.0:1788639154.188759:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788639154.188762:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fbe00, rc 0) 00000100:00100000:1.0:1788639154.189282:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+37:12439:x1875523754092800:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 1119us (2536us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1788639154.189290:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 211 00000100:00100000:2.0:1788639154.199775:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639154.202396:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754092928 00000100:00100000:3.0:1788639154.202411:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754092928 00000100:00100000:3.0:1788639154.202519:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 212 00000100:00100000:3.0:1788639154.202530:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+37:12439:x1875523754092928:12345-192.168.206.18@tcp:54:lfs.0 00010000:00010000:3.0:1788639154.202592:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8e00/0x25c454990262cf6c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.202609:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262cf03 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85779 expref: 37 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.202633:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8e00/0x25c454990262cf6c lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.202671:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262cf03 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85779 expref: 37 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.202685:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262cf03 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85779 expref: 37 pid: 11314 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639154.202699:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24400ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1875523773021952:192.168.206.18@tcp:104: 00000100:00100000:3.0:1788639154.203936:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae37b589240 going to sleep for 11 seconds 00000100:00100000:3.0:1788639154.207515:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24400ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6516:1875523773021952:192.168.206.18@tcp:104: 00010000:00010000:3.0:1788639154.207549:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8e00/0x25c454990262cf6c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639154.209206:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639154.209307:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754093184 00000100:00100000:3.0:1788639154.209315:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754093184 00000100:00100000:3.0:1788639154.209373:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 52 00000100:00100000:3.0:1788639154.209384:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+38:6175:x1875523754093184:12345-192.168.206.18@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788639154.209690:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+39:6175:x1875523754093184:12345-192.168.206.18@tcp:35:ldlm_bl.0 Request processed in 306us (489us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1788639154.209698:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 52 00000100:00100000:2.0:1788639154.214202:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639154.214312:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754093312 00000100:00100000:0.0:1788639154.214322:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754093312 00010000:00010000:0.0:1788639154.214363:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262cf03 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85779 expref: 39 pid: 11314 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639154.214410:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 96 00000100:00100000:0.0:1788639154.214420:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b60d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+39:2407:x1875523754093312:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788639154.214450:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788639154.214458:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262cf03 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85779 expref: 39 pid: 11314 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639154.214473:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262cf03 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85779 expref: 39 pid: 11314 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639154.214497:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262cf03 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85779 expref: 39 pid: 11314 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639154.214520:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242359a00) 00010000:00010000:0.0:1788639154.214526:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8e00/0x25c454990262cf6c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639154.214536:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8e00/0x25c454990262cf6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639154.214544:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8e00/0x25c454990262cf6c lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639154.214673:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788639154.214721:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b60d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+38:2407:x1875523754093312:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 302us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639154.214729:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 96 00010000:00010000:1.0:1788639154.219192:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8e00/0x25c454990262cf6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.219211:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8e00/0x25c454990262cf6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.219270:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8e00/0x25c454990262cf6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.219277:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8e00/0x25c454990262cf6c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.219284:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8e00/0x25c454990262cf6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.219290:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f8e00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639154.219294:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8e00/0x25c454990262cf6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.219301:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8e00/0x25c454990262cf6c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.219319:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242359a00) 00010000:00010000:1.0:1788639154.219341:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788639154.219346:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8e00/0x25c454990262cf6c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.219352:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8e00/0x25c454990262cf6c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639154.219500:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+37:12439:x1875523754092928:12345-192.168.206.18@tcp:54:lfs.0 Request processed in 16968us (19738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639154.219511:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 212 00000100:00100000:2.0:1788639154.227662:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639154.227772:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754093568 00000100:00100000:3.0:1788639154.227782:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754093568 00000100:00100000:3.0:1788639154.227836:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 53 00000100:00100000:3.0:1788639154.227846:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+37:12439:x1875523754093568:12345-192.168.206.18@tcp:35:lfs.0 00000100:00100000:3.0:1788639154.228072:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+38:12439:x1875523754093568:12345-192.168.206.18@tcp:35:lfs.0 Request processed in 226us (458us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1788639154.228080:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 53 00000100:00100000:3.0:1788639154.356972:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242177100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773022080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788639154.357043:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639154.357422:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773022080 00000100:00100000:1.0:1788639154.357430:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773022080 00000100:00100000:1.0:1788639154.357485:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788639154.357495:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24400ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1875523773022080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788639154.357518:0:13805:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788639154.357562:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24400ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1875523773022080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639154.357569:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788639154.357669:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242177100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773022080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788639154.357687:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788639154.357693:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773022208:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788639154.357724:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639154.358810:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773022208 00000100:00100000:1.0:1788639154.358817:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773022208 00000100:00100000:1.0:1788639154.358870:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788639154.358879:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773022208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788639154.358908:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788639154.358970:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773022208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (1245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639154.358977:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788639154.359306:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773022208:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788639154.377598:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639154.379715:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754093824 00000100:00100000:3.0:1788639154.379729:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754093824 00000100:00100000:3.0:1788639154.379878:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 213 00000100:00100000:3.0:1788639154.379889:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243991f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+38:12450:x1875523754093824:12345-192.168.206.18@tcp:101:cat.0 00010000:00010000:3.0:1788639154.379930:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639154.379951:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262cf73 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e8579c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.380025:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262cf7a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.380040:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262cf7a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.380057:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262cf7a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.380072:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9a00/0x25c454990262cf81 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.380078:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9a00/0x25c454990262cf81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.380084:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9a00/0x25c454990262cf81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.380309:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262cf88 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.380318:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262cf88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.380324:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262cf88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788639154.380332:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:3.0:1788639154.380410:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262cf7a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.380416:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262cf7a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.380422:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262cf7a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.380427:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f8a00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639154.380431:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262cf7a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.380438:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262cf7a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.380448:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ae242374600) 00010000:00010000:3.0:1788639154.380451:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639154.380454:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262cf7a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.380460:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262cf7a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.380472:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9a00/0x25c454990262cf81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.380477:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9a00/0x25c454990262cf81 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.380482:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9a00/0x25c454990262cf81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.380486:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f9a00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639154.380493:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9a00/0x25c454990262cf81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.380499:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9a00/0x25c454990262cf81 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.380506:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ae242374000) 00010000:00010000:3.0:1788639154.380508:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639154.380510:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9a00/0x25c454990262cf81 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.380515:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9a00/0x25c454990262cf81 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.380553:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262cf73 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8579c expref: 41 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.380564:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262cf88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8579c expref: 40 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.380570:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242359a00) 00010000:00010000:3.0:1788639154.380572:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788639154.380574:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f8400, rc 0) 00000100:00100000:3.0:1788639154.380692:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243991f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+40:12450:x1875523754093824:12345-192.168.206.18@tcp:101:cat.0 Request processed in 805us (3102us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1788639154.380700:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 213 00000100:00100000:0.0:1788639154.385703:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639154.385807:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754094080 00000100:00100000:3.0:1788639154.385817:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754094080 00000100:00100000:3.0:1788639154.385874:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 54 00000100:00100000:3.0:1788639154.385884:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243990000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+40:12450:x1875523754094080:12345-192.168.206.18@tcp:35:cat.0 00000100:00100000:3.0:1788639154.386851:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243990000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+41:12450:x1875523754094080:12345-192.168.206.18@tcp:35:cat.0 Request processed in 964us (1154us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1788639154.386862:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 54 00000100:00100000:0.0:1788639154.403949:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639154.404055:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754094336 00000100:00100000:1.0:1788639154.404065:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754094336 00000100:00100000:1.0:1788639154.404139:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 214 00000100:00100000:1.0:1788639154.404150:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243993800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+41:12451:x1875523754094336:12345-192.168.206.18@tcp:36:rm.0 00010000:00010000:1.0:1788639154.404203:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1788639154.404229:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262cf26 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85787 expref: 41 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.404266:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262cf88 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8579c expref: 40 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.404281:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262cf5e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85795 expref: 39 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.404291:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ac00/0x25c454990262cf18 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85780 expref: 38 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.404304:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242359a00) 00010000:00010000:1.0:1788639154.404309:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788639154.404328:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cf96 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.404340:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cf96 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.404349:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cf96 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.404360:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262cf9d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.404366:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262cf9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.404378:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262cf9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.404447:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cfa4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.404455:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cfa4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.404460:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cfa4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788639154.404751:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:1.0:1788639154.404761:0:6518:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 413199144727ns, next at 414199142309ns, rc = 0 00010000:00010000:1.0:1788639154.404804:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262cfab lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.404813:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262cfab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.404821:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262cfab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.404829:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262cfab lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.404836:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262cfab lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.404842:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262cfab lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.404875:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788639154.404898:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cfa4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.404904:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cfa4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.404910:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cfa4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.404916:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fac00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639154.404920:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cfa4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.404928:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cfa4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.404936:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242359a00) 00010000:00010000:1.0:1788639154.404939:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788639154.404942:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cfa4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.404948:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cfa4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.404962:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cf96 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.404968:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cf96 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.404973:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cf96 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.404985:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fa600 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639154.404988:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cf96 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.404994:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cf96 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.405000:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ae242374600) 00010000:00010000:1.0:1788639154.405003:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639154.405005:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cf96 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.405010:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cf96 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788639154.405019:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b5bddfed reply state 00000000d9076529 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262cf9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.405028:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262cf9d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.405033:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ae362514200) 00010000:00010000:1.0:1788639154.405035:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788639154.405037:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788639154.405108:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243993800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+39:12451:x1875523754094336:12345-192.168.206.18@tcp:36:rm.0 Request processed in 959us (1167us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1788639154.405116:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 214 00010000:00010000:3.0:1788639154.405383:0:9520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788639154.405389:0:9520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262cfab lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.405395:0:9520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fb000 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:3.0:1788639154.405398:0:9520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262cfab lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.405404:0:9520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262cfab lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.405413:0:9520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242359a00) 00010000:00010000:3.0:1788639154.405415:0:9520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788639154.405418:0:9520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262cfab lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.405423:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262cfab lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.405433:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639154.405435:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639154.405436:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639154.445313:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639154.445434:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754094592 00000100:00100000:1.0:1788639154.445444:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754094592 00000100:00100000:1.0:1788639154.445547:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 215 00000100:00100000:1.0:1788639154.445573:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243398380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+39:12457:x1875523754094592:12345-192.168.206.18@tcp:101:bash.0 00010000:00010000:1.0:1788639154.445599:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639154.445646:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cfb2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e857a3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.445743:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cfb9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.445774:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cfb9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.445787:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cfb9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.445799:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262cfc0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.445818:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262cfc0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.445826:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262cfc0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788639154.446154:0:6516:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:1.0:1788639154.446303:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262cfc7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.446314:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262cfc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.446322:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262cfc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.446368:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cfb9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.446375:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cfb9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.446382:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cfb9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.446388:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fac00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639154.446392:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cfb9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.446399:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cfb9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.446411:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ae242374600) 00010000:00010000:1.0:1788639154.446414:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639154.446419:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cfb9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.446424:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262cfb9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788639154.446438:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c35b52f4 reply state 0000000082c78c2b transno 4294967485 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262cfc0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.446448:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262cfc0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.446454:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ae362514200) 00010000:00010000:1.0:1788639154.446463:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788639154.446467:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788639154.446493:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262cfb2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857a3 expref: 42 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.446507:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262cfc7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857a3 expref: 41 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.446514:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ae362514600) 00010000:00010000:1.0:1788639154.446515:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788639154.446517:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fa000, rc 0) 00000100:00100000:1.0:1788639154.446584:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243398380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+42:12457:x1875523754094592:12345-192.168.206.18@tcp:101:bash.0 Request processed in 1013us (1279us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1788639154.446592:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 215 00000100:00100000:1.0:1788639154.449925:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639154.450062:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754094720 00000100:00100000:0.0:1788639154.450085:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754094720 00000100:00100000:0.0:1788639154.450161:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 67 00000100:00100000:0.0:1788639154.450172:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242174700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+7:2406:x1875523754094720:12345-192.168.206.18@tcp:101:bash.0 00010000:00010000:0.0:1788639154.450188:0:8829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639154.450208:0:8829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005bbae92c/0x25c454990262cfd5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e857aa expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788639154.450230:0:8829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788639154.450248:0:8829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=413s v=(0 0) 00010000:00010000:0.0:1788639154.450263:0:8829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788639154.450272:0:8829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bbae92c/0x25c454990262cfd5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857aa expref: 8 pid: 8829 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639154.450290:0:8829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005bbae92c/0x25c454990262cfd5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857aa expref: 8 pid: 8829 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639154.450302:0:8829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375ef5e00, rc 0) 00000100:00080000:2.0:1788639154.450409:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788639154.450560:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242174700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+8:2406:x1875523754094720:12345-192.168.206.18@tcp:101:bash.0 Request processed in 388us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639154.450568:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 67 00000100:00100000:0.0:1788639154.454581:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639154.454677:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754094848 00000100:00100000:2.0:1788639154.454693:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754094848 00000100:00100000:2.0:1788639154.454749:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 68 00000100:00100000:2.0:1788639154.454759:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244035c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+8:12457:x1875523754094848:12345-192.168.206.18@tcp:101:bash.0 00010000:00010000:2.0:1788639154.454775:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639154.454793:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec1d1b7b/0x25c454990262cfdc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e857b1 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639154.454889:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005bbae92c/0x25c454990262cfd5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857aa expref: 9 pid: 8829 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639154.454899:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788639154.454903:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788639154.454908:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec1d1b7b/0x25c454990262cfdc lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857b1 expref: 9 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639154.454943:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005bbae92c/0x25c454990262cfd5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857aa expref: 9 pid: 8829 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639154.454957:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005bbae92c/0x25c454990262cfd5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857aa expref: 9 pid: 8829 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639154.454971:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1875523773022336:192.168.206.18@tcp:104: 00000100:00100000:2.0:1788639154.455173:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2431a4540 going to sleep for 11 seconds 00000100:00100000:1.0:1788639154.457514:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639154.457659:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1875523773022336:192.168.206.18@tcp:104: 00010000:00010000:2.0:1788639154.457691:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ec1d1b7b/0x25c454990262cfdc lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857b1 expref: 9 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639154.457711:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78be00, rc 0) 00000100:00100000:2.0:1788639154.457764:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244035c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+9:12457:x1875523754094848:12345-192.168.206.18@tcp:101:bash.0 Request processed in 3007us (3190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639154.457772:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 68 00000100:00100000:3.0:1788639154.460300:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754094976 00000100:00100000:3.0:1788639154.460315:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754094976 00010000:00010000:3.0:1788639154.460360:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005bbae92c/0x25c454990262cfd5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857aa expref: 9 pid: 8829 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639154.460494:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 97 00000100:00100000:3.0:1788639154.460506:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242177480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+9:2407:x1875523754094976:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788639154.460521:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639154.460542:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005bbae92c/0x25c454990262cfd5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857aa expref: 9 pid: 8829 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.460557:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005bbae92c/0x25c454990262cfd5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857aa expref: 9 pid: 8829 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.460582:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005bbae92c/0x25c454990262cfd5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857aa expref: 9 pid: 8829 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.460600:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639154.460604:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639154.460612:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ec1d1b7b/0x25c454990262cfdc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857b1 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.460712:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec1d1b7b/0x25c454990262cfdc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857b1 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.460765:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ec1d1b7b/0x25c454990262cfdc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857b1 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639154.460780:0:6502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6502:1875523773022464:192.168.206.18@tcp:105: 00000100:00100000:3.0:1788639154.460896:0:6502:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae37b589cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788639154.465978:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639154.466079:0:6502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6502:1875523773022464:192.168.206.18@tcp:105: 00010000:00010000:3.0:1788639154.466116:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639154.466173:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242177480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+8:2407:x1875523754094976:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 5670us (8666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639154.466184:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 97 00000100:00100000:2.0:1788639154.467142:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754095232 00000100:00100000:2.0:1788639154.467152:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754095232 00000100:00100000:2.0:1788639154.467209:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 55 00000100:00100000:2.0:1788639154.467218:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242177100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+42:12457:x1875523754095232:12345-192.168.206.18@tcp:35:bash.0 00000100:00100000:2.0:1788639154.467535:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242177100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+43:12457:x1875523754095232:12345-192.168.206.18@tcp:35:bash.0 Request processed in 317us (1565us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1788639154.467543:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 55 00010000:00010000:3.0:1788639154.616643:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639154.682103:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639154.683192:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754095360 00000100:00100000:3.0:1788639154.683204:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754095360 00000100:00100000:3.0:1788639154.683280:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 216 00000100:00100000:3.0:1788639154.683296:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3461b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+43:12473:x1875523754095360:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:3.0:1788639154.683321:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639154.683341:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262cfe3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e857b8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.683407:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9a00/0x25c454990262cfea lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.683421:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9a00/0x25c454990262cfea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.683433:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9a00/0x25c454990262cfea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788639154.683471:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788639154.683474:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788639154.683491:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9a00/0x25c454990262cfea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.683536:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262cfe3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857b8 expref: 45 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.683572:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9a00/0x25c454990262cfea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857b8 expref: 44 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.683581:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ae242374600) 00010000:00010000:3.0:1788639154.683592:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788639154.683597:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f9a00, rc 0) 00000100:00100000:3.0:1788639154.683691:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3461b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+44:12473:x1875523754095360:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 397us (1596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639154.683699:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 216 00000100:00100000:1.0:1788639154.689151:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639154.689298:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754095616 00000100:00100000:2.0:1788639154.689308:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754095616 00000100:00100000:2.0:1788639154.689364:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 217 00000100:00100000:2.0:1788639154.689374:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+44:12473:x1875523754095616:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:2.0:1788639154.689394:0:10169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639154.689415:0:10169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b400/0x25c454990262cff1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e857bf expref: -99 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639154.689525:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ac00/0x25c454990262cff8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639154.689540:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ac00/0x25c454990262cff8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639154.689551:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ac00/0x25c454990262cff8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788639154.689561:0:10169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788639154.689682:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b400/0x25c454990262cff1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857bf expref: 47 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639154.689707:0:10169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ac00/0x25c454990262cff8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857bf expref: 46 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639154.689725:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ae362514600) 00010000:00010000:2.0:1788639154.689728:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788639154.689732:0:10169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78ac00, rc 0) 00000100:00100000:2.0:1788639154.689841:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+46:12473:x1875523754095616:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 467us (697us total) trans 4294967487 rc 0/0 00000100:00100000:2.0:1788639154.689849:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 217 00000100:00100000:0.0:1788639154.692878:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639154.692920:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639154.692999:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754095744 00000100:00100000:3.0:1788639154.693008:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754095744 00000100:00100000:3.0:1788639154.693070:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 15 00000100:00100000:3.0:1788639154.693080:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244037480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+46:2408:x1875523754095744:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788639154.693106:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639154.693128:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ac00/0x25c454990262cff8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857bf expref: 46 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.693150:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ae362514600) 00010000:00010000:3.0:1788639154.693156:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639154.693208:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244037480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+45:2408:x1875523754095744:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 130us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639154.693216:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 15 00000100:00100000:1.0:1788639154.693529:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754096000 00000100:00100000:1.0:1788639154.693535:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754096000 00000100:00100000:1.0:1788639154.693576:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 218 00000100:00100000:1.0:1788639154.693585:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244034380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+45:12473:x1875523754096000:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:1.0:1788639154.693604:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639154.693637:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262d006 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e857c6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.693745:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262d00d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.693774:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262d00d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.693785:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262d00d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788639154.693798:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788639154.693909:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262d006 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857c6 expref: 48 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.693925:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262d00d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857c6 expref: 47 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.693933:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ae362514600) 00010000:00010000:1.0:1788639154.693936:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788639154.693938:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fa200, rc 0) 00000100:00100000:1.0:1788639154.693978:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244034380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+47:12473:x1875523754096000:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 394us (1057us total) trans 4294967488 rc 0/0 00000100:00100000:1.0:1788639154.693984:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 218 00000100:00100000:0.0:1788639154.700883:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639154.701022:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754096128 00000100:00100000:1.0:1788639154.701032:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754096128 00000100:00100000:1.0:1788639154.701096:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 69 00000100:00100000:1.0:1788639154.701118:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244035880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+8:2407:x1875523754096128:12345-192.168.206.18@tcp:1:lfs.0 00010000:00010000:1.0:1788639154.701160:0:8829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dfc560a/0x25c454990262d01b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.701181:0:8829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ec1d1b7b/0x25c454990262cfdc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857b1 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.701201:0:8829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639154.701205:0:8829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788639154.701211:0:8829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dfc560a/0x25c454990262d01b lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.701262:0:8829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ec1d1b7b/0x25c454990262cfdc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857b1 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.701278:0:8829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ec1d1b7b/0x25c454990262cfdc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857b1 expref: 8 pid: 8430 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639154.701293:0:8829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244126680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8829:1875523773022592:192.168.206.18@tcp:104: 00000100:00100000:1.0:1788639154.701389:0:8829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3801ec780 going to sleep for 11 seconds 00000100:00100000:0.0:1788639154.704937:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639154.705027:0:8829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244126680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8829:1875523773022592:192.168.206.18@tcp:104: 00010000:00010000:1.0:1788639154.705052:0:8829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003dfc560a/0x25c454990262d01b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639154.705119:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754096256 00000100:00100000:3.0:1788639154.705141:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754096256 00002000:00100000:3.0:1788639154.705187:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9ae244034000 x1875523754096256/t0(0) o4->5deb128c-4fe3-4f51-b21e-f30846e08445@192.168.206.18@tcp:375/0 lens 504/0 e 0 to 0 dl 1788639165 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788639154.705197:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae244034000 with x1875523754096256 ext(0->8) 00010000:00010000:3.0:1788639154.705204:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ec1d1b7b/0x25c454990262cfdc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857b1 expref: 9 pid: 8430 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.705219:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ec1d1b7b/0x25c454990262cfdc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857b1 expref: 9 pid: 8430 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788639154.705227:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ae244034000 00000100:00100000:3.0:1788639154.705272:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 3 00000100:00100000:3.0:1788639154.705283:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244034000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+9:2407:x1875523754096256:12345-192.168.206.18@tcp:4:lfs.0 00000100:00100000:3.0:1788639154.706671:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244034000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+11:2407:x1875523754096256:12345-192.168.206.18@tcp:4:lfs.0 Request processed in 1382us (1735us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788639154.706683:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 3 00002000:00100000:3.0:1788639154.706694:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9ae244034000 x1875523754096256/t4294967309(0) o4->5deb128c-4fe3-4f51-b21e-f30846e08445@192.168.206.18@tcp:375/0 lens 504/448 e 0 to 0 dl 1788639165 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788639154.706703:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae244034000 with x1875523754096256 ext(0->8) 00010000:00010000:3.0:1788639154.706712:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ec1d1b7b/0x25c454990262cfdc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857b1 expref: 11 pid: 8430 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.706728:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ec1d1b7b/0x25c454990262cfdc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857b1 expref: 11 pid: 8430 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788639154.706747:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ae244034000 00000001:00080000:2.0:1788639154.708414:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:2.0:1788639154.708431:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:0.0:1788639154.710965:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639154.711215:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754096384 00000100:00100000:3.0:1788639154.711225:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754096384 00010000:00010000:3.0:1788639154.711274:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ec1d1b7b/0x25c454990262cfdc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857b1 expref: 7 pid: 8430 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639154.711317:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 98 00000100:00100000:3.0:1788639154.711327:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244034700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+7:2405:x1875523754096384:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788639154.711362:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788639154.711380:0:6502:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788639154.711382:0:6502:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788639155 00002000:00010000:3.0:1788639154.711384:0:6502:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788639155 00002000:00010000:3.0:1788639154.711386:0:6502:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788639155 00002000:00010000:3.0:1788639154.711388:0:6502:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788639154.711395:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ec1d1b7b/0x25c454990262cfdc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857b1 expref: 7 pid: 8430 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.711409:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ec1d1b7b/0x25c454990262cfdc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857b1 expref: 7 pid: 8430 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.711432:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec1d1b7b/0x25c454990262cfdc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857b1 expref: 7 pid: 8430 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.711460:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788639154.711464:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788639154.711477:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003dfc560a/0x25c454990262d01b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.711488:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dfc560a/0x25c454990262d01b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.711568:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639154.711668:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244034700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+6:2405:x1875523754096384:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 342us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639154.711675:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 98 00010000:00010000:1.0:1788639154.712610:0:8829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003dfc560a/0x25c454990262d01b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.712638:0:8829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003dfc560a/0x25c454990262d01b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.712661:0:8829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dfc560a/0x25c454990262d01b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.712679:0:8829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003dfc560a/0x25c454990262d01b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.712687:0:8829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003dfc560a/0x25c454990262d01b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.712693:0:8829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fb000 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:1.0:1788639154.712698:0:8829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003dfc560a/0x25c454990262d01b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.712706:0:8829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003dfc560a/0x25c454990262d01b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.712720:0:8829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003dfc560a/0x25c454990262d01b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.712728:0:8829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dfc560a/0x25c454990262d01b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639154.712904:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244035880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2407:x1875523754096128:12345-192.168.206.18@tcp:1:lfs.0 Request processed in 11786us (12028us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639154.712914:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 69 00000100:00100000:0.0:1788639154.715873:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639154.716110:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754096640 00000100:00100000:2.0:1788639154.716121:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754096640 00000100:00100000:2.0:1788639154.716209:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 56 00000100:00100000:2.0:1788639154.716220:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ef0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+47:12473:x1875523754096640:12345-192.168.206.18@tcp:35:lfs.0 00000004:00010000:2.0:1788639154.716295:0:6519:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262d00d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857c6 expref: 47 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788639154.716474:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1788639154.716503:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:2.0:1788639154.716819:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00010000:00010000:2.0:1788639154.716866:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262d022 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639154.716882:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262cfc7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857a3 expref: 51 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639154.716891:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262d022 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639154.716939:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262cfc7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857a3 expref: 51 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639154.716953:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262cfc7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857a3 expref: 51 pid: 6516 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639154.716965:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cc380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6519:1875523773022720:192.168.206.18@tcp:104: 00000100:00100000:2.0:1788639154.717047:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2431a40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788639154.720152:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639154.720216:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754096768 00000100:00100000:3.0:1788639154.720225:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754096768 00010000:00010000:3.0:1788639154.720271:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262cfc7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857a3 expref: 52 pid: 6516 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639154.720310:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 99 00000100:00100000:3.0:1788639154.720320:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244034a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+52:2408:x1875523754096768:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788639154.720334:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639154.720341:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262cfc7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857a3 expref: 52 pid: 6516 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.720356:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262cfc7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857a3 expref: 52 pid: 6516 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.720379:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ae362514600) 00010000:00010000:3.0:1788639154.720384:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262d022 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.720413:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262d022 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.720420:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262d022 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.720439:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639154.720496:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244034a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+52:2408:x1875523754096768:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 177us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639154.720504:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 99 00010000:00010000:1.0:1788639154.720565:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262cfc7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857a3 expref: 51 pid: 6516 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639154.720593:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cc380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6519:1875523773022720:192.168.206.18@tcp:104: 00010000:00010000:1.0:1788639154.720652:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262d022 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.720662:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262d022 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.720668:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262d022 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788639154.720787:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000001:00080000:1.0:1788639154.720902:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:1.0:1788639154.721004:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244126680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6519:1875523773022848:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788639154.721049:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639154.721077:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3801ec600 going to sleep for 11 seconds 00000100:00100000:3.0:1788639154.721249:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773022848 00000100:00100000:3.0:1788639154.721262:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773022848 00000100:00100000:3.0:1788639154.721300:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788639154.721307:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6519:x1875523773022848:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788639154.721371:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6519:x1875523773022848:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 65us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639154.721377:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788639154.722195:0:6519:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:2.0:1788639154.722202:0:6519:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:2.0:1788639154.722218:0:6519:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ae243b17100, transno 4294967308 00000100:00100000:2.0:1788639154.722229:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244126680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6519:1875523773022848:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788639154.722362:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00000100:00100000:2.0:1788639154.722417:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cc380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6519:1875523773022976:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788639154.722457:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639154.722491:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2431a40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788639154.722884:0:12414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773022976 00000100:00100000:0.0:1788639154.722891:0:12414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773022976 00000100:00100000:0.0:1788639154.722937:0:12414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788639154.722946:0:12414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6519:x1875523773022976:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788639154.723118:0:12414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6519:x1875523773022976:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 173us (659us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788639154.723126:0:12414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788639154.723291:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cc380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6519:1875523773022976:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788639154.723334:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:2.0:1788639154.723372:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262d022 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639154.723382:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262d022 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639154.723391:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262d022 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639154.723415:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78bc00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639154.723420:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262d022 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639154.723428:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262d022 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639154.723442:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ae362514600) 00010000:00010000:2.0:1788639154.723444:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788639154.723449:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262d022 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639154.723455:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262d022 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788639154.723546:0:6519:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788639154.723603:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1788639154.723612:0:6519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 413517995778ns, next at 414517994030ns, rc = 0 00000001:00080000:2.0:1788639154.723657:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967496 00010000:00010000:2.0:1788639154.723679:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ae362514600) 00010000:00010000:2.0:1788639154.723682:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788639154.723688:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262d00d lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857c6 expref: 55 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639154.723838:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ef0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+54:12473:x1875523754096640:12345-192.168.206.18@tcp:35:lfs.0 Request processed in 7619us (7973us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1788639154.723846:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 56 00000020:00080000:2.0:1788639154.723850:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788639154.726285:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639154.726368:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754096896 00000100:00100000:3.0:1788639154.726377:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754096896 00000100:00100000:3.0:1788639154.726459:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 219 00000100:00100000:3.0:1788639154.726469:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+54:12473:x1875523754096896:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:3.0:1788639154.726489:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639154.726508:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262d029 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e857cd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.726559:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262d029 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857cd expref: 55 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.726595:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262d029 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857cd expref: 55 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.726646:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ae242374000) 00010000:00010000:3.0:1788639154.726649:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788639154.726653:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f8200, rc 0) 00000100:00100000:3.0:1788639154.726697:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+55:12473:x1875523754096896:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 231us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639154.726704:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 219 00000100:00100000:0.0:1788639154.730654:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639154.730796:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754097152 00000100:00100000:3.0:1788639154.730806:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754097152 00000100:00100000:3.0:1788639154.730858:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 57 00000100:00100000:3.0:1788639154.730869:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244037b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+55:12473:x1875523754097152:12345-192.168.206.18@tcp:35:lfs.0 00000100:00100000:3.0:1788639154.731098:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244037b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+56:12473:x1875523754097152:12345-192.168.206.18@tcp:35:lfs.0 Request processed in 231us (491us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1788639154.731117:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 57 00000100:00100000:0.0:1788639154.843949:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639154.844277:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754097280 00000100:00100000:3.0:1788639154.844289:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754097280 00000100:00100000:3.0:1788639154.844349:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 220 00000100:00100000:3.0:1788639154.844361:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244037100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+56:12483:x1875523754097280:12345-192.168.206.18@tcp:34:lfs.0 00010000:00010000:3.0:1788639154.844434:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262d030 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.844452:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262d030 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.844488:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262d030 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.844501:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262d037 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.844509:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262d037 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.844515:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262d037 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.844586:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262d03e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.844595:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262d03e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.844603:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262d03e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788639154.844682:0:11314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262d03e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.844697:0:11314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262d030 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.844703:0:11314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262d030 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.844710:0:11314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262d030 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.844727:0:11314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f8a00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639154.844732:0:11314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262d030 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.844739:0:11314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262d030 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.844865:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ae242374600) 00010000:00010000:3.0:1788639154.844869:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639154.844875:0:11314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262d030 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.844882:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262d030 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.844897:0:11314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262d037 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.844903:0:11314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262d037 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.844909:0:11314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262d037 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.844915:0:11314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f9800 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639154.844918:0:11314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262d037 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.844923:0:11314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262d037 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.844942:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ae362514200) 00010000:00010000:3.0:1788639154.844945:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639154.844948:0:11314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262d037 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.844955:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262d037 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.844965:0:11314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262d03e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.844971:0:11314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262d03e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.844976:0:11314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262d03e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.844980:0:11314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f8800 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639154.844983:0:11314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262d03e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.844988:0:11314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262d03e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.844994:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ae242374000) 00010000:00010000:3.0:1788639154.844996:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639154.844999:0:11314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262d03e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.845004:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262d03e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639154.845134:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244037100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+56:12483:x1875523754097280:12345-192.168.206.18@tcp:34:lfs.0 Request processed in 774us (1192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639154.845143:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 220 00000100:00100000:1.0:1788639154.869048:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788639154.869116:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773023104:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788639154.869192:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639154.869414:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773023104 00000100:00100000:3.0:1788639154.869422:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773023104 00000100:00100000:3.0:1788639154.869471:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788639154.869480:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773023104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788639154.869513:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788639154.869568:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773023104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639154.869575:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788639154.869668:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773023104:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788639154.900177:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639154.902663:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754097536 00000100:00100000:1.0:1788639154.902676:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754097536 00000100:00100000:1.0:1788639154.903056:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 221 00000100:00100000:1.0:1788639154.903069:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+56:12486:x1875523754097536:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:1.0:1788639154.903091:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639154.903112:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262d045 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e857d4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.903211:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262d04c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.903227:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262d04c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.903239:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262d04c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.903264:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262d053 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.903272:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262d053 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.903280:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262d053 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.903463:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262d05a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.903472:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262d05a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.903481:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262d05a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788639154.903491:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788639154.903564:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262d04c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.903572:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262d04c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.903585:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262d04c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.903590:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fa600 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639154.903594:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262d04c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.903601:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262d04c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.903636:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ae242374600) 00010000:00010000:1.0:1788639154.903640:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639154.903644:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262d04c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.903650:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262d04c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.903664:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262d053 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.903670:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262d053 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.903676:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262d053 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.903753:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fa000 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639154.903757:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262d053 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.903774:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262d053 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.903783:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ae362514200) 00010000:00010000:1.0:1788639154.903785:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639154.903789:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262d053 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.903795:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262d053 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.903832:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262d045 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857d4 expref: 59 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.903847:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262d05a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857d4 expref: 58 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639154.903855:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ae242374000) 00010000:00010000:1.0:1788639154.903857:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788639154.903860:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fa200, rc 0) 00000100:00100000:1.0:1788639154.904056:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+58:12486:x1875523754097536:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 989us (3887us total) trans 4294967499 rc 0/0 00000100:00100000:1.0:1788639154.904065:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 221 00000100:00100000:1.0:1788639154.915798:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639154.915887:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754097664 00000100:00100000:3.0:1788639154.915896:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754097664 00000100:00100000:3.0:1788639154.915968:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 222 00000100:00100000:3.0:1788639154.915979:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+58:12486:x1875523754097664:12345-192.168.206.18@tcp:54:lfs.0 00010000:00010000:3.0:1788639154.916043:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262d068 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.916062:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262d068 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.916074:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262d068 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.916109:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262d068 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.916117:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262d068 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.916139:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262d068 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.916145:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f8800 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639154.916150:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262d068 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.916159:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262d068 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.916171:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ae242374000) 00010000:00010000:3.0:1788639154.916174:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788639154.916179:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262d068 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639154.916185:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262d068 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639154.916270:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+58:12486:x1875523754097664:12345-192.168.206.18@tcp:54:lfs.0 Request processed in 292us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639154.916278:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 222 00000100:00100000:0.0:1788639154.920436:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639154.920521:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754097920 00000100:00100000:3.0:1788639154.920532:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754097920 00000100:00100000:3.0:1788639154.920588:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 58 00000100:00100000:3.0:1788639154.920599:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244036a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+58:12486:x1875523754097920:12345-192.168.206.18@tcp:35:lfs.0 00000100:00100000:3.0:1788639154.922670:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244036a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+59:12486:x1875523754097920:12345-192.168.206.18@tcp:35:lfs.0 Request processed in 2062us (2232us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1788639154.922684:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 58 00000100:00100000:2.0:1788639155.013827:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639155.013985:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754098176 00000100:00100000:3.0:1788639155.013995:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754098176 00000100:00100000:3.0:1788639155.014078:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 223 00000100:00100000:3.0:1788639155.014091:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+59:12496:x1875523754098176:12345-192.168.206.18@tcp:101:bash.0 00010000:00010000:3.0:1788639155.014112:0:11314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639155.014116:0:11314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788639155.014141:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9a00/0x25c454990262cfea lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857b8 expref: 59 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639155.014172:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ae242374600) 00010000:00010000:3.0:1788639155.014178:0:11314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788639155.014192:0:11314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262d06f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e857db expref: -99 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639155.014328:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262d076 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639155.014343:0:11314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262d05a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857d4 expref: 59 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639155.014352:0:11314:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262d076 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639155.014383:0:11314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262d05a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857d4 expref: 59 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639155.014398:0:11314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262d05a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857d4 expref: 59 pid: 6516 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639155.014426:0:11314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2432cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11314:1875523773023232:192.168.206.18@tcp:104: 00000100:00100000:3.0:1788639155.014533:0:11314:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae37b589240 going to sleep for 11 seconds 00000100:00080000:2.0:1788639155.014713:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788639155.020002:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639155.020071:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754098304 00000100:00100000:3.0:1788639155.020079:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754098304 00010000:00010000:3.0:1788639155.020132:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262d05a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857d4 expref: 60 pid: 6516 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639155.020179:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 100 00000100:00100000:3.0:1788639155.020189:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243314e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+60:2407:x1875523754098304:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788639155.020203:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639155.020210:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262d05a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857d4 expref: 60 pid: 6516 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639155.020435:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262d05a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857d4 expref: 60 pid: 6516 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639155.020458:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ae242374000) 00010000:00010000:3.0:1788639155.020463:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262d076 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639155.020474:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262d076 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639155.020482:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262d076 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639155.020521:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639155.020567:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243314e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+60:2407:x1875523754098304:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 379us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639155.020575:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 100 00010000:00010000:2.0:1788639155.020786:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262d05a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857d4 expref: 59 pid: 6516 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639155.020803:0:11314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2432cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11314:1875523773023232:192.168.206.18@tcp:104: 00010000:00010000:2.0:1788639155.020822:0:11314:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262d076 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639155.020831:0:11314:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262d076 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639155.020837:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262d076 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788639155.020855:0:11314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788639155.020991:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262d06f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857db expref: 60 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639155.021007:0:11314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262d076 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857db expref: 59 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639155.021014:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ae242374000) 00010000:00010000:2.0:1788639155.021017:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788639155.021019:0:11314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f9800, rc 0) 00000100:00100000:2.0:1788639155.021047:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+59:12496:x1875523754098176:12345-192.168.206.18@tcp:101:bash.0 Request processed in 6961us (7290us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1788639155.021055:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 223 00000100:00100000:0.0:1788639155.031192:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639155.033273:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754098432 00000100:00100000:1.0:1788639155.033289:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754098432 00000100:00100000:1.0:1788639155.033368:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 224 00000100:00100000:1.0:1788639155.033379:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244036300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+59:12496:x1875523754098432:12345-192.168.206.18@tcp:101:bash.0 00010000:00010000:1.0:1788639155.033418:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639155.033440:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262d084 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e857e2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639155.033473:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262d08b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639155.033486:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262d08b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639155.033497:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262d08b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639155.033601:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262d084 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857e2 expref: 61 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639155.033662:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262d08b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857e2 expref: 60 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639155.033671:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ae242374000) 00010000:00010000:1.0:1788639155.033674:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788639155.033678:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fa600, rc 0) 00000100:00100000:1.0:1788639155.033750:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244036300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+60:12496:x1875523754098432:12345-192.168.206.18@tcp:101:bash.0 Request processed in 372us (2565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639155.033757:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 224 00000100:00100000:2.0:1788639155.044994:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639155.045191:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754098688 00000100:00100000:0.0:1788639155.045201:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754098688 00000100:00100000:0.0:1788639155.045330:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 225 00000100:00100000:0.0:1788639155.045342:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+60:12496:x1875523754098688:12345-192.168.206.18@tcp:36:bash.0 00010000:00010000:0.0:1788639155.045560:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262d092 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639155.045578:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262d092 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639155.045590:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262d092 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788639155.045678:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967502 00000004:00010000:0.0:1788639155.045701:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b3c934a2 reply state 00000000b12b7d93 transno 4294967503 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262d092 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639155.045723:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262d092 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639155.045731:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ae242374000) 00010000:00010000:0.0:1788639155.045734:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788639155.045738:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788639155.045914:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+63:12496:x1875523754098688:12345-192.168.206.18@tcp:36:bash.0 Request processed in 563us (917us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1788639155.045922:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 225 00000020:00080000:0.0:1788639155.045928:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788639155.048261:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639155.048345:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754098816 00000100:00100000:3.0:1788639155.048355:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754098816 00000100:00100000:3.0:1788639155.048474:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 226 00000100:00100000:3.0:1788639155.048485:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+63:12496:x1875523754098816:12345-192.168.206.18@tcp:101:bash.0 00010000:00010000:3.0:1788639155.048507:0:11314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639155.048527:0:11314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9a00/0x25c454990262d099 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e857e9 expref: -99 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639155.048610:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262d0a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639155.048673:0:11314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262d076 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857db expref: 64 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639155.048683:0:11314:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262d0a0 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639155.048716:0:11314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262d076 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857db expref: 64 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639155.048731:0:11314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262d076 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857db expref: 64 pid: 11314 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639155.048744:0:11314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243317b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11314:1875523773023360:192.168.206.18@tcp:104: 00000100:00100000:3.0:1788639155.048858:0:11314:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae37b5896c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788639155.053891:0:11314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243317b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11314:1875523773023360:192.168.206.18@tcp:104: 00010000:00010000:3.0:1788639155.053923:0:11314:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262d0a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639155.056660:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639155.056905:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754098944 00000100:00100000:3.0:1788639155.056914:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754098944 00010000:00010000:3.0:1788639155.056951:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262d076 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857db expref: 65 pid: 11314 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639155.056994:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 101 00000100:00100000:3.0:1788639155.057002:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+65:2407:x1875523754098944:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788639155.057016:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639155.057022:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262d076 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857db expref: 65 pid: 11314 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639155.057035:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262d076 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857db expref: 65 pid: 11314 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639155.057056:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262d076 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857db expref: 65 pid: 11314 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639155.057071:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ae242374000) 00010000:00010000:3.0:1788639155.057076:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262d0a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639155.057085:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262d0a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639155.057111:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262d0a0 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639155.057141:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639155.057190:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+64:2407:x1875523754098944:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 188us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639155.057198:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 101 00010000:00010000:2.0:1788639155.057637:0:11314:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262d0a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639155.057647:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262d0a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788639155.057701:0:11314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788639155.057705:0:11314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788639155.057727:0:11314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262d0a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639155.057770:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9a00/0x25c454990262d099 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857e9 expref: 64 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639155.057786:0:11314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262d0a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857e9 expref: 63 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639155.057794:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ae242374000) 00010000:00010000:2.0:1788639155.057797:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788639155.057800:0:11314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f8a00, rc 0) 00000100:00100000:2.0:1788639155.057843:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+63:12496:x1875523754098816:12345-192.168.206.18@tcp:101:bash.0 Request processed in 9360us (9601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639155.057852:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 226 00000100:00100000:2.0:1788639155.064009:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639155.064103:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754099200 00000100:00100000:1.0:1788639155.064111:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754099200 00000100:00100000:1.0:1788639155.064167:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 59 00000100:00100000:1.0:1788639155.064177:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2432cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+63:12496:x1875523754099200:12345-192.168.206.18@tcp:35:bash.0 00000100:00100000:1.0:1788639155.064520:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2432cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+64:12496:x1875523754099200:12345-192.168.206.18@tcp:35:bash.0 Request processed in 343us (518us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1788639155.064528:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 59 00000100:00100000:0.0:1788639155.146441:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639155.146591:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754099328 00000100:00100000:3.0:1788639155.146601:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754099328 00000100:00100000:3.0:1788639155.146706:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 227 00000100:00100000:3.0:1788639155.146718:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244034e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+64:12502:x1875523754099328:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:3.0:1788639155.146741:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639155.146773:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262d0a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e857f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639155.146837:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8c00/0x25c454990262d0ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639155.146862:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8c00/0x25c454990262d0ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639155.146875:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8c00/0x25c454990262d0ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788639155.146915:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788639155.146920:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788639155.146939:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8c00/0x25c454990262d0ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639155.146985:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262d0a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857f0 expref: 66 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639155.147004:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8c00/0x25c454990262d0ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857f0 expref: 65 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639155.147012:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ae242374600) 00010000:00010000:3.0:1788639155.147015:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788639155.147019:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f8c00, rc 0) 00000100:00100000:3.0:1788639155.147191:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244034e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+65:12502:x1875523754099328:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 474us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639155.147198:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 227 00000100:00100000:2.0:1788639155.151572:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639155.152192:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754099456 00000100:00100000:1.0:1788639155.152204:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754099456 00000100:00100000:1.0:1788639155.152308:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 228 00000100:00100000:1.0:1788639155.152320:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243990000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+65:12502:x1875523754099456:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:1.0:1788639155.152340:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639155.152359:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262d0b5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e857f7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639155.152495:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262d0bc lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639155.152511:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262d0bc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639155.152523:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262d0bc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639155.152537:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262d0c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639155.152544:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262d0c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639155.152551:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262d0c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639155.152652:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262d0ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639155.152677:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262d0ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639155.152685:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262d0ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788639155.152727:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788639155.152732:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788639155.152988:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262d0ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639155.153004:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262d0ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639155.153013:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262d0bc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639155.153019:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262d0bc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639155.153025:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262d0bc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639155.153032:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fb400 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639155.153036:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262d0bc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639155.153044:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262d0bc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639155.153056:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ae242374600) 00010000:00010000:1.0:1788639155.153059:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639155.153071:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262d0bc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639155.153079:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262d0bc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639155.153165:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262d0c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639155.153173:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262d0c3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639155.153179:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262d0c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639155.153184:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fa000 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639155.153187:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262d0c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639155.153193:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262d0c3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639155.153201:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ae362514200) 00010000:00010000:1.0:1788639155.153204:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639155.153207:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262d0c3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639155.153214:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262d0c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639155.153244:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fac00/0x25c454990262d0b5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857f7 expref: 67 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639155.153288:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262d0ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857f7 expref: 66 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639155.153295:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ae242374000) 00010000:00010000:1.0:1788639155.153297:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788639155.153300:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fa200, rc 0) 00000100:00100000:1.0:1788639155.155282:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243990000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+66:12502:x1875523754099456:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 1094us (1849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639155.155297:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 228 00000100:00100000:2.0:1788639155.158768:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639155.158841:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639155.159207:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754099840 00000100:00100000:0.0:1788639155.159217:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754099840 00000100:00100000:0.0:1788639155.159289:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 16 00000100:00100000:0.0:1788639155.159299:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b60f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+66:2408:x1875523754099840:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788639155.159315:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788639155.159339:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262d0ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857f7 expref: 66 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639155.159359:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ae242374000) 00010000:00010000:0.0:1788639155.159364:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788639155.159421:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b60f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+65:2408:x1875523754099840:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 124us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639155.159428:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 16 00000100:00100000:3.0:1788639155.160236:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754099712 00000100:00100000:3.0:1788639155.160245:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754099712 00000100:00100000:3.0:1788639155.160308:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 229 00000100:00100000:3.0:1788639155.160317:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242175180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+65:12502:x1875523754099712:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:3.0:1788639155.160335:0:11314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639155.160352:0:11314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9200/0x25c454990262d0d1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e857fe expref: -99 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639155.160557:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9a00/0x25c454990262d0d8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639155.160572:0:11314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262d0a0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857e9 expref: 66 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639155.160581:0:11314:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9a00/0x25c454990262d0d8 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639155.160706:0:11314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262d0a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857e9 expref: 66 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639155.160720:0:11314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262d0a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857e9 expref: 66 pid: 11314 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639155.160732:0:11314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243317b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11314:1875523773023488:192.168.206.18@tcp:104: 00000100:00100000:3.0:1788639155.160807:0:11314:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae37b5896c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788639155.167110:0:11314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243317b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11314:1875523773023488:192.168.206.18@tcp:104: 00010000:00010000:3.0:1788639155.167140:0:11314:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9a00/0x25c454990262d0d8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639155.170681:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639155.171128:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754099968 00000100:00100000:3.0:1788639155.171137:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754099968 00010000:00010000:3.0:1788639155.171174:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262d0a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857e9 expref: 67 pid: 11314 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639155.171215:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 102 00000100:00100000:3.0:1788639155.171225:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242177100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+67:2407:x1875523754099968:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788639155.171239:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639155.171245:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262d0a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857e9 expref: 67 pid: 11314 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639155.171267:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262d0a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857e9 expref: 67 pid: 11314 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639155.171301:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262d0a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857e9 expref: 67 pid: 11314 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639155.171316:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ae242374000) 00010000:00010000:3.0:1788639155.171322:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9a00/0x25c454990262d0d8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639155.171331:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9a00/0x25c454990262d0d8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639155.171338:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9a00/0x25c454990262d0d8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639155.171367:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639155.171409:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242177100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+66:2407:x1875523754099968:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 187us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639155.171553:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 102 00010000:00010000:2.0:1788639155.171611:0:11314:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9a00/0x25c454990262d0d8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639155.171648:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9a00/0x25c454990262d0d8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788639155.171665:0:11314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788639155.171790:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9200/0x25c454990262d0d1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857fe expref: 67 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639155.171805:0:11314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9a00/0x25c454990262d0d8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857fe expref: 66 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639155.171812:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ae242374000) 00010000:00010000:2.0:1788639155.171815:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788639155.171817:0:11314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f9a00, rc 0) 00000100:00100000:2.0:1788639155.171841:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242175180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+66:12502:x1875523754099712:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 11526us (13092us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1788639155.171848:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 229 00000100:00100000:2.0:1788639155.174343:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639155.174381:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639155.174425:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639155.174481:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639155.174508:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639155.174580:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754100096 00000100:00100000:0.0:1788639155.174589:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754100096 00000100:00100000:0.0:1788639155.174663:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 386 00000100:00100000:0.0:1788639155.174680:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae369902c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+13:2407:x1875523754100096:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639155.174740:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae369902c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+13:2407:x1875523754100096:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 62us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639155.174747:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 386 00000100:00100000:0.0:1788639155.174790:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754100352 00000100:00100000:0.0:1788639155.174794:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754100352 00000100:00100000:0.0:1788639155.174820:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 134 00000100:00100000:0.0:1788639155.174826:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+9:2407:x1875523754100352:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639155.174858:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+9:2407:x1875523754100352:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 27us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639155.174865:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 134 00000100:00100000:3.0:1788639155.175216:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754100224 00000100:00100000:3.0:1788639155.175220:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754100224 00000100:00100000:3.0:1788639155.175262:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754100480 00000100:00100000:3.0:1788639155.175265:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754100480 00000100:00100000:3.0:1788639155.175285:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754100608 00000100:00100000:3.0:1788639155.175287:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754100608 00000100:00100000:3.0:1788639155.175300:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 309 00000100:00100000:3.0:1788639155.175306:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242177480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2407:x1875523754100224:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639155.175339:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242177480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2407:x1875523754100224:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 33us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639155.175345:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 309 00000100:00100000:3.0:1788639155.175365:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 310 00000100:00100000:3.0:1788639155.175371:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2407:x1875523754100480:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639155.175394:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2407:x1875523754100480:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 24us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639155.175400:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 310 00000100:00100000:3.0:1788639155.175419:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 311 00000100:00100000:3.0:1788639155.175425:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2407:x1875523754100608:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639155.175445:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2407:x1875523754100608:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 21us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639155.175451:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 311 00000100:00080000:0.0:1788639155.176013:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788639155.176018:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788639155.178779:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639155.178865:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754100864 00000100:00100000:1.0:1788639155.178875:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754100864 00000100:00100000:1.0:1788639155.178927:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 17 00000100:00100000:1.0:1788639155.178938:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+66:12502:x1875523754100864:12345-192.168.206.18@tcp:103:lfs.0 00010000:00010000:1.0:1788639155.178953:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788639155.178977:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8200/0x25c454990262d029 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857cd expref: 66 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639155.178996:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ae242374000) 00010000:00010000:1.0:1788639155.179001:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788639155.179056:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+65:12502:x1875523754100864:12345-192.168.206.18@tcp:103:lfs.0 Request processed in 120us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639155.179064:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 17 00000100:00100000:1.0:1788639155.183459:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639155.183594:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754100992 00000100:00100000:3.0:1788639155.183604:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754100992 00000100:00100000:3.0:1788639155.183699:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 230 00000100:00100000:3.0:1788639155.183710:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+65:12502:x1875523754100992:12345-192.168.206.18@tcp:58:lfs.0 00010000:00010000:3.0:1788639155.183833:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262d0e6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639155.183973:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262d0e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639155.183989:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262d0e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788639155.184107:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1788639155.184190:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+65:12502:x1875523754100992:12345-192.168.206.18@tcp:58:lfs.0 Request processed in 481us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639155.184199:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 230 00000100:00100000:2.0:1788639155.187232:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639155.187350:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754101120 00000100:00100000:1.0:1788639155.187361:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754101120 00000100:00100000:1.0:1788639155.187462:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 231 00000100:00100000:1.0:1788639155.187474:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+65:12502:x1875523754101120:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:1.0:1788639155.187496:0:10169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639155.187519:0:10169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262d0ed lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85805 expref: -99 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639155.187578:0:10169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262d0e6 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639155.187589:0:10169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262d0ed lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85805 expref: 66 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639155.187612:0:10169:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262d0e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639155.187674:0:10169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262d0ed lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85805 expref: 66 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639155.187688:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ae242374000) 00010000:00010000:1.0:1788639155.187692:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788639155.187696:0:10169:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262d0ed lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85805 expref: 66 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639155.187705:0:10169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fb400, rc 0) 00000100:00100000:1.0:1788639155.187776:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+66:12502:x1875523754101120:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 305us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639155.187784:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 231 00010000:00010000:1.0:1788639155.639148:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788639156.153147:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788639156.153156:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788639156.153181:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1788639156.153189:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788639156.153327:0:13794:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243317b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1875523773023616:192.168.206.18@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788639156.153443:0:13794:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae37b589cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788639156.167436:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639156.168355:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754101248 00000100:00100000:0.0:1788639156.168365:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754101248 00000100:00100000:0.0:1788639156.168433:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 232 00000100:00100000:0.0:1788639156.168442:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+67:12503:x1875523754101248:12345-192.168.206.18@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788639156.168473:0:6517:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788639156.168588:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+67:12503:x1875523754101248:12345-192.168.206.18@tcp:53:lhsmtool_posix.0 Request processed in 147us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639156.168597:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 232 00000100:00100000:3.0:1788639156.174009:0:13794:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243317b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1875523773023616:192.168.206.18@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788639156.175312:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639156.175523:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754101376 00000100:00100000:2.0:1788639156.175531:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754101376 00000100:00100000:2.0:1788639156.175597:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 233 00000100:00100000:2.0:1788639156.175607:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244037480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+66:12503:x1875523754101376:12345-192.168.206.18@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788639156.175701:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262d0f4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.175727:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262d0f4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.175740:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262d0f4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.175765:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262d0fb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.175773:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262d0fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.175779:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262d0fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.175801:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262d102 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.175810:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262d102 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.175816:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262d102 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788639156.175860:0:11314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788639156.175865:0:11314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788639156.175877:0:11314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262d102 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.175895:0:11314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262d0f4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.175902:0:11314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262d0f4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.175909:0:11314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262d0f4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.175915:0:11314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78b200 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639156.175920:0:11314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262d0f4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.175927:0:11314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262d0f4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.175940:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ae34af01b00) 00010000:00010000:2.0:1788639156.175943:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639156.175947:0:11314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262d0f4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.175953:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262d0f4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.175972:0:11314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262d0fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.175979:0:11314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262d0fb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.175984:0:11314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262d0fb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.175995:0:11314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78b000 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639156.175998:0:11314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262d0fb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.176004:0:11314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262d0fb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.176011:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9ae242359800) 00010000:00010000:2.0:1788639156.176014:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639156.176017:0:11314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262d0fb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.176023:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262d0fb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.176040:0:11314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262d102 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.176046:0:11314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262d102 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.176051:0:11314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262d102 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.176057:0:11314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78a800 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639156.176060:0:11314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262d102 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.176066:0:11314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262d102 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.176084:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ae242374000) 00010000:00010000:2.0:1788639156.176086:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639156.176090:0:11314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262d102 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.176518:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262d102 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639156.176603:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244037480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+66:12503:x1875523754101376:12345-192.168.206.18@tcp:34:lhsmtool_posix.0 Request processed in 996us (1297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639156.176612:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 233 00000100:00100000:2.0:1788639156.181436:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639156.181518:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754101632 00000100:00100000:1.0:1788639156.181527:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754101632 00000100:00100000:1.0:1788639156.181580:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 234 00000100:00100000:1.0:1788639156.181590:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+66:12503:x1875523754101632:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788639156.181608:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639156.181663:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262d109 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e8580c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639156.181764:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262d110 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639156.181779:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262d110 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639156.181789:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262d110 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788639156.181798:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788639156.181863:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262d110 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639156.181870:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262d110 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639156.181877:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262d110 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639156.181882:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fa000 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639156.181887:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262d110 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639156.181894:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262d110 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639156.181920:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ae242374000) 00010000:00010000:1.0:1788639156.181923:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788639156.181927:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262d110 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639156.181934:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262d110 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639156.181975:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262d109 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8580c expref: 68 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639156.181985:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ae34af01b00) 00010000:00010000:1.0:1788639156.181987:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788639156.181991:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb000/0x25c454990262d109 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8580c expref: 68 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639156.181999:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fb000, rc 0) 00000100:00100000:1.0:1788639156.182049:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+67:12503:x1875523754101632:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 460us (620us total) trans 4294967506 rc 301/301 00000100:00100000:1.0:1788639156.182057:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 234 00000100:00100000:0.0:1788639156.188452:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639156.188724:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754101760 00000100:00100000:1.0:1788639156.188733:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754101760 00000100:00100000:1.0:1788639156.188786:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 235 00000100:00100000:1.0:1788639156.188796:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244034700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+67:12503:x1875523754101760:12345-192.168.206.18@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788639156.188829:0:6516:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788639156.188925:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244034700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+67:12503:x1875523754101760:12345-192.168.206.18@tcp:53:lhsmtool_posix.0 Request processed in 130us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639156.188950:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 235 00000100:00100000:2.0:1788639156.195700:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639156.196020:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754102016 00000100:00100000:3.0:1788639156.196029:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754102016 00000100:00100000:3.0:1788639156.196087:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 236 00000100:00100000:3.0:1788639156.196106:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370fd8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+67:12503:x1875523754102016:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788639156.196126:0:11314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639156.196129:0:11314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788639156.196153:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8c00/0x25c454990262d0ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857f0 expref: 67 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639156.196172:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ae242374600) 00010000:00010000:3.0:1788639156.196177:0:11314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788639156.196188:0:11314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262d11e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85813 expref: -99 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788639156.196647:0:11314:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:2.0:1788639156.196806:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262d125 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.196820:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262d125 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.196830:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262d125 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.196877:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9800/0x25c454990262d11e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85813 expref: 69 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.196892:0:11314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262d125 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85813 expref: 68 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.196920:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ae242359800) 00010000:00010000:2.0:1788639156.196923:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788639156.196926:0:11314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78a800, rc 0) 00000100:00100000:2.0:1788639156.196974:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370fd8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+68:12503:x1875523754102016:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 878us (1281us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1788639156.196981:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 236 00000100:00100000:3.0:1788639156.207087:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639156.207181:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754102272 00000100:00100000:0.0:1788639156.207191:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754102272 00000100:00100000:0.0:1788639156.207260:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 237 00000100:00100000:0.0:1788639156.207286:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243317b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+68:12503:x1875523754102272:12345-192.168.206.18@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788639156.207337:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788639156.207363:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262d125 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85813 expref: 68 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.207386:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ae242359800) 00010000:00010000:0.0:1788639156.207397:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788639156.207428:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5800/0x25c454990262d133 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.207443:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5800/0x25c454990262d133 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.207453:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5800/0x25c454990262d133 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.207468:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262d13a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x8dae10e2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.207475:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262d13a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x8dae10e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.207482:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262d13a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x8dae10e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.207527:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5800/0x25c454990262d133 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.207535:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5800/0x25c454990262d133 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.207553:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5800/0x25c454990262d133 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.207560:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef5800 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639156.207564:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5800/0x25c454990262d133 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.207572:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5800/0x25c454990262d133 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.207581:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ae242374600) 00010000:00010000:0.0:1788639156.207584:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639156.207588:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5800/0x25c454990262d133 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.207595:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5800/0x25c454990262d133 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.207607:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262d13a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x8dae10e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.207613:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262d13a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8dae10e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.207667:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262d13a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8dae10e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.207673:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef5a00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639156.207676:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262d13a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8dae10e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.207693:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262d13a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8dae10e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.207701:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x8dae10e2 (ffff9ae2430f5300) 00010000:00010000:0.0:1788639156.207704:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639156.207718:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262d13a lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x8dae10e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.207726:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5a00/0x25c454990262d13a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x8dae10e2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639156.207811:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243317b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+67:12503:x1875523754102272:12345-192.168.206.18@tcp:36:lhsmtool_posix.0 Request processed in 528us (732us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788639156.207819:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 237 00000100:00100000:0.0:1788639156.210771:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639156.212319:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754102400 00000100:00100000:2.0:1788639156.212333:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754102400 00000100:00100000:2.0:1788639156.212404:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 238 00000100:00100000:2.0:1788639156.212415:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244034a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+67:12503:x1875523754102400:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788639156.212433:0:10169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639156.212457:0:10169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262d141 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e8581a expref: -99 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.212701:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262d148 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.212716:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262d148 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.212729:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262d148 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.212839:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b000/0x25c454990262d141 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8581a expref: 69 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.212865:0:10169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262d148 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8581a expref: 68 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.212881:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ae242359e00) 00010000:00010000:2.0:1788639156.212884:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788639156.212888:0:10169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78b200, rc 0) 00000100:00100000:2.0:1788639156.212943:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244034a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+68:12503:x1875523754102400:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 529us (2179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639156.212949:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 238 00000100:00100000:3.0:1788639156.216746:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639156.217030:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754102656 00000100:00100000:2.0:1788639156.217039:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754102656 00000100:00100000:2.0:1788639156.217097:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 239 00000100:00100000:2.0:1788639156.217107:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243315c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+68:12503:x1875523754102656:12345-192.168.206.18@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788639156.217191:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262d14f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.217208:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262d14f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.217220:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262d14f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788639156.217390:0:11314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1788639156.217400:0:11314:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 415011783032ns, next at 416011780879ns, rc = 0 00000004:00010000:2.0:1788639156.217447:0:11314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005d9d2ef3 reply state 00000000584a6d00 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262d14f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.217460:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262d14f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.217467:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ae242359e00) 00010000:00010000:2.0:1788639156.217485:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788639156.217489:0:11314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788639156.217583:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243315c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+70:12503:x1875523754102656:12345-192.168.206.18@tcp:36:lhsmtool_posix.0 Request processed in 476us (845us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1788639156.217590:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 239 00000100:00100000:3.0:1788639156.220566:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639156.220953:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754102784 00000100:00100000:1.0:1788639156.220962:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754102784 00000100:00100000:1.0:1788639156.221023:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 240 00000100:00100000:1.0:1788639156.221034:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243315f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+70:12503:x1875523754102784:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788639156.221057:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639156.221079:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262d156 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85821 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639156.221133:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262d156 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85821 expref: 71 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639156.221148:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262d156 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85821 expref: 71 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639156.221167:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ae242359e00) 00010000:00010000:1.0:1788639156.221171:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788639156.221175:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fa000, rc 0) 00000100:00100000:1.0:1788639156.221237:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243315f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+71:12503:x1875523754102784:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 205us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639156.221254:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 240 00000100:00100000:1.0:1788639156.224280:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639156.224363:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754102912 00000100:00100000:3.0:1788639156.224372:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754102912 00000100:00100000:3.0:1788639156.224442:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 70 00000100:00100000:3.0:1788639156.224469:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+9:2407:x1875523754102912:12345-192.168.206.18@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788639156.224717:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+10:2407:x1875523754102912:12345-192.168.206.18@tcp:2:lhsmtool_posix.0 Request processed in 238us (433us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1788639156.224725:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 70 00000100:00080000:0.0:1788639156.224898:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788639156.227732:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639156.227833:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754103168 00000100:00100000:1.0:1788639156.227842:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754103168 00000100:00100000:1.0:1788639156.227896:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 60 00000100:00100000:1.0:1788639156.227907:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+71:12503:x1875523754103168:12345-192.168.206.18@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788639156.228613:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+72:12503:x1875523754103168:12345-192.168.206.18@tcp:35:lhsmtool_posix.0 Request processed in 705us (886us total) trans 4294967509 rc 0/0 00000100:00100000:1.0:1788639156.229266:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 60 00000100:00100000:2.0:1788639156.231441:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639156.231583:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754103424 00000100:00100000:1.0:1788639156.231593:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754103424 00000100:00100000:1.0:1788639156.231680:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 241 00000100:00100000:1.0:1788639156.231691:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+72:12503:x1875523754103424:12345-192.168.206.18@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788639156.231821:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+72:12503:x1875523754103424:12345-192.168.206.18@tcp:57:lhsmtool_posix.0 Request processed in 132us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639156.231829:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 241 00000100:00100000:0.0:1788639156.237511:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639156.237656:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754103552 00000100:00100000:2.0:1788639156.237665:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754103552 00000100:00100000:2.0:1788639156.237732:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 242 00000100:00100000:2.0:1788639156.237742:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244035f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+72:12503:x1875523754103552:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788639156.237769:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639156.237791:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262d15d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85828 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.237869:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262d164 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.237883:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262d164 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.237894:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262d164 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788639156.237938:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788639156.237956:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262d164 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.237980:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78be00/0x25c454990262d15d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85828 expref: 74 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.238028:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262d164 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85828 expref: 73 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.238036:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ae242359e00) 00010000:00010000:2.0:1788639156.238039:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788639156.238043:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78a600, rc 0) 00000100:00100000:2.0:1788639156.238103:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244035f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+73:12503:x1875523754103552:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 362us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639156.238110:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 242 00000100:00100000:3.0:1788639156.241848:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639156.241990:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754103680 00000100:00100000:0.0:1788639156.241999:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754103680 00000100:00100000:0.0:1788639156.242048:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 71 00000100:00100000:0.0:1788639156.242059:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243315880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+10:2408:x1875523754103680:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788639156.242074:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639156.242106:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e5b0644/0x25c454990262d16b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e8582f expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788639156.242131:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c77b5, blocks: 0x0 00010000:00010000:0.0:1788639156.242151:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=415s v=(0 0) 00010000:00010000:0.0:1788639156.242172:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788639156.242181:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e5b0644/0x25c454990262d16b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8582f expref: 11 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.242200:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005e5b0644/0x25c454990262d16b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8582f expref: 11 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.242212:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375ef5800, rc 0) 00000100:00100000:0.0:1788639156.242280:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243315880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+11:2408:x1875523754103680:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 223us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639156.242287:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 71 00000100:00100000:3.0:1788639156.245992:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639156.246227:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754103936 00000100:00100000:1.0:1788639156.246235:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754103936 00000100:00100000:1.0:1788639156.246304:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 243 00000100:00100000:1.0:1788639156.246314:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+73:12503:x1875523754103936:12345-192.168.206.18@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788639156.246412:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+73:12503:x1875523754103936:12345-192.168.206.18@tcp:57:lhsmtool_posix.0 Request processed in 100us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639156.246419:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 243 00000100:00100000:1.0:1788639156.249521:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639156.249596:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754104064 00000100:00100000:3.0:1788639156.249604:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754104064 00000100:00100000:3.0:1788639156.249691:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 72 00000100:00100000:3.0:1788639156.249700:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+11:12503:x1875523754104064:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788639156.249716:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639156.249731:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004bc433ab/0x25c454990262d172 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85836 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639156.249771:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005e5b0644/0x25c454990262d16b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8582f expref: 12 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639156.249780:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639156.249784:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639156.249789:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004bc433ab/0x25c454990262d172 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85836 expref: 12 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639156.249821:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005e5b0644/0x25c454990262d16b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8582f expref: 12 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639156.249834:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005e5b0644/0x25c454990262d16b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8582f expref: 12 pid: 8431 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639156.249861:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243314a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8432:1875523773023744:192.168.206.18@tcp:104: 00000100:00100000:3.0:1788639156.250111:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae37b589240 going to sleep for 11 seconds 00000100:00100000:1.0:1788639156.254385:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639156.254672:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754104192 00000100:00100000:3.0:1788639156.254682:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754104192 00010000:00010000:3.0:1788639156.254729:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005e5b0644/0x25c454990262d16b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8582f expref: 13 pid: 8431 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639156.254771:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 103 00000100:00100000:3.0:1788639156.254782:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244124a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+13:2408:x1875523754104192:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788639156.254794:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639156.254815:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005e5b0644/0x25c454990262d16b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8582f expref: 13 pid: 8431 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639156.254828:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005e5b0644/0x25c454990262d16b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8582f expref: 13 pid: 8431 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639156.254850:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639156.254855:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639156.254863:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004bc433ab/0x25c454990262d172 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85836 expref: 13 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639156.254874:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004bc433ab/0x25c454990262d172 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85836 expref: 13 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639156.254932:0:6500:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004bc433ab/0x25c454990262d172 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85836 expref: 13 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639156.254945:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243316d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6500:1875523773023872:192.168.206.18@tcp:105: 00000100:00100000:3.0:1788639156.255014:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344c1ed80 going to sleep for 11 seconds 00010000:00010000:2.0:1788639156.255097:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e5b0644/0x25c454990262d16b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8582f expref: 13 pid: 8431 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639156.255124:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243314a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8432:1875523773023744:192.168.206.18@tcp:104: 00010000:00010000:2.0:1788639156.255148:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004bc433ab/0x25c454990262d172 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85836 expref: 12 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.255159:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f8c00, rc 0) 00000100:00100000:2.0:1788639156.255302:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+12:12503:x1875523754104064:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 5601us (5787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639156.255310:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 72 00000100:00100000:3.0:1788639156.260952:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639156.261198:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754104320 00000100:00100000:1.0:1788639156.261208:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754104320 00002000:00100000:1.0:1788639156.261269:0:8436:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9ae243317100 x1875523754104320/t0(0) o4->5deb128c-4fe3-4f51-b21e-f30846e08445@192.168.206.18@tcp:377/0 lens 504/0 e 0 to 0 dl 1788639167 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788639156.261280:0:8436:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae243317100 with x1875523754104320 ext(0->12) 00002000:00010000:1.0:1788639156.261286:0:8436:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ae243317100 00000100:00100000:1.0:1788639156.261337:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 6 00000100:00100000:1.0:1788639156.261346:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243317100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+12:2407:x1875523754104320:12345-192.168.206.18@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788639156.262308:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243316d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6500:1875523773023872:192.168.206.18@tcp:105: 00010000:00010000:0.0:1788639156.262333:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788639156.262378:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243317100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+14:2407:x1875523754104320:12345-192.168.206.18@tcp:4:lhsmtool_posix.0 Request processed in 1031us (1432us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1788639156.262386:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 6 00002000:00100000:1.0:1788639156.262395:0:8436:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9ae243317100 x1875523754104320/t4294967321(0) o4->5deb128c-4fe3-4f51-b21e-f30846e08445@192.168.206.18@tcp:377/0 lens 504/448 e 0 to 0 dl 1788639167 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788639156.262404:0:8436:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae243317100 with x1875523754104320 ext(0->12) 00002000:00010000:1.0:1788639156.262409:0:8436:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ae243317100 00000100:00100000:0.0:1788639156.263256:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244124a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+13:2408:x1875523754104192:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 8461us (8865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639156.263267:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 103 00000100:00100000:0.0:1788639156.266556:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639156.266679:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754104448 00000100:00100000:2.0:1788639156.266689:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754104448 00000100:00100000:2.0:1788639156.266924:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 244 00000100:00100000:2.0:1788639156.266935:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244035500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+73:12503:x1875523754104448:12345-192.168.206.18@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788639156.268894:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967509 is committed 00000004:00080000:2.0:1788639156.268907:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 10 committed 00010000:00010000:0.0:1788639156.268979:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262ce77 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.268991:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262ce77 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.268998:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262ce77 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.269004:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f9600 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639156.269008:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262ce77 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.269025:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262ce77 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.269040:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ae2430f5a00) 00010000:00010000:0.0:1788639156.269043:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639156.269048:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262ce77 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.269053:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262ce77 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.269082:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4200/0x25c454990262cf1f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.269098:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4200/0x25c454990262cf1f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.269104:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4200/0x25c454990262cf1f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.269110:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef4200 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639156.269113:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4200/0x25c454990262cf1f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.269120:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4200/0x25c454990262cf1f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.269128:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ae242359a00) 00010000:00010000:0.0:1788639156.269131:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639156.269134:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4200/0x25c454990262cf1f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.269150:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4200/0x25c454990262cf1f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.269168:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262cf9d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.269174:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262cf9d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.269180:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262cf9d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.269186:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fb600 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639156.269189:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262cf9d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.269195:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262cf9d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.269203:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ae362514200) 00010000:00010000:0.0:1788639156.269206:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639156.269210:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262cf9d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.269215:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262cf9d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.269240:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262cfc0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.269256:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262cfc0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.269268:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262cfc0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.269274:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fbe00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639156.269277:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262cfc0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.269283:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262cfc0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.269291:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ae362514200) 00010000:00010000:0.0:1788639156.269293:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639156.269296:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262cfc0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.269302:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262cfc0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.269325:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262d092 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.269332:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262d092 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.269337:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262d092 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.269342:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef5e00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639156.269344:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262d092 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.269360:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262d092 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.269368:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ae242374000) 00010000:00010000:0.0:1788639156.269371:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639156.269374:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262d092 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.269379:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262d092 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.269394:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262d14f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.269401:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262d14f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.269406:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262d14f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.269411:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78a000 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639156.269414:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262d14f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.269420:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262d14f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.269426:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ae242359e00) 00010000:00010000:0.0:1788639156.269429:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788639156.269432:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262d14f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.269449:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a000/0x25c454990262d14f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788639156.269586:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1788639156.269605:0:6494:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ae2431a4600 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1788639156.269609:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ae3454e2e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ae2431a4300 00000020:00080000:2.0:1788639156.269612:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ae3454e2d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ae3414a1200 00000004:00080000:2.0:1788639156.269674:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000100:00100000:0.0:1788639156.269794:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788639156.269810:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244037800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773024000:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788639156.269871:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639156.269914:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773024000 00000100:00100000:0.0:1788639156.269921:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773024000 00000100:00100000:0.0:1788639156.269970:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788639156.269978:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244036680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1875523773024000:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788639156.270005:0:8431:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:0.0:1788639156.270032:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9c77b3, atime: 0x6a9c77b3, ctime: 0x6a9c77b3, blocks: 0x8 00010000:00010000:0.0:1788639156.270039:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5f5b35f/0x25c454990262d179 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.270054:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=415s v=(0 0) 00010000:00010000:0.0:1788639156.270058:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788639156.270064:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5f5b35f/0x25c454990262d179 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.270078:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5f5b35f/0x25c454990262d179 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788639156.270314:0:6548:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00080000:1.0:1788639156.270355:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788639156.270400:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5f5b35f/0x25c454990262d179 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.270422:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5f5b35f/0x25c454990262d179 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.270445:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788639156.270582:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244036680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3641:x1875523773024000:12345-0@lo:6:osp-syn-1-0.0 Request processed in 604us (710us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788639156.270590:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000004:00080000:0.0:1788639156.270655:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ae244037800/2, rc 0, transno 4294967311 00000100:00100000:0.0:1788639156.270662:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244037800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773024000:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788639156.270723:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788639156.270730:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5f5b35f/0x25c454990262d179 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639156.270738:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef5200 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:1.0:1788639156.270753:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5f5b35f/0x25c454990262d179 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639156.270764:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5f5b35f/0x25c454990262d179 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639156.270779:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5f5b35f/0x25c454990262d179 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639156.270787:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5f5b35f/0x25c454990262d179 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639156.270814:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639156.270816:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639156.270818:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639156.271071:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000020:00080000:2.0:1788639156.271166:0:6494:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ae3461bab40 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1788639156.271171:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ae3750de900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ae34653f900 00000020:00080000:2.0:1788639156.271174:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ae3750de500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ae243acda00 00000020:00080000:2.0:1788639156.271192:0:6494:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:2.0:1788639156.271312:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244035500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+21:12503:x1875523754104448:12345-192.168.206.18@tcp:44:lhsmtool_posix.0 Request processed in 4377us (4762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639156.271320:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 244 00000100:00100000:0.0:1788639156.271441:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788639156.271453:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243316300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773024256:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788639156.271492:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639156.271562:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773024256 00000100:00100000:2.0:1788639156.271568:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773024256 00000100:00100000:2.0:1788639156.271640:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788639156.271649:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244034380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3643:x1875523773024256:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1788639156.271856:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1788639156.271926:0:8829:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788639156.271930:0:8829:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788639157 00002000:00010000:2.0:1788639156.271933:0:8829:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788639156.271935:0:8829:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1788639157 -> 1788639157 00002000:00010000:2.0:1788639156.271937:0:8829:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1788639156.271979:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244034380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3643:x1875523773024256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 331us (486us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1788639156.271998:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000004:00080000:0.0:1788639156.272070:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ae243316300/2, rc 0, transno 4294967322 00000100:00100000:0.0:1788639156.272076:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243316300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773024256:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788639156.272189:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243316a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773024128:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788639156.272219:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788639156.272263:0:6548:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1788639156.272305:0:6548:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1788639156.272351:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773024128 00000100:00100000:2.0:1788639156.272356:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773024128 00000100:00100000:2.0:1788639156.272415:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788639156.272422:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3644:x1875523773024128:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788639156.272439:0:8430:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:2.0:1788639156.272455:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027e6f44d/0x25c454990262d180 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.272472:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000af174682/0x25c454990262cf2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8578e expref: 12 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.272480:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1788639156.272484:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788639156.272489:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027e6f44d/0x25c454990262d180 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.272516:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000af174682/0x25c454990262cf2d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8578e expref: 12 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.272530:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000af174682/0x25c454990262cf2d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8578e expref: 12 pid: 8431 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639156.272541:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a93b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1875523773024384:192.168.206.18@tcp:104: 00000100:00100000:2.0:1788639156.272584:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae346525180 going to sleep for 11 seconds 00000100:00100000:2.0:1788639156.276220:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639156.276420:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a93b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1875523773024384:192.168.206.18@tcp:104: 00010000:00010000:3.0:1788639156.276448:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000027e6f44d/0x25c454990262d180 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639156.277509:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639156.278694:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754104576 00000100:00100000:2.0:1788639156.278713:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754104576 00010000:00010000:2.0:1788639156.278765:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000af174682/0x25c454990262cf2d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8578e expref: 13 pid: 8431 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639156.278845:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 104 00000100:00100000:2.0:1788639156.278866:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+13:2408:x1875523754104576:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788639156.278880:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788639156.278886:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000af174682/0x25c454990262cf2d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8578e expref: 13 pid: 8431 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.278900:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000af174682/0x25c454990262cf2d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8578e expref: 13 pid: 8431 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.278923:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af174682/0x25c454990262cf2d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8578e expref: 13 pid: 8431 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.278939:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788639156.278943:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788639156.278949:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000027e6f44d/0x25c454990262d180 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.278960:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027e6f44d/0x25c454990262d180 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.278987:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788639156.279049:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+12:2408:x1875523754104576:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 184us (2835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639156.279056:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 104 00000100:00100000:0.0:1788639156.279412:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754104704 00000100:00100000:0.0:1788639156.279418:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754104704 00000100:00100000:0.0:1788639156.279455:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 76 00000100:00100000:0.0:1788639156.279461:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+12:2406:x1875523754104704:12345-192.168.206.18@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1788639156.279765:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000027e6f44d/0x25c454990262d180 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639156.279778:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027e6f44d/0x25c454990262d180 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639156.279789:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027e6f44d/0x25c454990262d180 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639156.279797:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027e6f44d/0x25c454990262d180 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639156.279822:0:8430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788639156.280592:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639156.280601:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027e6f44d/0x25c454990262d180 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.280612:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78ac00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639156.280652:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027e6f44d/0x25c454990262d180 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.280662:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027e6f44d/0x25c454990262d180 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.280679:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027e6f44d/0x25c454990262d180 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.280687:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027e6f44d/0x25c454990262d180 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.280710:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639156.280711:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639156.280713:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639156.281337:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3644:x1875523773024128:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8912us (9113us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1788639156.281355:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:3.0:1788639156.281409:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ae243316a00/2, rc 0, transno 4294967323 00000100:00100000:3.0:1788639156.281415:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243316a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773024128:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1788639156.282474:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:0.0:1788639156.282485:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:0.0:1788639156.282584:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+7:2406:x1875523754104704:12345-192.168.206.18@tcp:16:lhsmtool_posix.0 Request processed in 3120us (5079us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639156.282594:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 76 00000100:00100000:2.0:1788639156.287470:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639156.287556:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754104960 00000100:00100000:1.0:1788639156.287565:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754104960 00000100:00100000:1.0:1788639156.287871:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 245 00000100:00100000:1.0:1788639156.287884:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+21:12503:x1875523754104960:12345-192.168.206.18@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788639156.287934:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788639156.287958:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a600/0x25c454990262d164 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85828 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639156.287981:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ae242359e00) 00010000:00010000:1.0:1788639156.287986:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788639156.288014:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262d187 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639156.288029:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262d187 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639156.288039:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262d187 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788639156.288175:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002f394ca9 reply state 000000003f908f9a transno 4294967510 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262d187 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639156.288189:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262d187 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639156.288195:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ae242359e00) 00010000:00010000:1.0:1788639156.288198:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788639156.288201:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788639156.288305:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+22:12503:x1875523754104960:12345-192.168.206.18@tcp:36:lhsmtool_posix.0 Request processed in 424us (842us total) trans 4294967510 rc 0/0 00000100:00100000:1.0:1788639156.288313:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 245 00000100:00100000:3.0:1788639156.290791:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639156.291049:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754105088 00000100:00100000:0.0:1788639156.291059:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754105088 00000100:00100000:0.0:1788639156.291107:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 77 00000100:00100000:0.0:1788639156.291117:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36e297050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+7:2406:x1875523754105088:12345-192.168.206.18@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788639156.291255:0:8430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788639156.291259:0:8430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1788639157 -> 1788639155 00002000:00010000:0.0:1788639156.291262:0:8430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788639155 00002000:00010000:0.0:1788639156.291278:0:8430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1788639157 -> 1788639155 00002000:00010000:0.0:1788639156.291280:0:8430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1788639156.291337:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36e297050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+8:2406:x1875523754105088:12345-192.168.206.18@tcp:2:lhsmtool_posix.0 Request processed in 221us (553us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1788639156.291345:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 77 00000100:00100000:2.0:1788639156.294150:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639156.294237:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754105344 00000100:00100000:1.0:1788639156.294255:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754105344 00000100:00100000:1.0:1788639156.294345:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 246 00000100:00100000:1.0:1788639156.294357:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+22:12503:x1875523754105344:12345-192.168.206.18@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788639156.294420:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262d18e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639156.294437:0:10169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262d148 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8581a expref: 22 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639156.294447:0:10169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262d18e lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639156.294479:0:10169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262d148 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8581a expref: 22 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639156.294512:0:10169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262d148 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8581a expref: 22 pid: 10169 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639156.294525:0:10169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244127b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10169:1875523773024512:192.168.206.18@tcp:104: 00000100:00100000:1.0:1788639156.294661:0:10169:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3801ec300 going to sleep for 11 seconds 00000100:00100000:2.0:1788639156.297883:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639156.297983:0:10169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244127b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10169:1875523773024512:192.168.206.18@tcp:104: 00010000:00010000:3.0:1788639156.298008:0:10169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262d18e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639156.298601:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754105472 00000100:00100000:0.0:1788639156.298609:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754105472 00010000:00010000:0.0:1788639156.298670:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262d148 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8581a expref: 23 pid: 10169 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639156.298703:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 105 00000100:00100000:0.0:1788639156.298714:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+23:2407:x1875523754105472:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788639156.298731:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788639156.298738:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262d148 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8581a expref: 23 pid: 10169 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.298760:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262d148 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8581a expref: 23 pid: 10169 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.298783:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b200/0x25c454990262d148 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8581a expref: 23 pid: 10169 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.298809:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ae242359e00) 00010000:00010000:0.0:1788639156.298814:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262d18e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.298825:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262d18e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.298861:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262d18e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.298892:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788639156.298944:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+22:2407:x1875523754105472:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 231us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639156.298951:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 105 00010000:00010000:2.0:1788639156.300087:0:10169:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262d18e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.300196:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262d18e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.300239:0:10169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262d18e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.300258:0:10169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262d18e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.300265:0:10169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262d18e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.300270:0:10169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fbe00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639156.300275:0:10169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262d18e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.300282:0:10169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262d18e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.300295:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ae242359e00) 00010000:00010000:2.0:1788639156.300298:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788639156.300302:0:10169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262d18e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.300320:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fbe00/0x25c454990262d18e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639156.300398:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+21:12503:x1875523754105344:12345-192.168.206.18@tcp:55:lhsmtool_posix.0 Request processed in 6041us (6316us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788639156.300408:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 246 00000100:00100000:2.0:1788639156.302816:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639156.303079:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754105600 00000100:00100000:0.0:1788639156.303152:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754105600 00000100:00100000:0.0:1788639156.303232:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 78 00000100:00100000:0.0:1788639156.303250:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+8:2405:x1875523754105600:12345-192.168.206.18@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788639156.303291:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000587d9fc6/0x25c454990262d195 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.303309:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004bc433ab/0x25c454990262d172 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85836 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.303316:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788639156.303320:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788639156.303324:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000587d9fc6/0x25c454990262d195 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.303355:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004bc433ab/0x25c454990262d172 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85836 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.303368:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004bc433ab/0x25c454990262d172 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85836 expref: 8 pid: 8432 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639156.303397:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244035c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8432:1875523773024640:192.168.206.18@tcp:104: 00000100:00100000:0.0:1788639156.303475:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36e1829c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788639156.306580:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639156.306713:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244035c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8432:1875523773024640:192.168.206.18@tcp:104: 00010000:00010000:0.0:1788639156.306741:0:8432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000587d9fc6/0x25c454990262d195 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639156.306811:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754105728 00000100:00100000:2.0:1788639156.306817:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754105728 00010000:00010000:2.0:1788639156.306861:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004bc433ab/0x25c454990262d172 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85836 expref: 9 pid: 8432 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639156.306899:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 106 00000100:00100000:2.0:1788639156.306908:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243315500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+9:2407:x1875523754105728:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788639156.306922:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788639156.306943:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004bc433ab/0x25c454990262d172 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85836 expref: 9 pid: 8432 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.306956:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004bc433ab/0x25c454990262d172 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85836 expref: 9 pid: 8432 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.306978:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004bc433ab/0x25c454990262d172 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85836 expref: 9 pid: 8432 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.306994:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788639156.306998:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788639156.307016:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000587d9fc6/0x25c454990262d195 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.307025:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000587d9fc6/0x25c454990262d195 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.307058:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788639156.307115:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243315500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+8:2407:x1875523754105728:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 208us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639156.307123:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 106 00010000:00010000:1.0:1788639156.307284:0:8432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000587d9fc6/0x25c454990262d195 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639156.307293:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000587d9fc6/0x25c454990262d195 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639156.307313:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000587d9fc6/0x25c454990262d195 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639156.307321:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000587d9fc6/0x25c454990262d195 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639156.307329:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000587d9fc6/0x25c454990262d195 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639156.307335:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef4200 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:1.0:1788639156.307339:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000587d9fc6/0x25c454990262d195 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639156.307348:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000587d9fc6/0x25c454990262d195 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639156.307369:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000587d9fc6/0x25c454990262d195 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639156.307376:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000587d9fc6/0x25c454990262d195 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639156.307429:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+7:2405:x1875523754105600:12345-192.168.206.18@tcp:1:lhsmtool_posix.0 Request processed in 4188us (4620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639156.307437:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 78 00000100:00100000:3.0:1788639156.310953:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639156.311056:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754105984 00000100:00100000:2.0:1788639156.311065:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754105984 00000100:00100000:2.0:1788639156.311129:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 247 00000100:00100000:2.0:1788639156.311139:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243317800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+21:12503:x1875523754105984:12345-192.168.206.18@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788639156.311212:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262d19c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.311230:0:11314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262d08b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857e2 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.311240:0:11314:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262d19c lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.311283:0:11314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262d08b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857e2 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.311297:0:11314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262d08b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857e2 expref: 21 pid: 6516 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639156.311328:0:11314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a91500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11314:1875523773024768:192.168.206.18@tcp:104: 00000100:00100000:2.0:1788639156.311397:0:11314:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae346525180 going to sleep for 11 seconds 00000100:00100000:2.0:1788639156.314838:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639156.315063:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754106112 00000100:00100000:3.0:1788639156.315071:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754106112 00010000:00010000:3.0:1788639156.315118:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262d08b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857e2 expref: 22 pid: 6516 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639156.315156:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 107 00000100:00100000:3.0:1788639156.315165:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b60ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+22:2408:x1875523754106112:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788639156.315180:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639156.315186:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262d08b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857e2 expref: 22 pid: 6516 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639156.315198:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262d08b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857e2 expref: 22 pid: 6516 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639156.315218:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ae242374000) 00010000:00010000:3.0:1788639156.315223:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262d0ed lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85805 expref: 22 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639156.315255:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262d19c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639156.315264:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262d19c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639156.315271:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262d19c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639156.315289:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639156.315332:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b60ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+22:2408:x1875523754106112:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 168us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639156.315339:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 107 00010000:00010000:0.0:1788639156.319035:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262d08b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857e2 expref: 21 pid: 6516 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639156.319062:0:11314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a91500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11314:1875523773024768:192.168.206.18@tcp:104: 00010000:00010000:0.0:1788639156.319221:0:11314:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262d19c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.319253:0:11314:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262d19c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.319261:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262d19c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.319432:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262d1a3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.319447:0:11314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262d156 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85821 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.319456:0:11314:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262d1a3 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.319505:0:11314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262d156 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85821 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.319520:0:11314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262d156 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85821 expref: 21 pid: 6516 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639156.319533:0:11314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244035c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11314:1875523773024896:192.168.206.18@tcp:104: 00000100:00100000:0.0:1788639156.319860:0:11314:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36e182900 going to sleep for 11 seconds 00000100:00100000:0.0:1788639156.323098:0:11314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244035c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11314:1875523773024896:192.168.206.18@tcp:104: 00010000:00010000:0.0:1788639156.323127:0:11314:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262d1a3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639156.324825:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639156.325431:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754106240 00000100:00100000:0.0:1788639156.325441:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754106240 00010000:00010000:0.0:1788639156.325477:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262d156 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85821 expref: 22 pid: 6516 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639156.325518:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 108 00000100:00100000:0.0:1788639156.325529:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244127100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+22:2407:x1875523754106240:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788639156.325544:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788639156.325551:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262d156 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85821 expref: 22 pid: 6516 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.325565:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262d156 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85821 expref: 22 pid: 6516 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.325608:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa000/0x25c454990262d156 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85821 expref: 22 pid: 6516 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.325667:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ae242359e00) 00010000:00010000:0.0:1788639156.325672:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262d1a3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.325682:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262d1a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.325690:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262d1a3 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.325720:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788639156.325902:0:11314:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262d1a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.325910:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262d1a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788639156.326020:0:11314:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:2.0:1788639156.326288:0:11314:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000001:00080000:2.0:1788639156.326327:0:11314:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:2.0:1788639156.326398:0:11314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a93800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11314:1875523773025024:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788639156.326610:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244127100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+24:2407:x1875523754106240:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 1082us (1790us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639156.326657:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 108 00000100:00100000:2.0:1788639156.327651:0:11314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639156.327734:0:11314:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae37b589240 going to sleep for 11 seconds 00000100:00100000:1.0:1788639156.328433:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773025024 00000100:00100000:1.0:1788639156.328442:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773025024 00000100:00100000:1.0:1788639156.328539:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788639156.328550:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:11314:x1875523773025024:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788639156.328702:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:11314:x1875523773025024:12345-0@lo:1000:mdt00_004.0 Request processed in 154us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639156.328713:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788639156.328766:0:11314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:2.0:1788639156.328939:0:11314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:2.0:1788639156.328961:0:11314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ae243316300, transno 4294967322 00000100:00100000:2.0:1788639156.328984:0:11314:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9ae243316a00 x1875523773024128/t4294967323(4294967323) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788639172 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639156.328996:0:11314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a93800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11314:1875523773025024:0@lo:1000:mdt00_004.0 00000001:00080000:2.0:1788639156.329124:0:11314:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00000100:00100000:2.0:1788639156.329180:0:11314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a93800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11314:1875523773025152:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788639156.329218:0:11314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639156.329601:0:11314:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae346525180 going to sleep for 11 seconds 00000100:00100000:3.0:1788639156.329741:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773025152 00000100:00100000:3.0:1788639156.329823:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773025152 00000100:00100000:3.0:1788639156.329925:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788639156.329936:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b5f1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:11314:x1875523773025152:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788639156.330076:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b5f1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:11314:x1875523773025152:12345-0@lo:1000:mdt00_004.0 Request processed in 142us (857us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1788639156.330083:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788639156.330657:0:11314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a93800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11314:1875523773025152:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1788639156.330713:0:11314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262d1a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.330723:0:11314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262d1a3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.330731:0:11314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262d1a3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.330738:0:11314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef4000 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639156.330743:0:11314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262d1a3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.330763:0:11314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262d1a3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.330779:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ae242359e00) 00010000:00010000:2.0:1788639156.330782:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788639156.330787:0:11314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262d1a3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.330793:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef4000/0x25c454990262d1a3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.330818:0:11314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262d0e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.330824:0:11314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262d0e6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.330830:0:11314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262d0e6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.330846:0:11314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f8a00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639156.331035:0:11314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262d0e6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.331044:0:11314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262d0e6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.331053:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ae242374000) 00010000:00010000:2.0:1788639156.331056:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788639156.331063:0:11314:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262d0ed lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85805 expref: 24 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.331074:0:11314:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262d0ed lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85805 expref: 24 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.331082:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262d0ed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85805 expref: 24 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.331123:0:11314:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262d0ed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85805 expref: 24 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639156.331137:0:11314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a91c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11314:1875523773025280:192.168.206.18@tcp:105: 00000100:00100000:2.0:1788639156.331204:0:11314:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae34653f900 going to sleep for 11 seconds 00000100:00100000:2.0:1788639156.334564:0:11314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a91c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11314:1875523773025280:192.168.206.18@tcp:105: 00010000:00010000:2.0:1788639156.334592:0:11314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262d0e6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.334653:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8a00/0x25c454990262d0e6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.334687:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262d1aa lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.334701:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262d1aa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.334712:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262d1aa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.334721:0:11314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262d1aa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.334728:0:11314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262d1aa lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.334734:0:11314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262d1aa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.334740:0:11314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78a800 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639156.334754:0:11314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262d1aa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.334763:0:11314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262d1aa lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.334773:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ae242374000) 00010000:00010000:2.0:1788639156.334777:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639156.334780:0:11314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262d1aa lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.334793:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262d1aa lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.334807:0:11314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262d19c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.334814:0:11314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262d19c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.334820:0:11314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262d19c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.334825:0:11314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78bc00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639156.334827:0:11314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262d19c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.334833:0:11314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262d19c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.334841:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ae242374000) 00010000:00010000:2.0:1788639156.334843:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788639156.334846:0:11314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262d19c lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.334864:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262d19c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639156.335024:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243317800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+24:12503:x1875523754105984:12345-192.168.206.18@tcp:57:lhsmtool_posix.0 Request processed in 23885us (24079us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1788639156.335034:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 247 00000020:00080000:2.0:1788639156.335046:0:11314:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788639156.335669:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788639156.335674:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788639156.336412:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788639156.336422:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788639156.339712:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639156.339927:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754106368 00000100:00100000:1.0:1788639156.339937:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754106368 00000100:00100000:1.0:1788639156.339980:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 61 00000100:00100000:1.0:1788639156.339989:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243315500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+24:12502:x1875523754106368:12345-192.168.206.18@tcp:49:lfs.0 00000100:00100000:1.0:1788639156.340104:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243315500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+24:12502:x1875523754106368:12345-192.168.206.18@tcp:49:lfs.0 Request processed in 115us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639156.340111:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 61 00000100:00100000:1.0:1788639156.343104:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639156.343188:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754106624 00000100:00100000:3.0:1788639156.343198:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754106624 00000100:00100000:3.0:1788639156.343261:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 62 00000100:00100000:3.0:1788639156.343284:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ef0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+24:12503:x1875523754106624:12345-192.168.206.18@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788639156.343504:0:6520:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788639156.343531:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967516 00010000:00010000:3.0:1788639156.343559:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262d1b1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639156.343574:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262d1b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639156.343584:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262d1b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639156.343593:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262d1b1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639156.343599:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262d1b1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639156.343605:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262d1b1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639156.343670:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788639156.343888:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ef0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+26:12503:x1875523754106624:12345-192.168.206.18@tcp:35:lhsmtool_posix.0 Request processed in 605us (799us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1788639156.343896:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 62 00000020:00080000:3.0:1788639156.343901:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788639156.343982:0:9520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788639156.343988:0:9520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262d1b1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639156.343995:0:9520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f8400 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:1.0:1788639156.344000:0:9520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262d1b1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639156.344008:0:9520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262d1b1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639156.344019:0:9520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ae242359e00) 00010000:00010000:1.0:1788639156.344022:0:9520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788639156.344026:0:9520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262d1b1 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639156.344033:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262d1b1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639156.344044:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639156.344046:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639156.344047:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639156.348040:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639156.348110:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754106880 00000100:00100000:1.0:1788639156.348120:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754106880 00000100:00100000:1.0:1788639156.348179:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 248 00000100:00100000:1.0:1788639156.348190:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244035c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+26:12502:x1875523754106880:12345-192.168.206.18@tcp:58:lfs.0 00000040:00080000:1.0:1788639156.348359:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1788639156.348428:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244035c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+26:12502:x1875523754106880:12345-192.168.206.18@tcp:58:lfs.0 Request processed in 240us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639156.348434:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 248 00000100:00100000:0.0:1788639156.384733:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639156.384852:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754107008 00000100:00100000:2.0:1788639156.384861:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754107008 00000100:00100000:2.0:1788639156.384913:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 249 00000100:00100000:2.0:1788639156.384922:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244035880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+26:12505:x1875523754107008:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:2.0:1788639156.384944:0:10169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639156.384963:0:10169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262d1b8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e8583d expref: -99 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.385022:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262d1bf lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.385037:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262d1bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.385048:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262d1bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.385062:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262d1c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.385070:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262d1c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.385077:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262d1c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.385144:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262d1cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.385155:0:10169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9a00/0x25c454990262d0d8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857fe expref: 27 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.385181:0:10169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262d1cd lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.385210:0:10169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9a00/0x25c454990262d0d8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857fe expref: 27 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.385222:0:10169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9a00/0x25c454990262d0d8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857fe expref: 27 pid: 11314 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639156.385236:0:10169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a91c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10169:1875523773025408:192.168.206.18@tcp:104: 00000100:00100000:2.0:1788639156.385401:0:10169:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae34653f900 going to sleep for 11 seconds 00000100:00100000:3.0:1788639156.388547:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639156.388724:0:10169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a91c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10169:1875523773025408:192.168.206.18@tcp:104: 00000100:00100000:1.0:1788639156.388747:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754107264 00010000:00010000:2.0:1788639156.388752:0:10169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262d1cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639156.388756:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754107264 00000100:00100000:1.0:1788639156.388814:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 63 00000100:00100000:1.0:1788639156.388823:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243315500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+28:6174:x1875523754107264:12345-192.168.206.18@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788639156.389035:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243315500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+29:6174:x1875523754107264:12345-192.168.206.18@tcp:35:ldlm_bl.0 Request processed in 212us (495us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1788639156.389043:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 63 00000100:00100000:0.0:1788639156.394695:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639156.394999:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754107392 00000100:00100000:2.0:1788639156.395008:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754107392 00010000:00010000:2.0:1788639156.395047:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9a00/0x25c454990262d0d8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857fe expref: 29 pid: 11314 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639156.395087:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 109 00000100:00100000:2.0:1788639156.395098:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244036680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+29:2408:x1875523754107392:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788639156.395112:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788639156.395119:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9a00/0x25c454990262d0d8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857fe expref: 29 pid: 11314 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.395151:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9a00/0x25c454990262d0d8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857fe expref: 29 pid: 11314 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.395172:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9a00/0x25c454990262d0d8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e857fe expref: 29 pid: 11314 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.395188:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ae242374000) 00010000:00010000:2.0:1788639156.395193:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262d1cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.395203:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262d1cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.395211:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262d1cd lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639156.395254:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788639156.395319:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244036680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+28:2408:x1875523754107392:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 222us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639156.395326:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 109 00010000:00010000:0.0:1788639156.395392:0:10169:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262d1cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.395400:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262d1cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788639156.395450:0:10169:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788639156.395454:0:10169:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788639156.395472:0:10169:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262d1cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.395493:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262d1cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.395502:0:10169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262d1bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.395508:0:10169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262d1bf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.395515:0:10169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262d1bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.395520:0:10169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78a800 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639156.395524:0:10169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262d1bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.395532:0:10169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262d1bf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.395541:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ae242374600) 00010000:00010000:0.0:1788639156.395544:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639156.395547:0:10169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262d1bf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.395553:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262d1bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.395566:0:10169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262d1c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.395571:0:10169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262d1c6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.395582:0:10169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262d1c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.395601:0:10169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78b600 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639156.395604:0:10169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262d1c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.395610:0:10169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262d1c6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.395662:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ae242359b00) 00010000:00010000:0.0:1788639156.395664:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639156.395667:0:10169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262d1c6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.395673:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262d1c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.395717:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78bc00/0x25c454990262d1b8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8583d expref: 28 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.395734:0:10169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262d1cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8583d expref: 27 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639156.395741:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ae242374000) 00010000:00010000:0.0:1788639156.395748:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788639156.395751:0:10169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78a200, rc 0) 00000100:00100000:0.0:1788639156.395790:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244035880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+27:12505:x1875523754107008:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 10869us (11068us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639156.395817:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 249 00000100:00100000:0.0:1788639156.406471:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773025536:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788639156.406541:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639156.406676:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773025536 00000100:00100000:3.0:1788639156.406684:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773025536 00000100:00100000:3.0:1788639156.406743:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788639156.406752:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244034380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773025536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788639156.406804:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:3.0:1788639156.406851:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244034380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773025536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639156.406858:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788639156.406920:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773025536:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788639156.407273:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788639156.407556:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788639156.407566:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773025664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788639156.407602:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639156.407767:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773025664 00000100:00100000:0.0:1788639156.407782:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773025664 00000100:00100000:0.0:1788639156.407820:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788639156.407827:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243317480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1875523773025664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788639156.407842:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:0.0:1788639156.407880:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243317480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1875523773025664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639156.407886:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788639156.408017:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773025664:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788639156.660995:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788639157.032081:0:14808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788639157.032090:0:14808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788639157.032121:0:14808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788639157.032128:0:14808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788639157.365959:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788639157.365967:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788639157.365992:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788639157.366016:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788639157.366152:0:13794:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243314380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1875523773025792:192.168.206.18@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788639157.366280:0:13794:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243259c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788639157.372333:0:13794:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243314380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1875523773025792:192.168.206.18@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788639157.377656:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639157.377861:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754107520 00000100:00100000:2.0:1788639157.377871:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754107520 00000100:00100000:2.0:1788639157.377947:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 250 00000100:00100000:2.0:1788639157.377958:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+27:12517:x1875523754107520:12345-192.168.206.18@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788639157.377993:0:11314:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788639157.378233:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+27:12517:x1875523754107520:12345-192.168.206.18@tcp:53:lhsmtool_posix.0 Request processed in 276us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639157.378270:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 250 00000100:00080000:0.0:1788639157.380226:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788639157.385846:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639157.385943:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754107776 00000100:00100000:3.0:1788639157.385969:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754107776 00000100:00100000:3.0:1788639157.386032:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 251 00000100:00100000:3.0:1788639157.386043:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+27:12517:x1875523754107776:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788639157.386073:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639157.386099:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8e00/0x25c454990262d1d4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85844 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639157.386212:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262d1db lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639157.386259:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262d1db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639157.386273:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262d1db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788639157.386287:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788639157.386395:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8e00/0x25c454990262d1d4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85844 expref: 30 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639157.386803:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262d1db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85844 expref: 29 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639157.386814:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ae242374000) 00010000:00010000:3.0:1788639157.386817:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788639157.386820:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f8800, rc 0) 00000100:00100000:3.0:1788639157.386888:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+29:12517:x1875523754107776:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 847us (1048us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1788639157.386896:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 251 00000100:00100000:3.0:1788639157.395390:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639157.395451:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639157.395462:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754108032 00000100:00100000:0.0:1788639157.395474:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754108032 00000100:00100000:0.0:1788639157.395537:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 252 00000100:00100000:0.0:1788639157.395547:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+29:12517:x1875523754108032:12345-192.168.206.18@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788639157.395652:0:10169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262d1e9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639157.395670:0:10169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262d1e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639157.395682:0:10169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262d1e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639157.395934:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754108160 00000100:00100000:1.0:1788639157.395940:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754108160 00000100:00100000:1.0:1788639157.396001:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 18 00000100:00100000:1.0:1788639157.396012:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243315180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+31:2408:x1875523754108160:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788639157.396014:0:10169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262d1e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639157.396026:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788639157.396027:0:10169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262d1e9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639157.396037:0:10169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262d1e9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639157.396047:0:10169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef5000 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639157.396053:0:10169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262d1e9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639157.396059:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262d1db lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85844 expref: 31 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639157.396063:0:10169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262d1e9 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639157.396083:0:10169:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ae242374000) 00010000:00010000:0.0:1788639157.396085:0:10169:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788639157.396091:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ae242374000) 00010000:00010000:0.0:1788639157.396092:0:10169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262d1e9 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639157.396099:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788639157.396103:0:10169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5000/0x25c454990262d1e9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10169 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639157.396156:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243315180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+30:2408:x1875523754108160:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 147us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639157.396164:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 18 00000100:00100000:0.0:1788639157.396198:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+29:12517:x1875523754108032:12345-192.168.206.18@tcp:57:lhsmtool_posix.0 Request processed in 651us (814us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1788639157.396207:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 252 00000040:00080000:1.0:1788639157.396287:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788639157.396291:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788639157.397695:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788639157.397710:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788639157.401071:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639157.401158:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754108416 00000100:00100000:1.0:1788639157.401168:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754108416 00000100:00100000:1.0:1788639157.401223:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 64 00000100:00100000:1.0:1788639157.401233:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+29:12517:x1875523754108416:12345-192.168.206.18@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788639157.401497:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+30:12517:x1875523754108416:12345-192.168.206.18@tcp:35:lhsmtool_posix.0 Request processed in 264us (434us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1788639157.401505:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 64 00010000:00010000:1.0:1788639157.685050:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639158.710082:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788639158.807305:0:14859:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788639158.807314:0:14859:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788639158.807342:0:14859:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788639158.807347:0:14859:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788639158.969061:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243314e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773025920:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788639158.969134:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639158.969200:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773025920 00000100:00100000:3.0:1788639158.969206:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773025920 00000100:00100000:3.0:1788639158.969270:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788639158.969280:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243316300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773025920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788639158.969307:0:13805:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788639158.969355:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243316300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773025920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639158.969362:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:3.0:1788639158.969383:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788639158.969544:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243314e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773025920:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788639158.969912:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243314700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875523773026176:0@lo:400:kworker.0 00000100:00100000:3.0:1788639158.969941:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639158.969965:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243314e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875523773026688:0@lo:400:kworker.0 00000100:00100000:3.0:1788639158.969981:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639158.969997:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875523773027200:0@lo:400:kworker.0 00000100:00100000:3.0:1788639158.970013:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639158.970086:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788639158.970094:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243315880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773026304:0@lo:400:kworker.0 00000100:00100000:3.0:1788639158.970117:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639158.970143:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875523773026816:0@lo:400:kworker.0 00000100:00100000:3.0:1788639158.970161:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639158.970175:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875523773027328:0@lo:400:kworker.0 00000100:00100000:3.0:1788639158.970192:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639158.970217:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773026176 00000100:00100000:1.0:1788639158.970263:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773026304 00000100:00100000:1.0:1788639158.970269:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773026304 00000100:00100000:1.0:1788639158.970303:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788639158.970311:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773026304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639158.970360:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773026304:12345-0@lo:400:kworker.0 Request processed in 50us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639158.970368:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788639158.970510:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773026176 00000100:00100000:2.0:1788639158.970541:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773026688 00000100:00100000:3.0:1788639158.970584:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773027200 00000100:00100000:3.0:1788639158.970588:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773027200 00000100:00100000:3.0:1788639158.970672:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773026816 00000100:00100000:3.0:1788639158.970676:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773026816 00000100:00100000:3.0:1788639158.970690:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773027328 00000100:00100000:3.0:1788639158.970692:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773027328 00000100:00100000:3.0:1788639158.970711:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1788639158.970718:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875523773026176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639158.970728:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773026688 00000100:00100000:3.0:1788639158.970751:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875523773026176:12345-0@lo:400:kworker.0 Request processed in 33us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639158.970759:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1788639158.970765:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1788639158.971335:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875523773027200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639158.971379:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875523773027200:12345-0@lo:400:kworker.0 Request processed in 50us (1364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639158.972810:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1788639158.972829:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875523773026816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639158.972909:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875523773026816:12345-0@lo:400:kworker.0 Request processed in 90us (2746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639158.972917:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1788639158.972944:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1788639158.972951:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875523773027328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639158.972978:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875523773027328:12345-0@lo:400:kworker.0 Request processed in 28us (2784us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639158.972983:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1788639158.972995:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1788639158.974126:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875523773026688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639158.974183:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875523773026688:12345-0@lo:400:kworker.0 Request processed in 1183us (4200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639158.974192:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1788639158.974261:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01f1eef9-e690-4065-bf99-bf821af7b626:3644:1875523773026048:0@lo:400:kworker.0 00000100:00100000:3.0:1788639158.974316:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639158.974371:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243314a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773026560:0@lo:400:kworker.0 00000100:00100000:3.0:1788639158.974397:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639158.974413:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773026048 00000100:00100000:3.0:1788639158.974422:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773027072:0@lo:400:kworker.0 00000100:00100000:1.0:1788639158.974423:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773026048 00000100:00100000:3.0:1788639158.974456:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639158.974474:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1788639158.974484:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae369902850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+24:3644:x1875523773026048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639158.974486:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788639158.974498:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875523773026432:0@lo:400:kworker.0 00000100:00100000:1.0:1788639158.974537:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae369902850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+24:3644:x1875523773026048:12345-0@lo:400:kworker.0 Request processed in 53us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639158.974538:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639158.974547:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1788639158.975700:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773026944:0@lo:400:kworker.0 00000100:00100000:3.0:1788639158.975736:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639158.975758:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773027456:0@lo:400:kworker.0 00000100:00100000:3.0:1788639158.975781:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639158.975811:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01f1eef9-e690-4065-bf99-bf821af7b626:3644:1875523773026048:0@lo:400:kworker.0 00000100:00100000:3.0:1788639158.975850:0:12414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773026560 00000100:00100000:3.0:1788639158.975855:0:12414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773026560 00000100:00100000:1.0:1788639158.975945:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773027072 00000100:00100000:1.0:1788639158.975956:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773027072 00000100:00100000:3.0:1788639158.975971:0:12414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788639158.975982:0:12414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523773026560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639158.975984:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1788639158.975992:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773026944 00000100:00100000:1.0:1788639158.975994:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773026944 00000100:00100000:1.0:1788639158.976009:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773027456 00000100:00100000:2.0:1788639158.976011:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773026432 00000100:00100000:1.0:1788639158.976011:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773027456 00000100:00100000:2.0:1788639158.976014:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773026432 00000100:00100000:1.0:1788639158.976031:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788639158.976040:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3644:x1875523773027072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639158.976042:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788639158.976048:0:12414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523773026560:12345-0@lo:400:kworker.0 Request processed in 67us (1649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639158.976058:0:12414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788639158.976062:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875523773026432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639158.976081:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3644:x1875523773027072:12345-0@lo:400:kworker.0 Request processed in 43us (1625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639158.976087:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788639158.976098:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788639158.976099:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875523773026432:12345-0@lo:400:kworker.0 Request processed in 50us (1563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639158.976101:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773026944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639158.976108:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1788639158.976115:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788639158.976124:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3644:x1875523773027456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639158.976146:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773026944:12345-0@lo:400:kworker.0 Request processed in 49us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639158.976154:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788639158.976164:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3644:x1875523773027456:12345-0@lo:400:kworker.0 Request processed in 40us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639158.976172:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788639158.976174:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00080000:3.0:1788639158.976191:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788639158.976197:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788639158.976200:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754108672 00000100:00080000:3.0:1788639158.976201:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788639158.976206:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754108672 00000100:00080000:3.0:1788639158.976207:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788639158.976247:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 253 00000100:00100000:2.0:1788639158.976256:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+30:12537:x1875523754108672:12345-192.168.206.18@tcp:101:lfs.0 00000100:00100000:3.0:1788639158.976260:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875523773026432:0@lo:400:kworker.0 00010000:00010000:2.0:1788639158.976273:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1788639158.976276:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773026944:0@lo:400:kworker.0 00000100:00100000:3.0:1788639158.976289:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773027456:0@lo:400:kworker.0 00010000:00010000:2.0:1788639158.976294:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262d1f0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e8584b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639158.976299:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243314a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773026560:0@lo:400:kworker.0 00000100:00100000:3.0:1788639158.976315:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773027072:0@lo:400:kworker.0 00000100:00100000:3.0:1788639158.976351:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243315880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773026304:0@lo:400:kworker.0 00010000:00080000:3.0:1788639158.976365:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae243b15880 x1875523773026816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639158.976375:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875523773026816:0@lo:400:kworker.0 00010000:00080000:3.0:1788639158.976386:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae243b16300 x1875523773027328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639158.976393:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875523773027328:0@lo:400:kworker.0 00000100:00100000:3.0:1788639158.976405:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243314700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875523773026176:0@lo:400:kworker.0 00000100:00100000:3.0:1788639158.976419:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243314e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875523773026688:0@lo:400:kworker.0 00010000:00010000:2.0:1788639158.976420:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262d1f7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639158.976431:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875523773027200:0@lo:400:kworker.0 00010000:00010000:2.0:1788639158.976447:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262d1f7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639158.976461:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262d1f7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788639158.976474:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788639158.976581:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b600/0x25c454990262d1f0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8584b expref: 33 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639158.976604:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262d1f7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8584b expref: 32 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639158.978101:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ae242374000) 00010000:00010000:2.0:1788639158.978104:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788639158.978109:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78a800, rc 0) 00000100:00100000:2.0:1788639158.978173:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+32:12537:x1875523754108672:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 1916us (1997us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1788639158.978182:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 253 00000100:00100000:3.0:1788639158.984497:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639158.985716:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754108800 00000100:00100000:3.0:1788639158.985727:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754108800 00000100:00100000:3.0:1788639158.985788:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 254 00000100:00100000:3.0:1788639158.985797:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+32:12537:x1875523754108800:12345-192.168.206.18@tcp:54:lfs.0 00010000:00010000:3.0:1788639158.985862:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8000/0x25c454990262d205 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639158.985880:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8000/0x25c454990262d205 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639158.985903:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8000/0x25c454990262d205 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639158.985937:0:11314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8000/0x25c454990262d205 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639158.985944:0:11314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8000/0x25c454990262d205 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639158.985951:0:11314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8000/0x25c454990262d205 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639158.985958:0:11314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f8000 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639158.985963:0:11314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8000/0x25c454990262d205 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639158.985972:0:11314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8000/0x25c454990262d205 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639158.985985:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ae242374000) 00010000:00010000:3.0:1788639158.985988:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788639158.985993:0:11314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8000/0x25c454990262d205 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639158.986009:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8000/0x25c454990262d205 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639158.986087:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+32:12537:x1875523754108800:12345-192.168.206.18@tcp:54:lfs.0 Request processed in 288us (1596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639158.986095:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 254 00000100:00100000:2.0:1788639159.110032:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639159.110156:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754108928 00000100:00100000:3.0:1788639159.110174:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754108928 00000100:00100000:3.0:1788639159.110293:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 79 00000100:00100000:3.0:1788639159.110306:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+7:2408:x1875523754108928:12345-192.168.206.18@tcp:101:cat.0 00010000:00010000:3.0:1788639159.110332:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639159.110357:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020dc9e51/0x25c454990262d20c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85852 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788639159.110390:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a9c77b3, atime: 0x6a9c77b3, ctime: 0x6a9c77b3, blocks: 0x8 00010000:00010000:3.0:1788639159.110415:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=417s v=(0 0) 00010000:00010000:3.0:1788639159.110420:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639159.110431:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020dc9e51/0x25c454990262d20c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85852 expref: 8 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639159.110452:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000020dc9e51/0x25c454990262d20c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85852 expref: 8 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639159.110469:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f8000, rc 0) 00000100:00100000:3.0:1788639159.110560:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+8:2408:x1875523754108928:12345-192.168.206.18@tcp:101:cat.0 Request processed in 256us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639159.110587:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 79 00000100:00080000:0.0:1788639159.110879:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788639159.120498:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639159.121795:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754109056 00000100:00100000:3.0:1788639159.122453:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754109056 00002000:00100000:3.0:1788639159.122519:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9ae243a91880 x1875523754109056/t0(0) o3->5deb128c-4fe3-4f51-b21e-f30846e08445@192.168.206.18@tcp:380/0 lens 488/0 e 0 to 0 dl 1788639170 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788639159.122530:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae243a91880 with x1875523754109056 ext(0->4095) 00002000:00010000:3.0:1788639159.122537:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ae243a91880 00000100:00100000:3.0:1788639159.122579:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 7 00000100:00100000:3.0:1788639159.122589:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+8:2406:x1875523754109056:12345-192.168.206.18@tcp:3:cat.0 00000100:00100000:3.0:1788639159.124329:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+8:2406:x1875523754109056:12345-192.168.206.18@tcp:3:cat.0 Request processed in 212us (2311us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788639159.124344:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 7 00002000:00100000:3.0:1788639159.124356:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9ae243a91880 x1875523754109056/t0(0) o3->5deb128c-4fe3-4f51-b21e-f30846e08445@192.168.206.18@tcp:380/0 lens 488/4536 e 0 to 0 dl 1788639170 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788639159.124366:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ae243a91880 with x1875523754109056 ext(0->4095) 00002000:00010000:3.0:1788639159.124371:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ae243a91880 00000100:00100000:2.0:1788639159.477026:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788639159.477053:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773027584:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788639159.477129:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639159.477376:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773027584 00000100:00100000:3.0:1788639159.477384:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773027584 00000100:00100000:3.0:1788639159.477442:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788639159.477451:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773027584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788639159.477483:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788639159.477541:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773027584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639159.477549:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788639159.478577:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773027584:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788639159.478773:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788639159.478786:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244126300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773027712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788639159.478831:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639159.478954:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773027712 00000100:00100000:3.0:1788639159.478960:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773027712 00000100:00100000:3.0:1788639159.479008:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788639159.479017:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1875523773027712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788639159.479034:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788639159.479094:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1875523773027712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639159.479100:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788639159.479335:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244126300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773027712:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788639159.733684:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639159.990345:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788639159.990386:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773027840:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788639159.990485:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639159.990745:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773027840 00000100:00100000:3.0:1788639159.990755:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773027840 00000100:00100000:3.0:1788639159.990824:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788639159.990836:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773027840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788639159.990889:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788639159.990956:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773027840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 122us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639159.990965:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788639159.991009:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773027840:0@lo:41:osp-pre-1-0.0 00000001:00080000:0.0:1788639160.000586:0:9509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000100:00100000:2.0:1788639160.290807:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639160.290911:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754109184 00000100:00100000:3.0:1788639160.290922:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754109184 00000100:00100000:3.0:1788639160.290978:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 388 00000100:00100000:3.0:1788639160.290987:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae369903c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+13:2407:x1875523754109184:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639160.291052:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae369903c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+13:2407:x1875523754109184:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 66us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639160.291059:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 388 00000100:00100000:2.0:1788639160.291505:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639160.291536:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639160.291691:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754109312 00000100:00100000:3.0:1788639160.291706:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754109312 00000100:00100000:3.0:1788639160.291792:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 318 00000100:00100000:3.0:1788639160.291806:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+32:2408:x1875523754109312:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639160.291935:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+32:2408:x1875523754109312:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 133us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639160.291944:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 318 00000100:00080000:3.0:1788639160.291974:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788639160.294522:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639160.294555:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639160.294575:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639160.294714:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754109824 00000100:00100000:3.0:1788639160.294748:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754109824 00000100:00100000:3.0:1788639160.294846:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754109440 00000100:00100000:3.0:1788639160.294850:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754109440 00000100:00100000:3.0:1788639160.294885:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 319 00000100:00100000:3.0:1788639160.294914:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2408:x1875523754109824:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639160.295059:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2408:x1875523754109824:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 150us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639160.295068:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 319 00000100:00100000:3.0:1788639160.295096:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 320 00000100:00100000:3.0:1788639160.295106:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2407:x1875523754109440:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639160.295152:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2407:x1875523754109440:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 49us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639160.295158:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 320 00000100:00080000:3.0:1788639160.295187:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788639160.295193:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788639160.296969:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639160.297018:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754109952 00000100:00100000:3.0:1788639160.297026:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754109952 00000100:00100000:0.0:1788639160.297703:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754109568 00000100:00100000:0.0:1788639160.297718:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754109568 00000100:00100000:0.0:1788639160.297785:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754109696 00000100:00100000:0.0:1788639160.297789:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754109696 00000100:00100000:0.0:1788639160.297823:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 138 00000100:00100000:0.0:1788639160.297833:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+8:2408:x1875523754109568:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639160.297902:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+8:2408:x1875523754109568:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 71us (6365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639160.297909:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 138 00000100:00100000:0.0:1788639160.297923:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 139 00000100:00100000:0.0:1788639160.297929:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2407:x1875523754109696:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639160.297949:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2407:x1875523754109696:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 20us (3373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639160.297955:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 139 00000100:00080000:2.0:1788639160.298667:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788639160.298673:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788639160.300529:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 321 00000100:00100000:3.0:1788639160.300556:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2407:x1875523754109952:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639160.300692:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2407:x1875523754109952:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 148us (3733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639160.300716:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 321 00010000:00010000:1.0:1788639160.756873:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639161.526840:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773027968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788639161.526908:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639161.526978:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773027968 00000100:00100000:3.0:1788639161.526985:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773027968 00000100:00100000:3.0:1788639161.527040:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788639161.527050:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1875523773027968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788639161.527157:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788639161.527202:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1875523773027968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 153us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639161.527208:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788639161.527263:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773027968:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788639161.527339:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788639161.528223:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788639161.532824:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244037100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773028096:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788639161.532910:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639161.534196:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773028096 00000100:00100000:1.0:1788639161.534209:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773028096 00000100:00100000:1.0:1788639161.534331:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788639161.534342:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36e162c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773028096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788639161.534367:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788639161.534438:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36e162c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773028096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (1528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639161.534445:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:3.0:1788639161.534963:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788639161.535997:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244037100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773028096:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788639161.781871:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788639162.039746:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:0.0:1788639162.039760:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:2.0:1788639162.042348:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:2.0:1788639162.042385:0:6494:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ae3471f0840 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1788639162.042391:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ae3454e2a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ae3471f0000 00000020:00080000:2.0:1788639162.042394:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ae3454e2200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ae2438c2400 00000020:00080000:2.0:1788639162.042424:0:6494:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1788639162.042574:0:6548:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1788639162.042676:0:6548:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:1.0:1788639162.042848:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262d187 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639162.042860:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262d187 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639162.042881:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262d187 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639162.042887:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fa200 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639162.042892:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262d187 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639162.042900:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262d187 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639162.042916:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ae242359e00) 00010000:00010000:1.0:1788639162.042919:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639162.042924:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262d187 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639162.042930:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa200/0x25c454990262d187 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639162.805122:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788639163.445949:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788639163.446744:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639163.446819:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754110080 00000100:00100000:2.0:1788639163.446828:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754110080 00000100:00100000:2.0:1788639163.446908:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 255 00000100:00100000:2.0:1788639163.446919:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+18:12182:x1875523754110080:12345-192.168.206.18@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788639163.447019:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5deb128c-4fe3-4f51-b21e-f30846e08445+18:12182:x1875523754110080:12345-192.168.206.18@tcp:60:lhsmtool_posix.0 Request processed in 102us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639163.447027:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 255 00000100:00080000:3.0:1788639163.447646:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788639163.450310:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639163.450580:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754110208 00000100:00100000:3.0:1788639163.450595:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754110208 00000100:00080000:2.0:1788639163.450838:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788639163.450928:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 256 00000100:00100000:3.0:1788639163.450945:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+5:12182:x1875523754110208:12345-192.168.206.18@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788639163.451368:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+5:12182:x1875523754110208:12345-192.168.206.18@tcp:60:lhsmtool_posix.0 Request processed in 427us (1068us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639163.451400:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 256 00000100:00100000:0.0:1788639163.468364:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639163.468665:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754110464 00000100:00100000:1.0:1788639163.468678:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754110464 00000100:00100000:1.0:1788639163.468766:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 65 00000100:00100000:1.0:1788639163.468780:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+18:12182:x1875523754110464:12345-192.168.206.18@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788639163.469094:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+19:12182:x1875523754110464:12345-192.168.206.18@tcp:35:lhsmtool_posix.0 Request processed in 315us (741us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1788639163.469102:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 65 00000100:00100000:0.0:1788639163.666573:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639163.666740:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754110592 00000100:00100000:3.0:1788639163.666753:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754110592 00000100:00100000:3.0:1788639163.666911:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 257 00000100:00100000:3.0:1788639163.666924:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244036300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:12995:x1875523754110592:12345-192.168.206.18@tcp:101:lsof.0 00010000:00010000:3.0:1788639163.666949:0:11314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639163.666976:0:11314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9400/0x25c454990262d213 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85859 expref: -99 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639163.667056:0:11314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8e00/0x25c454990262d21a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639163.667073:0:11314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8e00/0x25c454990262d21a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639163.667090:0:11314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8e00/0x25c454990262d21a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788639163.667151:0:11314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788639163.667156:0:11314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788639163.667180:0:11314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8e00/0x25c454990262d21a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639163.667217:0:11314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9400/0x25c454990262d213 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85859 expref: 7 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639163.667238:0:11314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8e00/0x25c454990262d21a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85859 expref: 6 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639163.667268:0:11314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae242358200) 00010000:00010000:3.0:1788639163.667272:0:11314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788639163.667276:0:11314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f8e00, rc 0) 00000100:00100000:3.0:1788639163.667529:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244036300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+6:12995:x1875523754110592:12345-192.168.206.18@tcp:101:lsof.0 Request processed in 606us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639163.667538:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 257 00000100:00080000:2.0:1788639163.668072:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788639163.830187:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639164.085054:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875523773028352:0@lo:400:kworker.0 00000100:00100000:2.0:1788639164.085146:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639164.085163:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523773028224:0@lo:400:kworker.0 00000100:00100000:1.0:1788639164.085180:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773028480:0@lo:400:kworker.0 00000100:00100000:2.0:1788639164.085231:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243316300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875523773028864:0@lo:400:kworker.0 00000100:00100000:3.0:1788639164.085521:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875523773028608:0@lo:400:kworker.0 00000100:00100000:1.0:1788639164.091159:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639164.091288:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243314e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875523773028992:0@lo:400:kworker.0 00000100:00100000:1.0:1788639164.091353:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639164.091393:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875523773029504:0@lo:400:kworker.0 00000100:00100000:1.0:1788639164.091419:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639164.091481:0:12414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773028480 00000100:00100000:1.0:1788639164.091491:0:12414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773028480 00000100:00100000:1.0:1788639164.091556:0:12414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788639164.091568:0:12414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773028480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639164.091595:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639164.091647:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773028352 00000100:00100000:3.0:1788639164.091653:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773028352 00000100:00100000:1.0:1788639164.091671:0:12414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773028480:12345-0@lo:400:kworker.0 Request processed in 105us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639164.091679:0:12414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788639164.091692:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773028992 00000100:00100000:3.0:1788639164.091695:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773028992 00000100:00100000:1.0:1788639164.091713:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773029504 00000100:00100000:1.0:1788639164.091716:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773029504 00000100:00100000:3.0:1788639164.091732:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773028864 00000100:00100000:3.0:1788639164.091735:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773028864 00000100:00100000:1.0:1788639164.091736:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1788639164.091742:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875523773028352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639164.091749:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1788639164.091755:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875523773028992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639164.091777:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875523773028352:12345-0@lo:400:kworker.0 Request processed in 35us (6632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639164.091783:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1788639164.091797:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1788639164.091799:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875523773028992:12345-0@lo:400:kworker.0 Request processed in 45us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639164.091803:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875523773029504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639164.091805:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1788639164.091816:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1788639164.091821:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875523773028864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639164.091827:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875523773029504:12345-0@lo:400:kworker.0 Request processed in 26us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639164.091833:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1788639164.091845:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875523773028864:12345-0@lo:400:kworker.0 Request processed in 25us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639164.091851:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00010000:00080000:1.0:1788639164.091875:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae243316d80 x1875523773029504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639164.091926:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639164.092016:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875523773029504:0@lo:400:kworker.0 00000100:00100000:1.0:1788639164.092039:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773028480:0@lo:400:kworker.0 00010000:00080000:1.0:1788639164.092050:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae243314e00 x1875523773028992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639164.092059:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243314e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875523773028992:0@lo:400:kworker.0 00000100:00100000:1.0:1788639164.092089:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773028608 00000100:00100000:1.0:1788639164.092093:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773028608 00000100:00100000:1.0:1788639164.092114:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1788639164.092119:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875523773028608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639164.092150:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875523773028608:12345-0@lo:400:kworker.0 Request processed in 31us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639164.092156:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00080000:1.0:1788639164.092222:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788639164.092227:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788639164.097591:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639164.097777:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773028224 00000100:00100000:1.0:1788639164.097966:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773028224 00000100:00100000:1.0:1788639164.103295:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1788639164.103329:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae369900050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+24:3641:x1875523773028224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639164.103841:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae369900050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+24:3641:x1875523773028224:12345-0@lo:400:kworker.0 Request processed in 528us (6262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639164.103850:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1788639164.104493:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243316300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875523773028864:0@lo:400:kworker.0 00000100:00100000:2.0:1788639164.104537:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243314a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875523773029376:0@lo:400:kworker.0 00000100:00100000:2.0:1788639164.104588:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639164.104728:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242f08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523773029888:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788639164.104761:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639164.104793:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875523773028352:0@lo:400:kworker.0 00000100:00100000:2.0:1788639164.104807:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788639164.104814:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243315880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773029248:0@lo:400:kworker.0 00000100:00100000:2.0:1788639164.104842:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639164.104864:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242f0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773029760:0@lo:400:kworker.0 00000100:00100000:2.0:1788639164.104884:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639164.104921:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773029888 00000100:00100000:2.0:1788639164.104928:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773029888 00000100:00100000:2.0:1788639164.104988:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788639164.104998:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523773029888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788639164.105032:0:13805:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788639164.105077:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523773029888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639164.105084:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788639164.105111:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773029248 00000100:00100000:2.0:1788639164.105115:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773029248 00000100:00100000:2.0:1788639164.105161:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773029760 00000100:00100000:2.0:1788639164.105164:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773029760 00000100:00100000:2.0:1788639164.105184:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788639164.105191:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773029248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639164.105236:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773029248:12345-0@lo:400:kworker.0 Request processed in 45us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639164.105242:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788639164.105254:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788639164.105261:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773029760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639164.105299:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773029760:12345-0@lo:400:kworker.0 Request processed in 39us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639164.105305:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:2.0:1788639164.105335:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788639164.105350:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788639164.105369:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:2.0:1788639164.105375:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ae243316a00, transno 4294967323 00000004:00080000:2.0:1788639164.105388:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:2.0:1788639164.105411:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243315880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773029248:0@lo:400:kworker.0 00000100:00100000:2.0:1788639164.105421:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1788639164.105424:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:2.0:1788639164.105435:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ae244037800, transno 4294967311 00000100:00100000:2.0:1788639164.105446:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242f0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773029760:0@lo:400:kworker.0 00000100:00100000:2.0:1788639164.105465:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242f08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523773029888:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788639164.109515:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875523773028608:0@lo:400:kworker.0 00000100:00100000:3.0:1788639164.109540:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243314700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773029120:0@lo:400:kworker.0 00000100:00100000:1.0:1788639164.109580:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773029376 00000100:00100000:1.0:1788639164.109590:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773029376 00000100:00100000:3.0:1788639164.109660:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639164.109718:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773029632:0@lo:400:kworker.0 00000100:00100000:3.0:1788639164.109745:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639164.109765:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1788639164.109778:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875523773029376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639164.109848:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875523773029376:12345-0@lo:400:kworker.0 Request processed in 73us (5261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639164.109872:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1788639164.109926:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773029120 00000100:00100000:1.0:1788639164.109930:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773029120 00000100:00100000:3.0:1788639164.110744:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243314a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875523773029376:0@lo:400:kworker.0 00000100:00100000:3.0:1788639164.111958:0:8829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773029632 00000100:00100000:3.0:1788639164.111972:0:8829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773029632 00000100:00100000:3.0:1788639164.112108:0:8829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788639164.112123:0:8829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773029632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639164.112475:0:8829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773029632:12345-0@lo:400:kworker.0 Request processed in 355us (2728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639164.112484:0:8829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788639164.112552:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773029632:0@lo:400:kworker.0 00000100:00080000:2.0:1788639164.112897:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788639164.112906:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788639164.114563:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788639164.114579:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773029120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639164.114709:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773029120:12345-0@lo:400:kworker.0 Request processed in 135us (5049us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639164.114717:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788639164.115789:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243314700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773029120:0@lo:400:kworker.0 00000100:00100000:0.0:1788639164.120556:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523773028224:0@lo:400:kworker.0 00000100:00100000:2.0:1788639164.121300:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773028736:0@lo:400:kworker.0 00000100:00100000:2.0:1788639164.121555:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639164.124604:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773028736 00000100:00100000:3.0:1788639164.124645:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773028736 00000100:00100000:2.0:1788639164.127083:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788639164.127102:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773028736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639164.127243:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773028736:12345-0@lo:400:kworker.0 Request processed in 145us (5689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639164.127251:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788639164.127368:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773028736:0@lo:400:kworker.0 00000040:00080000:3.0:1788639164.596891:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788639164.596907:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788639164.597017:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1788639164.597025:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788639164.597479:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242f0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773030016:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788639164.597570:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639164.597891:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773030016 00000100:00100000:2.0:1788639164.597903:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773030016 00000100:00100000:2.0:1788639164.597971:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788639164.597983:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773030016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788639164.598030:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788639164.598093:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773030016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639164.598101:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788639164.598210:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242f0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773030016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788639164.598483:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244125c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773030144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788639164.598525:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639164.598652:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773030144 00000100:00100000:1.0:1788639164.598659:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773030144 00000100:00100000:1.0:1788639164.598703:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788639164.598712:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244034e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523773030144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788639164.598732:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788639164.598781:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244034e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523773030144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639164.598788:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788639164.598899:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244125c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773030144:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788639164.853805:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639165.108916:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244037480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773030272:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788639165.108986:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639165.109087:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773030272 00000100:00100000:1.0:1788639165.109102:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773030272 00000100:00100000:1.0:1788639165.109209:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788639165.109223:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773030272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788639165.109272:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788639165.113761:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773030272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4532us (4765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639165.113775:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788639165.117457:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244037480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773030272:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788639165.415578:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639165.415659:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639165.415791:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754110976 00000100:00100000:3.0:1788639165.415800:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754110976 00000100:00100000:3.0:1788639165.415876:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 328 00000100:00100000:3.0:1788639165.415913:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2406:x1875523754110976:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639165.415976:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2406:x1875523754110976:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 66us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639165.415983:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 328 00000100:00080000:0.0:1788639165.416265:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788639165.416358:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639165.416394:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639165.416425:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639165.416445:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639165.416462:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639165.416482:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754111488 00000100:00100000:1.0:1788639165.416486:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754111488 00000100:00100000:1.0:1788639165.416511:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754110848 00000100:00100000:1.0:1788639165.416514:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754110848 00000100:00100000:1.0:1788639165.416526:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754111360 00000100:00100000:1.0:1788639165.416528:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754111360 00000100:00100000:1.0:1788639165.416540:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 329 00000100:00100000:1.0:1788639165.416546:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2406:x1875523754111488:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:1.0:1788639165.416578:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2406:x1875523754111488:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 32us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639165.416584:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 329 00000100:00100000:1.0:1788639165.416594:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 330 00000100:00100000:1.0:1788639165.416599:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+19:2406:x1875523754110848:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:1.0:1788639165.416642:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+19:2406:x1875523754110848:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 43us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639165.416647:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 330 00000100:00100000:1.0:1788639165.416658:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 331 00000100:00100000:1.0:1788639165.416664:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+6:2406:x1875523754111360:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:1.0:1788639165.416682:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+6:2406:x1875523754111360:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 20us (220us total) trans 0 rc 0/0 00000100:00080000:0.0:1788639165.416845:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788639165.416849:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788639165.417040:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754111232 00000100:00100000:3.0:1788639165.417045:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754111232 00000100:00100000:3.0:1788639165.417086:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754111104 00000100:00100000:3.0:1788639165.417089:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754111104 00000100:00100000:3.0:1788639165.417113:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 144 00000100:00100000:3.0:1788639165.417120:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244124a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2406:x1875523754111232:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639165.417152:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244124a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2406:x1875523754111232:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 32us (1456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639165.417159:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 144 00000100:00100000:3.0:1788639165.417172:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 145 00000100:00100000:3.0:1788639165.417178:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+7:2406:x1875523754111104:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639165.417212:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+7:2406:x1875523754111104:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 35us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639165.417218:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 145 00000100:00080000:0.0:1788639165.417442:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788639165.417446:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788639165.417474:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 331 00000100:00100000:2.0:1788639165.417549:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754110720 00000100:00100000:2.0:1788639165.417554:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754110720 00000100:00100000:2.0:1788639165.417590:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 390 00000100:00100000:2.0:1788639165.417596:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae369900850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+13:2406:x1875523754110720:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639165.417661:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae369900850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1343f14-ed5c-4943-b596-61180b04fa87+13:2406:x1875523754110720:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 64us (2093us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639165.417667:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 390 00010000:00010000:1.0:1788639165.879984:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788639166.568991:0:15058:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 16:12:46 (1788639166) 00000100:00100000:2.0:1788639166.646139:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788639166.646174:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773030400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788639166.646278:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639166.646357:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773030400 00000100:00100000:2.0:1788639166.646367:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773030400 00000100:00100000:2.0:1788639166.646443:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788639166.646454:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773030400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788639166.646491:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788639166.646543:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773030400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639166.646551:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:2.0:1788639166.646575:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788639166.646642:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773030400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788639166.648952:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242f09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773030528:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788639166.649041:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639166.649994:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773030528 00000100:00100000:1.0:1788639166.650006:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773030528 00000100:00100000:1.0:1788639166.650094:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788639166.650105:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773030528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788639166.650135:0:13805:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00080000:3.0:1788639166.650328:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788639166.652174:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773030528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2060us (3130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639166.652200:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788639166.654209:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242f09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773030528:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788639166.901740:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639167.928386:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788639168.184250:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000020:00080000:2.0:1788639168.184276:0:6494:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1788639168.184387:0:6548:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1788639168.184398:0:6548:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1788639168.949325:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639169.204992:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242f09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773030656:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788639169.205067:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639169.205381:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875523773031168:0@lo:400:kworker.0 00000100:00100000:1.0:1788639169.205412:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639169.205437:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773031680:0@lo:400:kworker.0 00000100:00100000:1.0:1788639169.205460:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639169.205478:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773032192:0@lo:400:kworker.0 00000100:00100000:1.0:1788639169.205498:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639169.205516:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788639169.205522:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773031040:0@lo:400:kworker.0 00000100:00100000:1.0:1788639169.205544:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639169.205561:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875523773031552:0@lo:400:kworker.0 00000100:00100000:1.0:1788639169.205579:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639169.205593:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243314700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875523773032064:0@lo:400:kworker.0 00000100:00100000:1.0:1788639169.205613:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639169.205696:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773031680 00000100:00100000:1.0:1788639169.205703:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773031680 00000100:00100000:1.0:1788639169.205752:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773032192 00000100:00100000:1.0:1788639169.205756:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773032192 00000100:00100000:1.0:1788639169.205778:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788639169.205786:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243316a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773031680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639169.205833:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243316a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773031680:12345-0@lo:400:kworker.0 Request processed in 48us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639169.205840:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788639169.205856:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788639169.205862:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243315880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523773032192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639169.205888:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243315880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523773032192:12345-0@lo:400:kworker.0 Request processed in 26us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639169.205893:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788639169.205913:0:12414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773031040 00000100:00100000:1.0:1788639169.205916:0:12414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773031040 00000100:00100000:1.0:1788639169.205938:0:12414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788639169.205944:0:12414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243316300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773031040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639169.205974:0:12414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243316300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773031040:12345-0@lo:400:kworker.0 Request processed in 30us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639169.205980:0:12414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00080000:1.0:1788639169.205995:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788639169.205999:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788639169.206029:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773031040:0@lo:400:kworker.0 00000100:00100000:1.0:1788639169.206040:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773031680:0@lo:400:kworker.0 00000100:00100000:1.0:1788639169.206049:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773032192:0@lo:400:kworker.0 00000100:00100000:2.0:1788639169.206150:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523773030784:0@lo:400:kworker.0 00000100:00100000:2.0:1788639169.206194:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639169.206221:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244125c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773031296:0@lo:400:kworker.0 00000100:00100000:2.0:1788639169.206243:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639169.206258:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773031808:0@lo:400:kworker.0 00000100:00100000:2.0:1788639169.206276:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639169.206303:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788639169.206310:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244124380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875523773030912:0@lo:400:kworker.0 00000100:00100000:2.0:1788639169.206331:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639169.206346:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875523773031424:0@lo:400:kworker.0 00000100:00100000:2.0:1788639169.206365:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639169.206380:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875523773031936:0@lo:400:kworker.0 00000100:00100000:2.0:1788639169.206406:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639169.206426:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773031168 00000100:00100000:2.0:1788639169.206430:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773031168 00000100:00100000:2.0:1788639169.206452:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773031552 00000100:00100000:2.0:1788639169.206455:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773031552 00000100:00100000:2.0:1788639169.206473:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773032064 00000100:00100000:2.0:1788639169.206476:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773032064 00000100:00100000:2.0:1788639169.206489:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773030912 00000100:00100000:2.0:1788639169.206491:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773030912 00000100:00100000:2.0:1788639169.206500:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773031424 00000100:00100000:2.0:1788639169.206502:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773031424 00000100:00100000:2.0:1788639169.206512:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773031936 00000100:00100000:2.0:1788639169.206514:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773031936 00000100:00100000:2.0:1788639169.206527:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1788639169.206532:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243314a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875523773031168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639169.206570:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243314a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875523773031168:12345-0@lo:400:kworker.0 Request processed in 38us (1157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639169.206576:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1788639169.206590:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1788639169.206597:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243314e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875523773031552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639169.206647:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243314e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875523773031552:12345-0@lo:400:kworker.0 Request processed in 50us (1066us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639169.206662:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1788639169.206675:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1788639169.206681:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243316d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875523773032064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639169.206709:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243316d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875523773032064:12345-0@lo:400:kworker.0 Request processed in 29us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639169.206715:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1788639169.206726:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1788639169.206732:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875523773030912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639169.206761:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875523773030912:12345-0@lo:400:kworker.0 Request processed in 30us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639169.206767:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1788639169.206779:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1788639169.206784:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875523773031424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639169.206808:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875523773031424:12345-0@lo:400:kworker.0 Request processed in 24us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639169.206814:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1788639169.206824:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1788639169.206830:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875523773031936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639169.206855:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875523773031936:12345-0@lo:400:kworker.0 Request processed in 25us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639169.206860:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00080000:2.0:1788639169.206880:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788639169.206883:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788639169.206890:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773031808 00000100:00100000:2.0:1788639169.206893:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773031808 00000100:00100000:2.0:1788639169.206927:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788639169.206933:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773031808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639169.206963:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773031808:12345-0@lo:400:kworker.0 Request processed in 30us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639169.206969:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:2.0:1788639169.206984:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788639169.207003:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244124380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875523773030912:0@lo:400:kworker.0 00000100:00100000:2.0:1788639169.207012:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875523773031424:0@lo:400:kworker.0 00000100:00100000:2.0:1788639169.207021:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875523773031936:0@lo:400:kworker.0 00000100:00100000:2.0:1788639169.207029:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773031808:0@lo:400:kworker.0 00010000:00080000:2.0:1788639169.207058:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae243b16300 x1875523773031552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639169.207069:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875523773031552:0@lo:400:kworker.0 00010000:00080000:2.0:1788639169.207078:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae243314700 x1875523773032064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639169.207087:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243314700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875523773032064:0@lo:400:kworker.0 00000100:00100000:2.0:1788639169.207098:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875523773031168:0@lo:400:kworker.0 00000100:00100000:0.0:1788639169.207203:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773031296 00000100:00100000:0.0:1788639169.207207:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773031296 00000100:00100000:0.0:1788639169.207240:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788639169.207247:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773031296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639169.207286:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773031296:12345-0@lo:400:kworker.0 Request processed in 40us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639169.207291:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788639169.207317:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244125c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773031296:0@lo:400:kworker.0 00000100:00100000:3.0:1788639169.207966:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773030656 00000100:00100000:3.0:1788639169.207973:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773030656 00000100:00100000:3.0:1788639169.208028:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788639169.208046:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244034700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773030656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788639169.208069:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788639169.208116:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244034700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773030656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (3048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639169.208122:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788639169.208161:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242f09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773030656:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788639169.208718:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788639169.208813:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773030784 00000100:00100000:3.0:1788639169.208818:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773030784 00000100:00100000:3.0:1788639169.208854:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1788639169.208861:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+24:3641:x1875523773030784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639169.209253:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01f1eef9-e690-4065-bf99-bf821af7b626+24:3641:x1875523773030784:12345-0@lo:400:kworker.0 Request processed in 391us (3057us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639169.209260:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1788639169.211233:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523773030784:0@lo:400:kworker.0 00000100:00100000:0.0:1788639169.716877:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773032320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788639169.716963:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639169.717075:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773032320 00000100:00100000:1.0:1788639169.717082:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773032320 00000100:00100000:1.0:1788639169.717142:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788639169.717145:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788639169.717154:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244037480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773032320:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788639169.717158:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242f09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773032448:0@lo:41:osp-pre-0-1.0 00002000:00000024:1.0:1788639169.717186:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788639169.717207:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639169.717246:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244037480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773032320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639169.717254:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788639169.717269:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773032320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788639169.717297:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773032448 00000100:00100000:1.0:1788639169.717303:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773032448 00000100:00100000:1.0:1788639169.717344:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788639169.717350:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773032448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788639169.717376:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788639169.717413:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773032448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639169.717419:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788639169.717450:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242f09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773032448:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788639169.976289:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639170.229021:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788639170.229048:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244037800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773032576:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788639170.229115:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639170.235426:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773032576 00000100:00100000:1.0:1788639170.235442:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773032576 00000100:00100000:1.0:1788639170.236333:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788639170.236348:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523773032576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788639170.236388:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788639170.236589:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523773032576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 245us (7474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639170.236596:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788639170.237933:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244037800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773032576:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788639170.531840:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639170.531887:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639170.531919:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639170.531952:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639170.531977:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639170.531995:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639170.532015:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639170.532046:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754111872 00000100:00100000:0.0:1788639170.532055:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754111872 00000100:00100000:1.0:1788639170.532064:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754111616 00000100:00100000:1.0:1788639170.532086:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754111616 00000100:00100000:1.0:1788639170.532141:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 392 00000100:00100000:1.0:1788639170.532151:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+13:2405:x1875523754111616:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639170.532190:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754112384 00000100:00100000:0.0:1788639170.532194:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754112384 00000100:00100000:0.0:1788639170.532212:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754111744 00000100:00100000:0.0:1788639170.532214:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754111744 00000100:00100000:0.0:1788639170.532226:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754112256 00000100:00100000:0.0:1788639170.532230:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754112256 00000100:00100000:1.0:1788639170.532232:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1343f14-ed5c-4943-b596-61180b04fa87+13:2405:x1875523754111616:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 80us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639170.532242:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 392 00000100:00100000:0.0:1788639170.532248:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 338 00000100:00100000:0.0:1788639170.532257:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244037100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2405:x1875523754111872:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:1.0:1788639170.532284:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754112128 00000100:00100000:1.0:1788639170.532289:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754112128 00000100:00100000:0.0:1788639170.532295:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244037100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2405:x1875523754111872:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 39us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639170.532303:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 338 00000100:00100000:0.0:1788639170.532319:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 339 00000100:00100000:1.0:1788639170.532322:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754112000 00000100:00100000:1.0:1788639170.532327:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754112000 00000100:00100000:0.0:1788639170.532328:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244037b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2405:x1875523754112384:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639170.532355:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244037b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2405:x1875523754112384:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 29us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639170.532357:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 149 00000100:00100000:0.0:1788639170.532367:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 339 00000100:00100000:1.0:1788639170.532372:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244034380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2405:x1875523754112128:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639170.532391:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 340 00000100:00100000:0.0:1788639170.532399:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244036a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+18:2405:x1875523754111744:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:1.0:1788639170.532410:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244034380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2405:x1875523754112128:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 40us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639170.532419:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 149 00000100:00100000:0.0:1788639170.532431:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244036a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+18:2405:x1875523754111744:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 33us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639170.532438:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 150 00000100:00100000:0.0:1788639170.532443:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 340 00000100:00100000:1.0:1788639170.532452:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244037800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+7:2405:x1875523754112000:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639170.532460:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 341 00000100:00100000:0.0:1788639170.532467:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+6:2405:x1875523754112256:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:1.0:1788639170.532497:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244037800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+7:2405:x1875523754112000:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 49us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639170.532504:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 150 00000100:00100000:0.0:1788639170.532852:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+6:2405:x1875523754112256:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 384us (834us total) trans 0 rc 0/0 00000100:00080000:2.0:1788639170.532860:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788639170.532861:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 341 00000100:00080000:2.0:1788639170.532868:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788639170.532872:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788639170.532875:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788639170.998753:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639171.037077:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639171.037178:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754112640 00000100:00100000:3.0:1788639171.037187:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754112640 00000100:00100000:3.0:1788639171.037248:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 66 00000100:00100000:3.0:1788639171.037258:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+18:13218:x1875523754112640:12345-192.168.206.18@tcp:35:umount.0 00000100:00100000:3.0:1788639171.037513:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+19:13218:x1875523754112640:12345-192.168.206.18@tcp:35:umount.0 Request processed in 257us (443us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1788639171.037520:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 66 00000100:00100000:3.0:1788639171.040324:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639171.040487:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754112896 00000100:00100000:1.0:1788639171.040500:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754112896 00000100:00100000:1.0:1788639171.040683:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 67 00000100:00100000:1.0:1788639171.040697:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+19:13218:x1875523754112896:12345-192.168.206.18@tcp:35:umount.0 00000100:00100000:1.0:1788639171.041227:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+20:13218:x1875523754112896:12345-192.168.206.18@tcp:35:umount.0 Request processed in 531us (914us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1788639171.041249:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 67 00000100:00100000:0.0:1788639171.046604:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639171.046818:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754113152 00000100:00100000:2.0:1788639171.046831:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754113152 00000100:00100000:2.0:1788639171.046925:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 68 00000100:00100000:2.0:1788639171.046936:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae370ef0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+20:13218:x1875523754113152:12345-192.168.206.18@tcp:35:umount.0 00000100:00100000:2.0:1788639171.047223:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae370ef0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+21:13218:x1875523754113152:12345-192.168.206.18@tcp:35:umount.0 Request processed in 288us (633us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1788639171.047232:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 68 00000100:00100000:0.0:1788639171.050258:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639171.050381:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754113408 00000100:00100000:2.0:1788639171.050394:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754113408 00000100:00100000:2.0:1788639171.050530:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 69 00000100:00100000:2.0:1788639171.050543:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+21:13218:x1875523754113408:12345-192.168.206.18@tcp:35:umount.0 00000100:00100000:2.0:1788639171.051051:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+22:13218:x1875523754113408:12345-192.168.206.18@tcp:35:umount.0 Request processed in 506us (1203us total) trans 4294967527 rc 0/0 00000100:00100000:2.0:1788639171.051060:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 69 00000100:00100000:3.0:1788639171.053698:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639171.053798:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639171.053831:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639171.053934:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639171.053989:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754113920 00000100:00100000:3.0:1788639171.054040:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754113920 00000100:00100000:3.0:1788639171.054120:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 80 00000100:00100000:3.0:1788639171.054134:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2404:x1875523754113920:12345-192.168.206.18@tcp:9:umount.0 00000100:00100000:2.0:1788639171.054141:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754113536 00000100:00100000:2.0:1788639171.054146:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754113536 00000020:00000080:3.0:1788639171.054185:0:8431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262c50f 00000100:00100000:2.0:1788639171.054189:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754113792 00000100:00100000:2.0:1788639171.054191:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754113792 00000100:00080000:3.0:1788639171.054198:0:8431:0:(import.c:65:import_set_state_nolock()) ffff9ae37f755000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788639171.054203:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754113664 00000100:00100000:2.0:1788639171.054205:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754113664 00000100:00100000:2.0:1788639171.054219:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 19 00000100:00100000:2.0:1788639171.054225:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1343f14-ed5c-4943-b596-61180b04fa87+15:2408:x1875523754113536:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788639171.054237:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00000004:3.0:1788639171.054258:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00010000:00010000:2.0:1788639171.054261:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae375f54600/0x25c454990262c1f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e853ac expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639171.054279:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788639171.054344:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1343f14-ed5c-4943-b596-61180b04fa87+14:2408:x1875523754113536:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 119us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639171.054371:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 19 00000100:00100000:2.0:1788639171.054390:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 20 00000100:00100000:2.0:1788639171.054396:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1343f14-ed5c-4943-b596-61180b04fa87+13:2408:x1875523754113792:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788639171.054404:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788639171.054409:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5deb128c-4fe3-4f51-b21e-f30846e08445+2:2404:x1875523754113920:12345-192.168.206.18@tcp:9:umount.0 Request processed in 280us (475us total) trans 0 rc 0/0 00010000:00010000:2.0:1788639171.054414:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae38217aa00/0x25c454990262c40c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85485 expref: 13 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639171.054416:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 80 00010000:00010000:2.0:1788639171.054425:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788639171.054435:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639171.054441:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1343f14-ed5c-4943-b596-61180b04fa87+12:2408:x1875523754113792:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 46us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639171.054447:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 20 00000100:00100000:2.0:1788639171.054459:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 21 00000100:00100000:2.0:1788639171.054464:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1343f14-ed5c-4943-b596-61180b04fa87+11:2408:x1875523754113664:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788639171.054474:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788639171.054483:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae375f54e00/0x25c454990262c134 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8536d expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639171.054492:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788639171.054508:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d1343f14-ed5c-4943-b596-61180b04fa87+10:2408:x1875523754113664:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 45us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639171.054514:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 21 00000100:00100000:0.0:1788639171.057393:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639171.057546:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754114304 00000100:00100000:2.0:1788639171.057558:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754114304 00000100:00100000:2.0:1788639171.057642:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 81 00000100:00100000:2.0:1788639171.057654:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+7:2404:x1875523754114304:12345-192.168.206.18@tcp:9:umount.0 00000020:00000080:2.0:1788639171.057717:0:8430:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262c77e 00000020:00010000:2.0:1788639171.057728:0:8430:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ae343eb8800: total 0 00000100:00080000:2.0:1788639171.057733:0:8430:0:(import.c:65:import_set_state_nolock()) ffff9ae343eba000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788639171.057797:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1788639171.057996:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2404:x1875523754114304:12345-192.168.206.18@tcp:9:umount.0 Request processed in 343us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639171.058004:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 81 00000020:00010000:1.0:1788639171.058148:0:9519:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ae343eb8800: total 0 00010000:00010000:1.0:1788639171.058199:0:9519:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ae343eb8800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1788639171.058257:0:9519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6600111/0x25c454990262cb3d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8566f expref: 5 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639171.058294:0:9519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020dc9e51/0x25c454990262d20c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85852 expref: 4 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639171.058310:0:9519:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ae343eb8800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1788639171.058320:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639171.058322:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639171.058324:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639171.065654:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639171.066222:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754115328 00000100:00100000:1.0:1788639171.066237:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754115328 00000100:00100000:1.0:1788639171.066318:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 258 00000100:00100000:1.0:1788639171.066331:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+22:2404:x1875523754115328:12345-192.168.206.18@tcp:39:umount.0 00000020:00000080:1.0:1788639171.066377:0:10169:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262c142 00000020:00010000:1.0:1788639171.066398:0:10169:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ae2431e0000: total 0 00000100:00080000:1.0:1788639171.066404:0:10169:0:(import.c:65:import_set_state_nolock()) ffff9ae2431e5000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788639171.066445:0:10169:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000020:00010000:3.0:1788639171.067800:0:6503:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ae2431e0000: total 0 00010000:00010000:3.0:1788639171.067885:0:6503:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ae2431e0000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788639171.067933:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ae242374000) 00010000:00010000:3.0:1788639171.067938:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788639171.067949:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262d1f7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8584b expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639171.067978:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ae242358d00) 00010000:00010000:3.0:1788639171.067996:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788639171.068003:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fba00/0x25c454990262c4e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e854af expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639171.068028:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ae242374000) 00010000:00010000:3.0:1788639171.068032:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788639171.068035:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a200/0x25c454990262d1cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8583d expref: 19 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639171.068051:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ae34ac63e00) 00010000:00010000:3.0:1788639171.068053:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788639171.068057:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fae00/0x25c454990262cafe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8565a expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639171.068071:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ae242374600) 00010000:00010000:3.0:1788639171.068074:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788639171.068078:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9c00/0x25c454990262ceaf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8576b expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639171.068091:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae242358200) 00010000:00010000:3.0:1788639171.068093:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788639171.068096:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a400/0x25c454990262cba6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8568b expref: 16 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639171.068108:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ae242358d00) 00010000:00010000:3.0:1788639171.068111:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788639171.068114:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217a600/0x25c454990262c7e0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85588 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639171.068150:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ae34af01b00) 00010000:00010000:3.0:1788639171.068153:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639171.068158:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750faa00/0x25c454990262c48a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8549a expref: 14 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639171.068185:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ae242374000) 00010000:00010000:3.0:1788639171.068187:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788639171.068191:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262d0ed lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85805 expref: 13 pid: 10169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639171.068208:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ae34ac63e00) 00010000:00010000:3.0:1788639171.068210:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788639171.068214:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8600/0x25c454990262cb28 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85668 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639171.068227:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ae242359200) 00010000:00010000:3.0:1788639171.068230:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788639171.068234:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78ba00/0x25c454990262c46e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85493 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639171.068256:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ae242374600) 00010000:00010000:3.0:1788639171.068259:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788639171.068262:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9000/0x25c454990262cbc2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85692 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639171.068277:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ae34ac63e00) 00010000:00010000:3.0:1788639171.068280:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788639171.068290:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae38217b800/0x25c454990262ca1e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85622 expref: 9 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639171.068307:0:6503:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ae2431e0000, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1788639171.068323:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639171.068325:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639171.068327:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639171.070279:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5deb128c-4fe3-4f51-b21e-f30846e08445+7:2404:x1875523754115328:12345-192.168.206.18@tcp:39:umount.0 Request processed in 3935us (4650us total) trans 4294967528 rc 0/0 00000100:00100000:1.0:1788639171.070296:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 258 00000100:00100000:0.0:1788639171.076240:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639171.076361:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754115456 00000100:00100000:2.0:1788639171.076373:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754115456 00000100:00100000:2.0:1788639171.076465:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 259 00000100:00100000:2.0:1788639171.076478:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+5:2404:x1875523754115456:12345-192.168.206.18@tcp:39:umount.0 00000020:00000080:2.0:1788639171.076518:0:6516:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262c149 00000100:00080000:2.0:1788639171.076537:0:6516:0:(import.c:65:import_set_state_nolock()) ffff9ae2431e4800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788639171.076602:0:6516:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788639171.076828:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5deb128c-4fe3-4f51-b21e-f30846e08445+3:2404:x1875523754115456:12345-192.168.206.18@tcp:39:umount.0 Request processed in 351us (601us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788639171.076837:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 259 00010000:00010000:3.0:1788639171.076955:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639171.765209:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773032704:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788639171.765312:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788639171.765319:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639171.765328:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773032832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788639171.765376:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639171.765409:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773032704 00000100:00100000:1.0:1788639171.765429:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773032704 00000100:00100000:2.0:1788639171.765447:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773032832 00000100:00100000:2.0:1788639171.765451:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773032832 00000100:00100000:1.0:1788639171.765504:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788639171.765514:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773032704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788639171.765551:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00080000:3.0:1788639171.765699:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788639171.770091:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788639171.770132:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243316680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773032832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788639171.770201:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788639171.770326:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243316680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773032832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 220us (4948us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639171.773656:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773032832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788639171.773983:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773032704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 8466us (8660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639171.773996:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788639171.774313:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788639171.774837:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773032704:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788639172.022545:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639172.608228:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639172.608279:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639172.608317:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639172.608413:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754115584 00000100:00100000:1.0:1788639172.608426:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754115584 00000100:00100000:1.0:1788639172.608488:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754115840 00000100:00100000:1.0:1788639172.608491:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754115840 00000100:00100000:1.0:1788639172.608503:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754115712 00000100:00100000:1.0:1788639172.608506:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754115712 00000100:00100000:1.0:1788639172.608521:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 22 00000100:00100000:1.0:1788639172.608530:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b60e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1343f14-ed5c-4943-b596-61180b04fa87+12:2407:x1875523754115584:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788639172.608549:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788639172.608573:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae242f23200/0x25c454990262c245 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e853c1 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639172.608593:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788639172.608709:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b60e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1343f14-ed5c-4943-b596-61180b04fa87+11:2407:x1875523754115584:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 179us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639172.608718:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 22 00000100:00100000:1.0:1788639172.608775:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 23 00000100:00100000:1.0:1788639172.608782:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1343f14-ed5c-4943-b596-61180b04fa87+10:2407:x1875523754115840:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788639172.608808:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788639172.608819:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae38217a400/0x25c454990262c405 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8547e expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639172.608831:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788639172.608852:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1343f14-ed5c-4943-b596-61180b04fa87+9:2407:x1875523754115840:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 70us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639172.608858:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 23 00000100:00100000:1.0:1788639172.608872:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 24 00000100:00100000:1.0:1788639172.608878:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1343f14-ed5c-4943-b596-61180b04fa87+8:2407:x1875523754115712:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788639172.608888:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788639172.608897:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae242f22c00/0x25c454990262c24c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e853f2 expref: 8 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639172.608906:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788639172.608925:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1343f14-ed5c-4943-b596-61180b04fa87+7:2407:x1875523754115712:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 48us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639172.608930:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 24 00000100:00100000:1.0:1788639172.618475:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639172.618581:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754116096 00000100:00100000:3.0:1788639172.618596:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754116096 00000100:00100000:3.0:1788639172.618722:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 260 00000100:00100000:3.0:1788639172.618737:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+6:2404:x1875523754116096:12345-192.168.206.18@tcp:39:umount.0 00000020:00000080:3.0:1788639172.618790:0:6518:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262c25a 00000020:00010000:3.0:1788639172.618800:0:6518:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ae242f2d800: total 0 00000100:00080000:3.0:1788639172.618805:0:6518:0:(import.c:65:import_set_state_nolock()) ffff9ae242f29800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788639172.618839:0:6518:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00100000:3.0:1788639172.619220:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2404:x1875523754116096:12345-192.168.206.18@tcp:39:umount.0 Request processed in 486us (758us total) trans 4294967529 rc 0/0 00000100:00100000:3.0:1788639172.619229:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 260 00000020:00010000:3.0:1788639172.619290:0:8446:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ae242f2d800: total 0 00010000:00010000:3.0:1788639172.619354:0:8446:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ae242f2d800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788639172.619418:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae242358200) 00010000:00010000:3.0:1788639172.619422:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788639172.619433:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8e00/0x25c454990262d21a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85859 expref: 4 pid: 11314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639172.619461:0:8446:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ae242f2d800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788639172.619475:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639172.619478:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639172.619480:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788639172.619850:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788639172.631749:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639172.633916:0:10169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754116224 00000100:00100000:1.0:1788639172.633937:0:10169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754116224 00000100:00100000:1.0:1788639172.634179:0:10169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 261 00000100:00100000:1.0:1788639172.634193:0:10169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+5:2404:x1875523754116224:12345-192.168.206.18@tcp:39:umount.0 00000020:00000080:1.0:1788639172.634245:0:10169:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262c261 00000100:00080000:1.0:1788639172.634257:0:10169:0:(import.c:65:import_set_state_nolock()) ffff9ae2432a6000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788639172.634296:0:10169:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788639172.634511:0:10169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aeb8e47b-1fde-42ab-834f-69a8d71ffb89+3:2404:x1875523754116224:12345-192.168.206.18@tcp:39:umount.0 Request processed in 320us (2775us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788639172.634519:0:10169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 261 00010000:00010000:3.0:1788639172.635852:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788639172.637853:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788639172.678758:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639172.679111:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754116480 00000100:00100000:0.0:1788639172.679126:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754116480 00000100:00100000:0.0:1788639172.679232:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 393 00000100:00100000:0.0:1788639172.679245:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+7:2404:x1875523754116480:12345-192.168.206.18@tcp:251:umount.0 00000020:00000080:0.0:1788639172.679307:0:6511:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262c11f 00000020:00010000:0.0:1788639172.679331:0:6511:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ae242df1800: total 0 00000100:00080000:0.0:1788639172.679338:0:6511:0:(import.c:65:import_set_state_nolock()) ffff9ae242df5800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788639172.679437:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1343f14-ed5c-4943-b596-61180b04fa87+3:2404:x1875523754116480:12345-192.168.206.18@tcp:251:umount.0 Request processed in 194us (691us total) trans 0 rc 0/0 00000020:00010000:3.0:1788639172.679443:0:6503:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ae242df1800: total 0 00000100:00100000:0.0:1788639172.679449:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 393 00010000:00010000:3.0:1788639172.679525:0:6503:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ae242df1800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788639172.679571:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae3750fa800/0x25c454990262c1f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e853b3 expref: 2 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639172.679592:0:6503:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ae242df1800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788639172.680111:0:6503:0:(genops.c:885:class_export_put()) final put ffff9ae242df1800/d1343f14-ed5c-4943-b596-61180b04fa87 00010000:00010000:3.0:1788639172.680136:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639172.680139:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639172.680141:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788639172.680182:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae242df1800/d1343f14-ed5c-4943-b596-61180b04fa87 for MGS 00000020:00000080:0.0:1788639172.680235:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae242df5800 for MGS 00010000:00010000:1.0:1788639173.046993:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788639173.686929:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788639174.070063:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639174.324945:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875523773033344:0@lo:400:kworker.0 00000100:00100000:1.0:1788639174.325042:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639174.325106:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773033856:0@lo:400:kworker.0 00000100:00100000:1.0:1788639174.325135:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639174.325168:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244124380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773034368:0@lo:400:kworker.0 00000100:00100000:1.0:1788639174.325193:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639174.325222:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1788639174.325228:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243314700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523773032960:0@lo:400:kworker.0 00000100:00100000:1.0:1788639174.325267:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639174.325292:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773033472:0@lo:400:kworker.0 00000100:00100000:1.0:1788639174.325317:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639174.325336:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773033984:0@lo:400:kworker.0 00000100:00100000:1.0:1788639174.325358:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639174.325376:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773034496:0@lo:400:kworker.0 00000100:00100000:1.0:1788639174.325398:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639174.325427:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523773033088:0@lo:400:kworker.0 00000100:00100000:1.0:1788639174.325451:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639174.325470:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875523773033600:0@lo:400:kworker.0 00000100:00100000:1.0:1788639174.325492:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639174.325520:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244125c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875523773034112:0@lo:400:kworker.0 00000100:00100000:1.0:1788639174.325542:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639174.325562:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788639174.325568:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773033216:0@lo:400:kworker.0 00000100:00100000:1.0:1788639174.325590:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639174.325609:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875523773033728:0@lo:400:kworker.0 00000100:00100000:1.0:1788639174.325665:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639174.325685:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875523773034240:0@lo:400:kworker.0 00000100:00100000:1.0:1788639174.325704:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639174.325732:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773033344 00000100:00100000:1.0:1788639174.325740:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773033344 00000100:00100000:1.0:1788639174.325786:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773033088 00000100:00100000:1.0:1788639174.325790:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773033088 00000100:00100000:1.0:1788639174.325801:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773033600 00000100:00100000:1.0:1788639174.325804:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773033600 00000100:00100000:1.0:1788639174.325827:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773034112 00000100:00100000:1.0:1788639174.325830:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773034112 00000100:00100000:1.0:1788639174.325842:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773033728 00000100:00100000:1.0:1788639174.325845:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773033728 00000100:00100000:1.0:1788639174.325856:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773034240 00000100:00100000:1.0:1788639174.325859:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773034240 00000100:00100000:1.0:1788639174.325877:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1788639174.325886:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875523773033344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639174.325949:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875523773033344:12345-0@lo:400:kworker.0 Request processed in 61us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639174.325956:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1788639174.325976:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1788639174.325982:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523773033088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639174.326025:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523773033088:12345-0@lo:400:kworker.0 Request processed in 43us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639174.326032:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1788639174.326044:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1788639174.326050:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875523773033600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639174.326076:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875523773033600:12345-0@lo:400:kworker.0 Request processed in 27us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639174.326083:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1788639174.326094:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1788639174.326100:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875523773034112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639174.326126:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875523773034112:12345-0@lo:400:kworker.0 Request processed in 27us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639174.326132:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1788639174.326143:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1788639174.326163:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875523773033728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639174.326206:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875523773033728:12345-0@lo:400:kworker.0 Request processed in 45us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639174.326212:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1788639174.326223:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1788639174.326229:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875523773034240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639174.326254:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875523773034240:12345-0@lo:400:kworker.0 Request processed in 25us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639174.326260:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1788639174.326280:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773033856 00000100:00100000:1.0:1788639174.326284:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773033856 00000100:00100000:1.0:1788639174.326315:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773034368 00000100:00100000:1.0:1788639174.326318:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773034368 00000100:00100000:1.0:1788639174.326330:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773033984 00000100:00100000:1.0:1788639174.326332:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773033984 00000100:00100000:1.0:1788639174.326343:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773034496 00000100:00100000:1.0:1788639174.326346:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773034496 00000100:00100000:1.0:1788639174.326359:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788639174.326366:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773033856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639174.326398:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773033856:12345-0@lo:400:kworker.0 Request processed in 33us (1262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639174.326404:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788639174.326416:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788639174.326428:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773034368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639174.326456:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773034368:12345-0@lo:400:kworker.0 Request processed in 35us (1263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639174.326463:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788639174.326475:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788639174.326481:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773033984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639174.326506:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773033984:12345-0@lo:400:kworker.0 Request processed in 26us (1147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639174.326511:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788639174.326522:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788639174.326527:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773034496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639174.326549:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773034496:12345-0@lo:400:kworker.0 Request processed in 22us (1150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639174.326554:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788639174.326584:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773032960 00000100:00100000:1.0:1788639174.326593:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773032960 00000100:00100000:1.0:1788639174.326686:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1788639174.326692:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+24:3641:x1875523773032960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639174.326719:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01f1eef9-e690-4065-bf99-bf821af7b626+24:3641:x1875523773032960:12345-0@lo:400:kworker.0 Request processed in 28us (1451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639174.326724:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1788639174.326750:0:12414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773033472 00000100:00100000:1.0:1788639174.326753:0:12414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773033472 00000100:00100000:1.0:1788639174.326783:0:12414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773033216 00000100:00100000:1.0:1788639174.326787:0:12414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773033216 00000100:00100000:1.0:1788639174.326800:0:12414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788639174.326806:0:12414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773033472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639174.326839:0:12414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773033472:12345-0@lo:400:kworker.0 Request processed in 33us (1521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639174.326845:0:12414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788639174.326856:0:12414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788639174.326861:0:12414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773033216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639174.326888:0:12414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773033216:12345-0@lo:400:kworker.0 Request processed in 27us (1298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639174.326893:0:12414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00080000:1.0:1788639174.326943:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788639174.326948:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788639174.326951:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788639174.326953:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788639174.326961:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788639174.326974:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773034624:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788639174.327007:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639174.327043:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773034624 00000100:00100000:1.0:1788639174.327054:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773034624 00000100:00100000:1.0:1788639174.327081:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788639174.327087:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773034624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788639174.327113:0:13805:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788639174.327163:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773034624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639174.327171:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788639174.327226:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773034624:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788639174.327261:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773033216:0@lo:400:kworker.0 00010000:00080000:1.0:1788639174.327276:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae243b14380 x1875523773033728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639174.327288:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875523773033728:0@lo:400:kworker.0 00010000:00080000:1.0:1788639174.327299:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae244126680 x1875523773034240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639174.327307:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875523773034240:0@lo:400:kworker.0 00000100:00100000:1.0:1788639174.327319:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523773033088:0@lo:400:kworker.0 00000100:00100000:1.0:1788639174.327332:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875523773033600:0@lo:400:kworker.0 00000100:00100000:1.0:1788639174.327342:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244125c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875523773034112:0@lo:400:kworker.0 00000100:00100000:1.0:1788639174.327382:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243314700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523773032960:0@lo:400:kworker.0 00000100:00100000:1.0:1788639174.327395:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773033472:0@lo:400:kworker.0 00000100:00100000:1.0:1788639174.327405:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773033984:0@lo:400:kworker.0 00000100:00100000:1.0:1788639174.327430:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773034496:0@lo:400:kworker.0 00000100:00100000:1.0:1788639174.327441:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875523773033344:0@lo:400:kworker.0 00000100:00100000:1.0:1788639174.327451:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773033856:0@lo:400:kworker.0 00000100:00100000:1.0:1788639174.327458:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244124380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773034368:0@lo:400:kworker.0 00000020:01000004:3.0:1788639174.661219:0:15253:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788639174.677231:0:15253:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788639174.677325:0:15253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f23600/0x25c454990262c1c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c1ce expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639174.677345:0:15253:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f23600/0x25c454990262c1c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262c1ce expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639174.677354:0:15253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f23600/0x25c454990262c1c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262c1ce expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639174.677362:0:15253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9ae242f23600/0x25c454990262c1c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262c1ce expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639174.677394:0:15253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788639174.677401:0:15253:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788639174.677436:0:15253:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788639174.677442:0:15253:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788639174.677452:0:15253:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788639174.677504:0:15253:0:(import.c:65:import_set_state_nolock()) ffff9ae36d18b000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788639174.677962:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875523773034752:0@lo:39:umount.0 00000100:00100000:2.0:1788639174.678081:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639174.678353:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773034752 00000100:00100000:2.0:1788639174.678366:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773034752 00000100:00100000:2.0:1788639174.678445:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788639174.678681:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875523773034752:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788639174.678834:0:6516:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262bd36 00000100:00080000:2.0:1788639174.678846:0:6516:0:(import.c:65:import_set_state_nolock()) ffff9ae3483c5000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788639174.678889:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788639174.678901:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae242f23600/0x25c454990262c1c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262c1ce expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639174.678910:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f23600 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:3.0:1788639174.678915:0:8446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae242f23600/0x25c454990262c1c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262c1ce expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639174.678934:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3640:x1875523773034752:12345-0@lo:39:umount.0 Request processed in 467us (850us total) trans 0 rc 0/0 00010000:00010000:3.0:1788639174.678942:0:8446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae242f23600/0x25c454990262c1c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c454990262c1ce expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639174.678947:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 10000000:00010000:3.0:1788639174.678956:0:8446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae242f23600/0x25c454990262c1c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c454990262c1ce expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639174.678963:0:8446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000020:00000080:2.0:1788639174.678965:0:6516:0:(genops.c:885:class_export_put()) final put ffff9ae3483c0000/lustre-MDT0000-lwp-MDT0000_UUID 10000000:01000000:3.0:1788639174.678966:0:8446:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788639174.678971:0:8446:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788639174.678998:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639174.679010:0:8446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae242f23600/0x25c454990262c1c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262c1ce expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639174.679018:0:8446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:2.0:1788639174.679038:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae36d18b000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:3.0:1788639174.679045:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae242f23600/0x25c454990262c1c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262c1ce expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639174.679053:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae242f23600/0x25c454990262c1c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262c1ce expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639174.679068:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639174.679070:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639174.679072:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639174.679086:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242f0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01f1eef9-e690-4065-bf99-bf821af7b626:3644:1875523773034880:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788639174.679120:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875523773034752:0@lo:39:umount.0 00000100:00100000:3.0:1788639174.679128:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639174.679193:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773034880 00000100:00100000:3.0:1788639174.679197:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773034880 00000100:00100000:3.0:1788639174.679237:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788639174.679244:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+24:3644:x1875523773034880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788639174.679256:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000080:2.0:1788639174.679282:0:13809:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae3483c0000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788639174.679378:0:13809:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae3483c5000 for lustre-MDT0000 00000100:00080000:0.0:1788639174.679603:0:15253:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788639174.679608:0:15253:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788639174.679613:0:15253:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788639174.680064:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae375f55e00/0x25c454990262c1ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c454990262c1c7 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639174.680101:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639174.680236:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01f1eef9-e690-4065-bf99-bf821af7b626+23:3644:x1875523773034880:12345-0@lo:103:ldlm_bl.0 Request processed in 987us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639174.680248:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788639174.680340:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242f0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01f1eef9-e690-4065-bf99-bf821af7b626:3644:1875523773034880:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788639174.681905:0:15253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae375f55a00/0x25c454990262c1d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c1dc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639174.681928:0:15253:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae375f55a00/0x25c454990262c1d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262c1dc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639174.681937:0:15253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae375f55a00/0x25c454990262c1d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262c1dc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639174.681945:0:15253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9ae375f55a00/0x25c454990262c1d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262c1dc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639174.682047:0:15253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788639174.682063:0:15253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3750fbc00/0x25c454990262c0d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c0e0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639174.682071:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639174.682090:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae375f55a00/0x25c454990262c1d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262c1dc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639174.682122:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375f55a00 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:0.0:1788639174.682129:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae375f55a00/0x25c454990262c1d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262c1dc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639174.682142:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae375f55a00/0x25c454990262c1d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c454990262c1dc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788639174.682168:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae375f55a00/0x25c454990262c1d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c454990262c1dc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639174.682174:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788639174.682178:0:6503:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1788639174.682231:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae375f55a00/0x25c454990262c1d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262c1dc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639174.682239:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788639174.682273:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae375f55a00/0x25c454990262c1d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262c1dc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639174.682290:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae375f55a00/0x25c454990262c1d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262c1dc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639174.682292:0:15253:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3750fbc00/0x25c454990262c0d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262c0e0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639174.682309:0:15253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3750fbc00/0x25c454990262c0d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262c0e0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639174.682315:0:15253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9ae3750fbc00/0x25c454990262c0d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262c0e0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639174.682322:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639174.682338:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788639174.682342:0:15253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788639174.682343:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae3750fbc00/0x25c454990262c0d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262c0e0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639174.682355:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fbc00 already unused, calling callback (ffffffffc131ec20) 00010000:00010000:2.0:1788639174.682356:0:15253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae340031c00/0x25c454990262c43d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c444 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788639174.682360:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae3750fbc00/0x25c454990262c0d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262c0e0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639174.682372:0:15253:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae340031c00/0x25c454990262c43d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262c444 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639174.682375:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae3750fbc00/0x25c454990262c0d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c454990262c0e0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788639174.682391:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae3750fbc00/0x25c454990262c0d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c454990262c0e0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639174.682393:0:15253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae340031c00/0x25c454990262c43d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262c444 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639174.682406:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788639174.682410:0:15253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9ae340031c00/0x25c454990262c43d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262c444 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639174.682411:0:6503:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788639174.682417:0:6503:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788639174.682437:0:15253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788639174.682447:0:15253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae341480a00/0x25c454990262bc95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bc9c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639174.682450:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae3750fbc00/0x25c454990262c0d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262c0e0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639174.682457:0:15253:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae341480a00/0x25c454990262bc95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262bc9c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639174.682461:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788639174.682476:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae3750fbc00/0x25c454990262c0d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262c0e0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639174.682480:0:15253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae341480a00/0x25c454990262bc95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262bc9c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639174.682488:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae3750fbc00/0x25c454990262c0d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262c0e0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639174.682491:0:15253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9ae341480a00/0x25c454990262bc95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262bc9c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639174.682517:0:15253:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788639174.682518:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:01000000:2.0:1788639174.682522:0:15253:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:0.0:1788639174.682526:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae340031c00/0x25c454990262c43d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262c444 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788639174.682530:0:15253:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:0.0:1788639174.682536:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae340031c00 already unused, calling callback (ffffffffc131ec20) 00010000:00010000:1.0:1788639174.682588:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788639174.682602:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae341480a00/0x25c454990262bc95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262bc9c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639174.682654:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae341480a00 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:1.0:1788639174.682660:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae341480a00/0x25c454990262bc95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262bc9c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639174.682670:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639174.682672:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae341480a00/0x25c454990262bc95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c454990262bc9c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788639174.682687:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae341480a00/0x25c454990262bc95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c454990262bc9c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788639174.682694:0:15253:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 10000000:01000000:1.0:1788639174.682695:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00000020:01000000:2.0:1788639174.682702:0:15253:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 10000000:01000000:1.0:1788639174.682704:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00000020:00000080:2.0:1788639174.682714:0:15253:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 10000000:01000000:1.0:1788639174.682715:0:6504:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000020:00000080:2.0:1788639174.682728:0:15253:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:2.0:1788639174.682741:0:15253:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9ae242df2800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788639174.682748:0:15253:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9ae375cae800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788639174.682754:0:15253:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9ae36d258800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788639174.682759:0:15253:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9ae36d237800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:2.0:1788639174.682768:0:15253:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9ae242f2d800 aeb8e47b-1fde-42ab-834f-69a8d71ffb89 192.168.206.18@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788639174.682775:0:15253:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9ae2431e0000 5deb128c-4fe3-4f51-b21e-f30846e08445 192.168.206.18@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967523 stale:0 00000020:00080000:2.0:1788639174.682781:0:15253:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9ae342e53380) has exports, disconnecting them 00000020:00080000:2.0:1788639174.682786:0:15253:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ae242df2800), last request at 1788639174 00000020:00000080:2.0:1788639174.682794:0:15253:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262c046 00000100:00080000:2.0:1788639174.682820:0:15253:0:(import.c:65:import_set_state_nolock()) ffff9ae242df4800 : changing import state from FULL to CLOSED 10000000:00010000:0.0:1788639174.682832:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae340031c00/0x25c454990262c43d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262c444 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639174.682845:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae340031c00/0x25c454990262c43d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c454990262c444 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788639174.682852:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae340031c00/0x25c454990262c43d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c454990262c444 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639174.682858:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788639174.682860:0:6503:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788639174.682862:0:6503:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788639174.682883:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae340031c00/0x25c454990262c43d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262c444 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639174.682890:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788639174.682909:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae340031c00/0x25c454990262c43d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262c444 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639174.682916:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae340031c00/0x25c454990262c43d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262c444 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639174.682929:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639174.682930:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639174.683074:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639174.683099:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523773035008:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788639174.683108:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae341480a00/0x25c454990262bc95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262bc9c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639174.683119:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:2.0:1788639174.683132:0:15253:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ae242df2800): rc 0 00010000:00010000:1.0:1788639174.683137:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae341480a00/0x25c454990262bc95 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262bc9c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788639174.683157:0:15253:0:(genops.c:885:class_export_put()) final put ffff9ae242df2800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788639174.683176:0:15253:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ae375cae800), last request at 1788639174 00000020:00000080:2.0:1788639174.683186:0:15253:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262bf20 00000100:00080000:2.0:1788639174.683198:0:15253:0:(import.c:65:import_set_state_nolock()) ffff9ae241e9b800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788639174.683198:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae341480a00/0x25c454990262bc95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262bc9c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639174.683211:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1788639174.683228:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae242df2800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788639174.683283:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae242df4800 for lustre-MDT0000 00010000:00010000:2.0:1788639174.683294:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639174.683298:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788639174.683310:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523773035136:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788639174.683313:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788639174.683315:0:15253:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ae375cae800): rc 0 00010000:00010000:1.0:1788639174.683318:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788639174.683321:0:15253:0:(genops.c:885:class_export_put()) final put ffff9ae375cae800/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:1.0:1788639174.683326:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788639174.683336:0:15253:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ae36d258800), last request at 1788638949 00000020:00000080:2.0:1788639174.683340:0:15253:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262be1d 00000100:00100000:0.0:1788639174.683344:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788639174.683347:0:15253:0:(import.c:65:import_set_state_nolock()) ffff9ae36d25b800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788639174.683361:0:13809:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae375cae800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00010000:00010000:1.0:1788639174.683404:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788639174.683406:0:13809:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae241e9b800 for lustre-MDT0000 00000020:00080000:2.0:1788639174.683431:0:15253:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ae36d258800): rc 0 00000100:00100000:0.0:1788639174.683431:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523773035264:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1788639174.683434:0:15253:0:(genops.c:885:class_export_put()) final put ffff9ae36d258800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1788639174.683445:0:15253:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ae36d237800), last request at 1788638949 00000020:00000080:2.0:1788639174.683449:0:15253:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262bde5 00000100:00080000:2.0:1788639174.683454:0:15253:0:(import.c:65:import_set_state_nolock()) ffff9ae37513f000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788639174.683465:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1788639174.683466:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae36d258800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000100:00100000:0.0:1788639174.683494:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788639174.683502:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523773035392:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1788639174.683530:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae36d25b800 for lustre-MDT0000 00000100:00100000:0.0:1788639174.683544:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788639174.683565:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1788639174.683582:0:15253:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000100:00100000:0.0:1788639174.683584:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773035008 00000100:00100000:0.0:1788639174.683593:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773035008 00000020:00080000:2.0:1788639174.683726:0:15253:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ae36d237800): rc 0 00000004:00000080:2.0:1788639174.683735:0:15253:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffaea581c9fae0 00000100:00080000:2.0:1788639174.683757:0:15253:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788639174.683761:0:15253:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00100000:0.0:1788639174.683821:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773035136 00000100:00100000:0.0:1788639174.683827:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773035136 00000100:00100000:0.0:1788639174.683848:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773035264 00000100:00100000:0.0:1788639174.683850:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773035264 00000100:00100000:0.0:1788639174.683862:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773035392 00000100:00100000:0.0:1788639174.683864:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773035392 00000100:00100000:0.0:1788639174.683882:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788639174.683891:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01f1eef9-e690-4065-bf99-bf821af7b626+26:3641:x1875523773035008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788639174.683906:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788639174.683923:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae242f23000/0x25c454990262c1dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c454990262c1d5 expref: 26 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639174.683937:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788639174.683981:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01f1eef9-e690-4065-bf99-bf821af7b626+25:3641:x1875523773035008:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639174.683988:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788639174.684009:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788639174.684015:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01f1eef9-e690-4065-bf99-bf821af7b626+24:3641:x1875523773035136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788639174.684023:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788639174.684031:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae375f55000/0x25c454990262c0e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c454990262c0d9 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639174.684053:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788639174.684079:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01f1eef9-e690-4065-bf99-bf821af7b626+23:3641:x1875523773035136:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639174.684086:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788639174.684100:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788639174.684106:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01f1eef9-e690-4065-bf99-bf821af7b626+22:3643:x1875523773035264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788639174.684114:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788639174.684124:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae340031200/0x25c454990262c444 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c454990262c43d expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639174.684133:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788639174.684171:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01f1eef9-e690-4065-bf99-bf821af7b626+21:3643:x1875523773035264:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639174.684177:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788639174.684190:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788639174.684197:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b60fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01f1eef9-e690-4065-bf99-bf821af7b626+20:3643:x1875523773035392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788639174.684206:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788639174.684217:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae341481800/0x25c454990262bc9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c454990262bc95 expref: 20 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639174.684229:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788639174.684254:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b60fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01f1eef9-e690-4065-bf99-bf821af7b626+19:3643:x1875523773035392:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639174.684261:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:0.0:1788639174.684304:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788639174.685108:0:15253:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00010000:00010000:3.0:1788639174.685115:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788639174.685159:0:15253:0:(import.c:65:import_set_state_nolock()) ffff9ae375d4d800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788639174.685210:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773035520:0@lo:39:umount.0 00000100:00100000:2.0:1788639174.685268:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639174.686015:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523773035136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788639174.686087:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523773035392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788639174.686109:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523773035264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788639174.686114:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523773035008:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788639174.686487:0:15253:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788639174.686493:0:15253:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:2.0:1788639174.686519:0:15253:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788639174.686581:0:15253:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788639174.686610:0:15253:0:(import.c:65:import_set_state_nolock()) ffff9ae375c2b800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788639174.686664:0:15253:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788639174.686667:0:15253:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000100:00100000:1.0:1788639174.686682:0:12414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773035520 00000004:00080000:2.0:1788639174.686685:0:15253:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788639174.686696:0:12414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773035520 00000100:00080000:2.0:1788639174.686755:0:15253:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788639174.686768:0:15253:0:(import.c:65:import_set_state_nolock()) ffff9ae2431e2000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788639174.686777:0:12414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788639174.686792:0:12414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875523773035520:12345-0@lo:39:umount.0 00000100:00100000:3.0:1788639174.686800:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773035648:0@lo:9:umount.0 00000020:00080000:2.0:1788639174.686813:0:15253:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9ae342e53380) has no exports 00000020:00000080:1.0:1788639174.686830:0:12414:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262be78 00000100:00080000:1.0:1788639174.686847:0:12414:0:(import.c:65:import_set_state_nolock()) ffff9ae375ea0000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788639174.686881:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00000004:1.0:1788639174.686883:0:12414:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1788639174.686930:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773035776:0@lo:9:umount.0 00000100:00100000:3.0:1788639174.686957:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639174.687017:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773035648 00000100:00100000:0.0:1788639174.687040:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773035648 00000100:00100000:1.0:1788639174.687042:0:12414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3640:x1875523773035520:12345-0@lo:39:umount.0 Request processed in 250us (1772us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788639174.687053:0:12414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788639174.687102:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773035776 00010000:00010000:1.0:1788639174.687105:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639174.687109:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773035776 00000100:00080000:1.0:1788639174.687159:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae375d4d800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788639174.687167:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788639174.687174:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773035520:0@lo:39:umount.0 00000100:00100000:0.0:1788639174.687185:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875523773035648:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788639174.687214:0:8432:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262bfc8 00000100:00080000:0.0:1788639174.687222:0:8432:0:(import.c:65:import_set_state_nolock()) ffff9ae2416ed000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788639174.687271:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1788639174.687444:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3640:x1875523773035648:12345-0@lo:9:umount.0 Request processed in 267us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639174.687452:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788639174.687472:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788639174.687479:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875523773035776:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788639174.687493:0:8432:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262c10a 00000100:00080000:0.0:1788639174.687500:0:8432:0:(import.c:65:import_set_state_nolock()) ffff9ae241e9c800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788639174.687527:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1788639174.687608:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3640:x1875523773035776:12345-0@lo:9:umount.0 Request processed in 129us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639174.687645:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:0.0:1788639174.687678:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639174.687687:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788639174.687731:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae375c2b800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788639174.687750:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788639174.687753:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788639174.687756:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773035648:0@lo:9:umount.0 00000100:00080000:0.0:1788639174.688387:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae2431e2000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788639174.688416:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788639174.688418:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788639174.688421:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773035776:0@lo:9:umount.0 00000020:00080000:0.0:1788639174.696712:0:15253:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9ae342e53380) has no exports 00000020:00000080:0.0:1788639174.736230:0:15253:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262bcf0 00000020:00000080:0.0:1788639174.736246:0:15253:0:(genops.c:885:class_export_put()) final put ffff9ae369175800/lustre-QMT0000_UUID 00000020:01000000:0.0:1788639174.736268:0:15253:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788639174.736374:0:13809:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae369175800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788639174.736413:0:15253:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788639174.736425:0:15253:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788639174.736430:0:15253:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9ae3802a0000) has no exports 00000020:00000080:1.0:1788639174.737075:0:15253:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262bce9 00000020:00000080:1.0:1788639174.737082:0:15253:0:(genops.c:885:class_export_put()) final put ffff9ae36d08a000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788639174.737157:0:15253:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788639174.737165:0:15253:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788639174.737205:0:13809:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae36d08a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788639174.737240:0:15253:0:(genops.c:885:class_export_put()) final put ffff9ae36d089800/lustre-QMT0000_UUID 00000020:00000080:1.0:1788639174.737242:0:15253:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae36d089800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788639174.737250:0:15253:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00100000:1.0:1788639174.837006:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788639174.837033:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242f08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523773035904:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788639174.837120:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639174.837360:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773035904 00000100:00100000:3.0:1788639174.837370:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773035904 00000100:00100000:3.0:1788639174.837422:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788639174.837431:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1875523773035904:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1788639174.837440:0:6521:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788639174.837490:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1875523773035904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (369us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788639174.837497:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:02020000:0.0:1788639174.837683:0:3642:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:0.0:1788639174.845538:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788639174.845547:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ae36ddec000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788639174.845553:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788639174.859570:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ae36ddec000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788639174.859591:0:3642:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 208 00000100:00080000:0.0:1788639174.859606:0:3642:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9ae36ddec000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:1.0:1788639174.862592:0:3642:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae24233f480 x1875523773036032/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788639174.862747:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773036032:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788639174.862810:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639174.862971:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773036032 00000100:00100000:1.0:1788639174.862979:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773036032 00000100:00100000:1.0:1788639174.863019:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788639174.863026:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875523773036032:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1788639174.863043:0:6522:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788639174.869434:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875523773036032:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 6399us (6616us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788639174.869448:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00080000:0.0:1788639174.870873:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae36ddec000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788639174.870885:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788639174.870890:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773036032:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:0.0:1788639175.092790:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639176.119073:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639176.885056:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788639176.885080:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773036160:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788639176.885180:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639176.885411:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773036160 00000100:00100000:2.0:1788639176.885420:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773036160 00000100:00100000:2.0:1788639176.885504:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788639176.885513:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773036160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788639176.885542:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788639176.885589:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773036160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639176.885595:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788639176.885671:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773036160:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788639176.885836:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788639177.142556:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788639177.400022:0:9509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788639177.400035:0:9509:0:(genops.c:885:class_export_put()) final put ffff9ae241e9a800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788639177.400063:0:9509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5deb128c-4fe3-4f51-b21e-f30846e08445 00000020:00000080:2.0:1788639177.400065:0:9509:0:(genops.c:885:class_export_put()) final put ffff9ae37f753000/5deb128c-4fe3-4f51-b21e-f30846e08445 00000020:00000080:0.0:1788639177.400223:0:13809:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae241e9a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788639177.400286:0:13809:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae37f753000/5deb128c-4fe3-4f51-b21e-f30846e08445 for lustre-OST0001 00000020:00000080:0.0:1788639177.400306:0:13809:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae241e9c800 for lustre-OST0001 00000020:00000080:0.0:1788639177.400312:0:13809:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae37f755000 for lustre-OST0001 00000001:00100000:0.0:1788639177.400606:0:7446:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788639177.400657:0:7446:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:0.0:1788639177.400661:0:7446:0:(genops.c:885:class_export_put()) final put ffff9ae375ea5000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788639177.400692:0:7446:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of aeb8e47b-1fde-42ab-834f-69a8d71ffb89 00000001:00080000:0.0:1788639177.400697:0:7446:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:0.0:1788639177.400699:0:7446:0:(genops.c:885:class_export_put()) final put ffff9ae2432a1000/aeb8e47b-1fde-42ab-834f-69a8d71ffb89 00000001:00100000:0.0:1788639177.400704:0:7446:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 5deb128c-4fe3-4f51-b21e-f30846e08445 00000001:00080000:0.0:1788639177.400708:0:7446:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:0.0:1788639177.400709:0:7446:0:(genops.c:885:class_export_put()) final put ffff9ae2431e6000/5deb128c-4fe3-4f51-b21e-f30846e08445 00000001:00100000:2.0:1788639177.400812:0:6494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788639177.400822:0:6494:0:(genops.c:885:class_export_put()) final put ffff9ae36d237800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788639177.400836:0:6494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of aeb8e47b-1fde-42ab-834f-69a8d71ffb89 00000001:00080000:2.0:1788639177.400843:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967529 is committed 00000020:00000080:2.0:1788639177.400846:0:6494:0:(genops.c:885:class_export_put()) final put ffff9ae242f2d800/aeb8e47b-1fde-42ab-834f-69a8d71ffb89 00000001:00100000:2.0:1788639177.400852:0:6494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5deb128c-4fe3-4f51-b21e-f30846e08445 00000001:00080000:2.0:1788639177.400856:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:2.0:1788639177.400862:0:6494:0:(genops.c:885:class_export_put()) final put ffff9ae2431e0000/5deb128c-4fe3-4f51-b21e-f30846e08445 00000020:00000080:1.0:1788639177.400938:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae375ea5000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1788639177.400993:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae2432a1000/aeb8e47b-1fde-42ab-834f-69a8d71ffb89 for lustre-MDT0001 00000020:00000080:1.0:1788639177.401024:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae2431e6000/5deb128c-4fe3-4f51-b21e-f30846e08445 for lustre-MDT0001 00000020:00000080:1.0:1788639177.401060:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae36d237800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1788639177.401095:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae242f2d800/aeb8e47b-1fde-42ab-834f-69a8d71ffb89 for lustre-MDT0000 00000020:00000080:1.0:1788639177.401139:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae2431e0000/5deb128c-4fe3-4f51-b21e-f30846e08445 for lustre-MDT0000 00000020:00000080:1.0:1788639177.401178:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae375ea0000 for lustre-MDT0001 00000020:00000080:1.0:1788639177.401185:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae2432a6000 for lustre-MDT0001 00000020:00000080:1.0:1788639177.401191:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae2431e4800 for lustre-MDT0001 00000020:00000080:1.0:1788639177.401195:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae37513f000 for lustre-MDT0000 00000020:00000080:1.0:1788639177.401206:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae242f29800 for lustre-MDT0000 00000020:00000080:1.0:1788639177.401210:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae2431e5000 for lustre-MDT0000 00000001:00100000:0.0:1788639177.401496:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788639177.401501:0:8425:0:(genops.c:885:class_export_put()) final put ffff9ae2416ec800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788639177.401597:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae2416ec800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788639177.401665:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae2416ed000 for lustre-OST0000 00000001:00100000:0.0:1788639177.401710:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5deb128c-4fe3-4f51-b21e-f30846e08445 00000020:00000080:0.0:1788639177.401713:0:8425:0:(genops.c:885:class_export_put()) final put ffff9ae343eb8800/5deb128c-4fe3-4f51-b21e-f30846e08445 00000020:00000080:1.0:1788639177.401819:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae343eb8800/5deb128c-4fe3-4f51-b21e-f30846e08445 for lustre-OST0000 00000020:00000080:1.0:1788639177.401844:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae343eba000 for lustre-OST0000 00010000:00010000:0.0:1788639178.165666:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639179.188798:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788639179.444912:0:13809:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788639179.444923:0:13809:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788639179.444927:0:13809:0:(import.c:65:import_set_state_nolock()) ffff9ae36ddec000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788639179.444939:0:13809:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 433 00000100:00080000:1.0:1788639179.444946:0:13809:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788639179.444954:0:13809:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9ae36ddec000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:1.0:1788639179.444986:0:13809:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae24233f480 x1875523773036416/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788639179.445093:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875523773036800:0@lo:400:kworker.0 00000100:00100000:1.0:1788639179.445203:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639179.445253:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773036800 00000100:00100000:1.0:1788639179.445262:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773036800 00000100:00100000:1.0:1788639179.445332:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1788639179.445343:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875523773036800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639179.445393:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875523773036800:12345-0@lo:400:kworker.0 Request processed in 53us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639179.445401:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00080000:1.0:1788639179.445442:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788639179.445515:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae244127100 x1875523773036800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639179.445555:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875523773036800:0@lo:400:kworker.0 00000100:00100000:1.0:1788639179.445564:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523773037312:0@lo:400:kworker.0 00000100:00100000:1.0:1788639179.445595:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639179.445678:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788639179.445685:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244124380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875523773036672:0@lo:400:kworker.0 00000100:00100000:1.0:1788639179.445711:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639179.445735:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773036672 00000100:00100000:1.0:1788639179.445739:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773036672 00000100:00100000:1.0:1788639179.445764:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788639179.445770:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875523773036672:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788639179.445777:0:6517:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788639179.445804:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875523773036672:12345-0@lo:400:kworker.0 Request processed in 33us (93us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788639179.445810:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00080000:1.0:1788639179.445842:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788639179.445848:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ae3438e8000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788639179.445852:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1788639179.447086:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875523773036544:0@lo:400:kworker.0 00000100:00100000:0.0:1788639179.447163:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639179.447230:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875523773037056:0@lo:400:kworker.0 00000100:00100000:0.0:1788639179.447252:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639179.447282:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788639179.447289:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01f1eef9-e690-4065-bf99-bf821af7b626:3644:1875523773036288:0@lo:400:kworker.0 00000100:00100000:0.0:1788639179.447318:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639179.447339:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773036928:0@lo:400:kworker.0 00000100:00100000:0.0:1788639179.447363:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639179.447393:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773036416:0@lo:38:kworker.0 00000100:00100000:0.0:1788639179.447419:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639179.447469:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773037312 00000100:00100000:0.0:1788639179.447476:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773037312 00000100:00100000:0.0:1788639179.447531:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773036928 00000100:00100000:0.0:1788639179.447535:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773036928 00000100:00100000:0.0:1788639179.447577:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788639179.447587:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523773037312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639179.447691:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773036544 00000100:00100000:2.0:1788639179.447706:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773036544 00000100:00100000:2.0:1788639179.447753:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773037056 00000100:00100000:2.0:1788639179.447757:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773037056 00000100:00100000:2.0:1788639179.447778:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788639179.447786:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1875523773036544:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788639179.447795:0:6516:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788639179.447874:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1875523773036544:12345-0@lo:400:kworker.0 Request processed in 88us (710us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788639179.447881:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788639179.447897:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788639179.447901:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1875523773037056:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788639179.447905:0:6516:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788639179.447928:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1875523773037056:12345-0@lo:400:kworker.0 Request processed in 25us (674us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788639179.447950:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788639179.448537:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788639179.448549:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773036928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639179.448602:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773036928:12345-0@lo:400:kworker.0 Request processed in 58us (1239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639179.448608:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788639179.448664:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242f09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773037440:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788639179.448699:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639179.448739:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773037440 00000100:00100000:3.0:1788639179.448744:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773037440 00000100:00100000:3.0:1788639179.448773:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788639179.448779:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875523773037440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788639179.448798:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788639179.448832:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875523773037440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639179.448838:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788639179.448877:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242f09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773037440:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788639179.448936:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523773037312:12345-0@lo:400:kworker.0 Request processed in 1344us (3334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639179.448948:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773036288 00000100:00100000:0.0:1788639179.448952:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788639179.448957:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773036288 00000100:00100000:0.0:1788639179.449004:0:12414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773036416 00000100:00100000:0.0:1788639179.449013:0:12414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773036416 00000100:00100000:0.0:1788639179.449045:0:12414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788639179.449051:0:12414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875523773036416:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1788639179.449069:0:12414:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:2.0:1788639179.451739:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788639179.451748:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9ae36d25f800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788639179.451752:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788639179.451759:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9ae36d25f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788639179.451763:0:3644:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 208 00000100:00080000:2.0:1788639179.451772:0:3644:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9ae36d25f800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788639179.451814:0:3644:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae375f38000 x1875523773037568/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788639179.451850:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875523773036544:0@lo:400:kworker.0 00000100:00080000:2.0:1788639179.451867:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788639179.451870:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9ae242df6000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788639179.451874:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788639179.451882:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9ae242df6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788639179.451885:0:3644:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 253 00000100:00080000:2.0:1788639179.451889:0:3644:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ae242df6000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788639179.451902:0:3644:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae375f3b480 x1875523773037696/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788639179.451912:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875523773037056:0@lo:400:kworker.0 00000100:00100000:2.0:1788639179.451955:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773036928:0@lo:400:kworker.0 00000100:00080000:2.0:1788639179.452027:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788639179.452034:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788639179.452080:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875523773037568:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788639179.452148:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639179.452174:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875523773037696:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788639179.452195:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639179.452227:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773037568 00000100:00100000:2.0:1788639179.452233:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773037568 00000100:00100000:2.0:1788639179.452259:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773037696 00000100:00100000:2.0:1788639179.452262:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773037696 00000100:00100000:2.0:1788639179.452276:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788639179.452283:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875523773037568:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1788639179.452298:0:6518:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788639179.452334:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875523773037568:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 50us (185us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788639179.452341:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788639179.452357:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788639179.452361:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244036680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875523773037696:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1788639179.452367:0:6518:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788639179.452388:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244036680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875523773037696:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 26us (192us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788639179.452393:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:2.0:1788639179.452418:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae36d25f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788639179.452421:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788639179.452424:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875523773037568:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:2.0:1788639179.452432:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae242df6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788639179.452435:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788639179.452437:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875523773037696:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788639179.453395:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1788639179.453412:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37b67f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+19:3644:x1875523773036288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639179.453472:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37b67f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01f1eef9-e690-4065-bf99-bf821af7b626+19:3644:x1875523773036288:12345-0@lo:400:kworker.0 Request processed in 69us (6153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639179.453478:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1788639179.453526:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01f1eef9-e690-4065-bf99-bf821af7b626:3644:1875523773036288:0@lo:400:kworker.0 00000100:00080000:1.0:1788639179.459816:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9ae3438e8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788639179.459830:0:3642:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 232 00000100:00080000:1.0:1788639179.459843:0:3642:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ae3438e8000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:1.0:1788639179.459901:0:3642:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae243b14380 x1875523773037824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788639179.459993:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244124380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875523773036672:0@lo:400:kworker.0 00000100:00100000:1.0:1788639179.460014:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244125c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875523773037184:0@lo:400:kworker.0 00000100:00100000:1.0:1788639179.460182:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639179.460271:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523773037312:0@lo:400:kworker.0 00000100:00100000:2.0:1788639179.460460:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875523773037824:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1788639179.460493:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639179.460875:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773037184 00000100:00100000:3.0:1788639179.460884:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773037184 00000100:00100000:3.0:1788639179.461130:0:11314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773037824 00000100:00100000:3.0:1788639179.461135:0:11314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773037824 00000100:00100000:3.0:1788639179.461161:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1788639179.461172:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875523773037184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639179.461242:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875523773037184:12345-0@lo:400:kworker.0 Request processed in 72us (1059us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639179.461249:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1788639179.461267:0:11314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788639179.461271:0:11314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1875523773037824:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1788639179.461288:0:11314:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788639179.461324:0:11314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1875523773037824:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 50us (829us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788639179.461330:0:11314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:3.0:1788639179.461373:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae3438e8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788639179.461379:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788639179.461384:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875523773037824:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:2.0:1788639179.461484:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788639179.461687:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae244125c00 x1875523773037184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639179.461701:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244125c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875523773037184:0@lo:400:kworker.0 00000100:00100000:0.0:1788639179.474544:0:12414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875523773036416:12345-0@lo:38:kworker.0 Request processed in 25358us (26989us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788639179.474563:0:12414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00080000:3.0:1788639179.475188:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae36ddec000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788639179.475201:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788639179.475207:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773036416:0@lo:38:kworker.0 00010000:00010000:0.0:1788639180.212970:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788639180.788774:0:15253:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ae343eb5720 - data ffff9ae378b335e8/ffff9ae24317b000 00000020:01000000:1.0:1788639180.788929:0:15253:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ae35058dc00 - data ffff9ae3789446c0/ffff9ae374fdcc00 00000001:00000004:1.0:1788639180.794520:0:15253:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000100:00080000:2.0:1788639180.860796:0:15253:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788639180.860808:0:15253:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1788639180.860828:0:15253:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9ae375f39880 x1875523773035520/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788639184 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639180.860864:0:15253:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788639180.865338:0:15253:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788639180.865352:0:15253:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:2.0:1788639180.865425:0:15253:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788639180.865429:0:15253:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788639180.869550:0:8827:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788639180.869563:0:8827:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1788639180.869581:0:8827:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788639180.872392:0:15253:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788639180.872402:0:15253:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:2.0:1788639180.872454:0:15253:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788639180.872457:0:15253:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788639180.879983:0:9838:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788639180.880004:0:9838:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:3.0:1788639180.880022:0:9838:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1788639180.882428:0:15253:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262bcb8 00000020:00000080:0.0:1788639180.882444:0:15253:0:(genops.c:885:class_export_put()) final put ffff9ae3691c2000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788639180.884145:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae3691c2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788639180.894515:0:15253:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262bccd 00000020:00000080:0.0:1788639180.894535:0:15253:0:(genops.c:885:class_export_put()) final put ffff9ae3691c5800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788639180.894558:0:15253:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788639180.894564:0:15253:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788639180.894575:0:15253:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788639180.894580:0:15253:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9ae342e519c0) has no exports 00000004:01000000:0.0:1788639180.895301:0:15253:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788639180.895315:0:15253:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262c103 00000020:00000080:0.0:1788639180.895322:0:15253:0:(genops.c:885:class_export_put()) final put ffff9ae241e9a000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788639180.895326:0:15253:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788639180.895331:0:15253:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788639180.895356:0:15253:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788639180.895359:0:15253:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff9ae37f7199c0) has no exports 00000020:00000080:0.0:1788639180.895368:0:15253:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262c0fc 00000020:00000080:0.0:1788639180.895373:0:15253:0:(genops.c:885:class_export_put()) final put ffff9ae2431e0800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788639180.896268:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae3691c5800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1788639180.896284:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae241e9a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788639180.896289:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae2431e0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788639180.897476:0:15253:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788639180.897484:0:15253:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788639180.897490:0:15253:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:0.0:1788639180.897499:0:15253:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788639180.897502:0:15253:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788639180.897576:0:15253:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788639180.897595:0:15253:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788639180.897605:0:15253:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262bfc1 00000020:00000080:0.0:1788639180.897829:0:15253:0:(genops.c:885:class_export_put()) final put ffff9ae37f756000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788639180.897836:0:15253:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788639180.897845:0:15253:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788639180.897852:0:15253:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788639180.897857:0:15253:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9ae37f71cd40) has no exports 00000020:00000080:0.0:1788639180.897866:0:15253:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262bfba 00000020:00000080:0.0:1788639180.897870:0:15253:0:(genops.c:885:class_export_put()) final put ffff9ae375c2c000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788639180.898832:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae2431e2000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788639180.898845:0:38:0:(genops.c:885:class_export_put()) final put ffff9ae2431ad000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788639180.898849:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae2431ad000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788639180.898856:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788639180.898983:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae37f756000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788639180.898988:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae375c2c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788639180.899140:0:15253:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788639180.899146:0:15253:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788639180.899149:0:15253:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:0.0:1788639180.899157:0:15253:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788639180.899159:0:15253:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788639180.899288:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae375c2b800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788639180.899328:0:15253:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788639180.899339:0:15253:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788639180.899343:0:15253:0:(genops.c:885:class_export_put()) final put ffff9ae375c2f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788639180.899345:0:15253:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae375c2f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788639180.899357:0:15253:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1788639180.899434:0:15253:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1788639180.899443:0:15253:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262be71 00000020:00000080:0.0:1788639180.899448:0:15253:0:(genops.c:885:class_export_put()) final put ffff9ae375d48000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788639180.899471:0:15253:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1788639180.899475:0:15253:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788639180.899482:0:15253:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788639180.899486:0:15253:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9ae375c5b380) has no exports 00000020:00000080:0.0:1788639180.899492:0:15253:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262be6a 00000020:00000080:0.0:1788639180.899497:0:15253:0:(genops.c:885:class_export_put()) final put ffff9ae375d4f800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788639180.899996:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae375d48000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788639180.900008:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae375d4f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788639180.901831:0:15253:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1788639180.901841:0:15253:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788639180.901846:0:15253:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1788639180.901858:0:15253:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788639180.901931:0:15253:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788639180.901944:0:15253:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788639180.901978:0:15253:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788639180.901982:0:15253:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788639180.901988:0:15253:0:(genops.c:885:class_export_put()) final put ffff9ae3506f2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788639180.901992:0:15253:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae3506f2000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788639180.901999:0:15253:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788639180.902136:0:15253:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262bcd4 00000020:00000080:2.0:1788639180.902145:0:15253:0:(genops.c:885:class_export_put()) final put ffff9ae3691c7800/lustre-MDD0000_UUID 00000020:01000000:2.0:1788639180.902150:0:15253:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788639180.902154:0:15253:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788639180.902159:0:15253:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788639180.902164:0:15253:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9ae3691c99c0) has no exports 00000020:00000080:2.0:1788639180.902184:0:15253:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788639180.902188:0:15253:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788639180.902192:0:15253:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262bcdb 00000020:00000080:2.0:1788639180.902197:0:15253:0:(genops.c:885:class_export_put()) final put ffff9ae3691c1800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788639180.902219:0:15253:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ae3461e3800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788639180.902223:0:15253:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ae3461e3800 3 00000020:01000004:2.0:1788639180.902226:0:15253:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ae3461e3800 from lustre-MDT0000 00000020:00000080:2.0:1788639180.902246:0:15253:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788639180.902249:0:15253:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788639180.902252:0:15253:0:(genops.c:885:class_export_put()) final put ffff9ae3691c0800/lustre-MDT0000_UUID 00000020:00000080:2.0:1788639180.902254:0:15253:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae3691c0800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788639180.902261:0:15253:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788639180.902307:0:15253:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1788639180.902312:0:15253:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788639180.902315:0:15253:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788639180.902318:0:15253:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788639180.902321:0:15253:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788639180.902329:0:15253:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9ae34b10c000 01f1eef9-e690-4065-bf99-bf821af7b626 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788639180.902334:0:15253:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9ae342e54d40) has exports, disconnecting them 00000020:00080000:2.0:1788639180.902339:0:15253:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9ae34b10c000), last request at 1788638930 00000020:00000080:2.0:1788639180.902359:0:15253:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262bc79 00000020:00010000:2.0:1788639180.902363:0:15253:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ae34b10c000: total 2 00000100:00080000:2.0:1788639180.902368:0:15253:0:(import.c:65:import_set_state_nolock()) ffff9ae34b10e800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788639180.902379:0:15253:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ae34b10c000): rc 0 00000020:00080000:2.0:1788639180.902384:0:15253:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9ae342e54d40) has no exports 00000100:00100000:2.0:1788639180.902449:0:6510:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9ae34436f600:6510] 1 exiting: rc = 0 00000020:00010000:3.0:1788639180.902788:0:8446:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ae34b10c000: total 2 00010000:00010000:3.0:1788639180.902794:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639180.902849:0:8446:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ae34b10c000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788639180.902887:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae375f54a00/0x25c454990262c1ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c454990262c1e3 expref: 14 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639180.902915:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae3429e5e00/0x25c454990262c17a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c454990262c173 expref: 13 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639180.902928:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae3750fa400/0x25c454990262c428 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c454990262c421 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639180.902938:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae3429e4e00/0x25c454990262c188 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c454990262c181 expref: 11 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639180.902950:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae340031800/0x25c454990262c436 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c454990262c42f expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639180.902961:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae375f54000/0x25c454990262c09a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c454990262c093 expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639180.902974:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae242f22a00/0x25c454990262c196 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c454990262c18f expref: 8 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639180.902983:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae375f55c00/0x25c454990262c1a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c454990262c19d expref: 7 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639180.902994:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae242f23a00/0x25c454990262c1c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c454990262c1b9 expref: 6 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639180.903005:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae3429e4c00/0x25c454990262bd75 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c454990262bd6e expref: 5 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639180.903016:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae242f22000/0x25c454990262c1b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c454990262c1ab expref: 4 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639180.903040:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae38217ba00/0x25c454990262c41a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c454990262c413 expref: 3 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639180.903054:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae3429e5c00/0x25c454990262bd83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x25c454990262bd7c expref: 2 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639180.903064:0:8446:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ae34b10c000, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1788639180.903080:0:8446:0:(genops.c:885:class_export_put()) final put ffff9ae34b10c000/01f1eef9-e690-4065-bf99-bf821af7b626 00010000:00010000:3.0:1788639180.903086:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639180.903088:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639180.903090:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639180.903148:0:6508:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9ae36a0f1e00:6508] 0 exiting: rc = 1 00000020:00000080:3.0:1788639180.903223:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae375d4d800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788639180.903230:0:38:0:(genops.c:885:class_export_put()) final put ffff9ae375d4c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788639180.903233:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae375d4c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1788639180.903239:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788639180.903292:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae3691c7800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788639180.903296:0:38:0:(genops.c:885:class_export_put()) final put ffff9ae3691c6000/lustre-MDD0000_UUID 00000020:00000080:3.0:1788639180.903299:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae3691c6000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788639180.903305:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1788639180.903351:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae3691c1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788639180.903356:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae34b10c000/01f1eef9-e690-4065-bf99-bf821af7b626 for MGS 00000020:00000080:3.0:1788639180.903785:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae34b10e800 for MGS 00000100:00100000:2.0:1788639180.904842:0:6511:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9ae36a0f1400:6511] 2 exiting: rc = 0 00000100:00100000:3.0:1788639180.905182:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905193:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905199:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905205:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905279:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905303:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905309:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905315:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905322:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905329:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905337:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905343:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905348:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905360:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905367:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905374:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905381:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905388:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905395:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905402:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905409:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905415:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905423:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905430:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905438:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905445:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905452:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905459:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905465:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905471:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905477:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905482:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905488:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905494:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905499:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905506:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905512:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905518:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905523:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905528:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905863:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905868:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905874:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905879:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905901:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905910:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905918:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905923:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905928:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905934:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905939:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905944:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905949:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905955:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905959:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905965:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905970:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905976:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905981:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905987:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905992:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.905998:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.906004:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639180.906009:0:15253:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1788639180.907521:0:15253:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ae242e08780 - data ffff9ae378a69d80/ffff9ae243043400 00000020:01000000:3.0:1788639180.907804:0:15253:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ae3609ac6c0 - data ffff9ae378833360/ffff9ae350fca000 00000020:00000080:3.0:1788639180.908437:0:15253:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262bc5d 00000020:00000080:3.0:1788639180.908449:0:15253:0:(genops.c:885:class_export_put()) final put ffff9ae343038800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788639180.908506:0:15253:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ae3461e3800 from MGS, refs=2 00000020:01000004:3.0:1788639180.908510:0:15253:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ae3461e3800 2 00000020:01000004:3.0:1788639180.908514:0:15253:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ae3461e3800 from MGS 00000020:00000080:3.0:1788639180.908537:0:15253:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788639180.908545:0:15253:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788639180.908548:0:15253:0:(genops.c:885:class_export_put()) final put ffff9ae343039800/MGS 00000020:00000080:3.0:1788639180.908564:0:15253:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae343039800/MGS for MGS 00000020:01000000:3.0:1788639180.908571:0:15253:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788639180.908670:0:15253:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788639180.908675:0:15253:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788639180.908682:0:15253:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788639180.908751:0:15253:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9ae36d08f000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788639180.908758:0:15253:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9ae36d180000) has exports, disconnecting them 00000020:00080000:3.0:1788639180.908763:0:15253:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9ae36d08f000), last request at 1788638930 00000020:00000080:3.0:1788639180.908767:0:15253:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262bd28 00000020:00080000:3.0:1788639180.908777:0:15253:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ae36d08f000): rc 0 00000020:00000080:3.0:1788639180.908782:0:15253:0:(genops.c:885:class_export_put()) final put ffff9ae36d08f000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788639180.909106:0:13809:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae343038800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788639180.910389:0:13809:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae36d08f000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788639180.910659:0:15253:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788639180.910665:0:15253:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788639180.910670:0:15253:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788639180.910676:0:15253:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788639180.910711:0:13809:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae36d18b000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788639180.911188:0:15253:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788639180.911199:0:15253:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788639180.911206:0:15253:0:(genops.c:885:class_export_put()) final put ffff9ae369173800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788639180.911219:0:15253:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae369173800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788639180.911227:0:15253:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788639180.911350:0:15253:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ae3461e3800 1 00000020:00000080:2.0:1788639180.911366:0:15253:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262bc4f 00000020:00000080:2.0:1788639180.911386:0:15253:0:(genops.c:885:class_export_put()) final put ffff9ae34303c000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788639180.911398:0:15253:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788639180.911409:0:13809:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae34303c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788639180.911420:0:15253:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788639180.911425:0:15253:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788639180.911430:0:15253:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9ae36a0ecd40) has no exports 00000020:00000080:2.0:1788639181.108600:0:15253:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788639181.108782:0:15253:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788639181.108789:0:15253:0:(genops.c:885:class_export_put()) final put ffff9ae37b648800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788639181.108796:0:15253:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae37b648800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788639181.108803:0:15253:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788639181.108989:0:15253:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ae3461e0800 00000020:02000400:2.0:1788639181.109080:0:15253:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788639181.236760:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639182.004733:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773037952:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788639182.004795:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639182.004871:0:13805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773037952 00000100:00100000:2.0:1788639182.004879:0:13805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773037952 00000100:00100000:2.0:1788639182.004927:0:13805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788639182.004935:0:13805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773037952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788639182.004970:0:13805:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788639182.005007:0:13805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773037952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639182.005013:0:13805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:2.0:1788639182.005041:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788639182.005073:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773037952:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788639182.260916:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639183.285598:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788639183.925605:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:2.0:1788639184.211352:0:15454:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788639184.223868:0:15454:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1788639184.223917:0:15454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae375f55400/0x25c454990262c1ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c1b2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639184.223932:0:15454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae375f55400/0x25c454990262c1ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262c1b2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639184.223940:0:15454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae375f55400/0x25c454990262c1ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262c1b2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639184.223947:0:15454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9ae375f55400/0x25c454990262c1ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262c1b2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639184.224007:0:15454:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788639184.224013:0:15454:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788639184.224039:0:15454:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788639184.224043:0:15454:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788639184.224049:0:15454:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788639184.224054:0:15454:0:(import.c:65:import_set_state_nolock()) ffff9ae36d25f800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788639184.224075:0:15454:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788639184.224077:0:15454:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788639184.224080:0:15454:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788639184.225208:0:15454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae375f54400/0x25c454990262c1b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c1c0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639184.225224:0:15454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae375f54400/0x25c454990262c1b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262c1c0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639184.225231:0:15454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae375f54400/0x25c454990262c1b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262c1c0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639184.225239:0:15454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9ae375f54400/0x25c454990262c1b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262c1c0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639184.226177:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788639184.226188:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae375f55400/0x25c454990262c1ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262c1b2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639184.226197:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375f55400 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:0.0:1788639184.226201:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae375f55400/0x25c454990262c1ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262c1b2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639184.226210:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae375f55400/0x25c454990262c1ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c454990262c1b2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788639184.226217:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae375f55400/0x25c454990262c1ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c454990262c1b2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639184.226222:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788639184.226225:0:6503:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788639184.226228:0:6503:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788639184.226271:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae375f55400/0x25c454990262c1ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262c1b2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639184.226278:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788639184.226308:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae375f55400/0x25c454990262c1ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262c1b2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639184.226332:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae375f55400/0x25c454990262c1ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262c1b2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639184.226347:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639184.226350:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae375f54400/0x25c454990262c1b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262c1c0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639184.226356:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375f54400 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:0.0:1788639184.226359:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae375f54400/0x25c454990262c1b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262c1c0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639184.226365:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae375f54400/0x25c454990262c1b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c454990262c1c0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788639184.226371:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae375f54400/0x25c454990262c1b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c454990262c1c0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639184.226375:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788639184.226377:0:6503:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:0.0:1788639184.226391:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae375f54400/0x25c454990262c1b9 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262c1c0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639184.226396:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788639184.226403:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae375f54400/0x25c454990262c1b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262c1c0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639184.226409:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639184.226411:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639184.226413:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639184.226443:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523773038080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788639184.226508:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639184.226561:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788639184.226567:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523773038208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788639184.226589:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639184.226653:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773038080 00000100:00100000:0.0:1788639184.226660:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773038080 00000100:00100000:0.0:1788639184.226691:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773038208 00000100:00100000:0.0:1788639184.226694:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773038208 00000100:00100000:0.0:1788639184.226705:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788639184.226711:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3641:x1875523773038080:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788639184.226717:0:6502:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788639184 with bad export cookie 2721393090985376889 00010000:00010000:1.0:1788639184.231302:0:15454:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788639184.231317:0:15454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae375f54400/0x25c454990262c1b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262c1c0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639184.231341:0:15454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5000/0x25c454990262c093 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c09a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639184.231349:0:15454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5000/0x25c454990262c093 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262c09a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639184.231356:0:15454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5000/0x25c454990262c093 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262c09a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639184.231362:0:15454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5000/0x25c454990262c093 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262c09a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639184.231404:0:15454:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788639184.231411:0:15454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae38217a800/0x25c454990262c42f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c436 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639184.231418:0:15454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae38217a800/0x25c454990262c42f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262c436 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639184.231424:0:15454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae38217a800/0x25c454990262c42f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262c436 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639184.231430:0:15454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9ae38217a800/0x25c454990262c42f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262c436 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639184.231442:0:15454:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788639184.231448:0:15454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae341480200/0x25c454990262bd7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262bd83 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639184.231454:0:15454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae341480200/0x25c454990262bd7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262bd83 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639184.231460:0:15454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae341480200/0x25c454990262bd7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262bd83 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639184.231465:0:15454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9ae341480200/0x25c454990262bd7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262bd83 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639184.231476:0:15454:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:1.0:1788639184.231481:0:15454:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:1.0:1788639184.231491:0:15454:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:1.0:1788639184.231529:0:15454:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1788639184.231533:0:15454:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:1.0:1788639184.231537:0:15454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788639184.231543:0:15454:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1788639184.231549:0:15454:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9ae242399000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788639184.231555:0:15454:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9ae241e9d800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788639184.231560:0:15454:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9ae36d183380) has exports, disconnecting them 00000020:00080000:1.0:1788639184.231565:0:15454:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9ae242399000), last request at 1788639179 00000020:00000080:1.0:1788639184.231570:0:15454:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262c05b 00000100:00080000:1.0:1788639184.231587:0:15454:0:(import.c:65:import_set_state_nolock()) ffff9ae24239a800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788639184.231649:0:15454:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ae242399000): rc 0 00000020:00000080:1.0:1788639184.231652:0:15454:0:(genops.c:885:class_export_put()) final put ffff9ae242399000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1788639184.231660:0:15454:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9ae241e9d800), last request at 1788639179 00000020:00000080:1.0:1788639184.231663:0:15454:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262bf35 00000100:00080000:1.0:1788639184.231668:0:15454:0:(import.c:65:import_set_state_nolock()) ffff9ae241e9f000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788639184.231674:0:15454:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ae241e9d800): rc 0 00000020:00000080:1.0:1788639184.231676:0:15454:0:(genops.c:885:class_export_put()) final put ffff9ae241e9d800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1788639184.231682:0:15454:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffaea580c97ae0 00000100:00080000:1.0:1788639184.231699:0:15454:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788639184.231708:0:15454:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9ae242f08700 x1875523773035904/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788639190 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639184.231724:0:15454:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00010000:00010000:3.0:1788639184.231728:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788639184.231735:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5000/0x25c454990262c093 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262c09a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639184.231742:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3429e5000 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:3.0:1788639184.231746:0:8446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5000/0x25c454990262c093 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262c09a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639184.231753:0:8446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5000/0x25c454990262c093 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c454990262c09a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788639184.231760:0:8446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5000/0x25c454990262c093 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c454990262c09a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639184.231766:0:8446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788639184.231768:0:8446:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788639184.231771:0:8446:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788639184.231804:0:8446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5000/0x25c454990262c093 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262c09a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639184.231821:0:8446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788639184.231844:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5000/0x25c454990262c093 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262c09a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639184.231851:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae3429e5000/0x25c454990262c093 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262c09a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639184.231865:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788639184.231868:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae38217a800/0x25c454990262c42f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262c436 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639184.231874:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae38217a800 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:3.0:1788639184.231877:0:8446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae38217a800/0x25c454990262c42f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262c436 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639184.231883:0:8446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae38217a800/0x25c454990262c42f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c454990262c436 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788639184.231889:0:8446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae38217a800/0x25c454990262c42f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c454990262c436 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639184.231895:0:8446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788639184.231897:0:8446:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788639184.231899:0:8446:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788639184.231910:0:8446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae38217a800/0x25c454990262c42f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262c436 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639184.231915:0:8446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788639184.231920:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae38217a800/0x25c454990262c42f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262c436 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639184.231937:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae38217a800/0x25c454990262c42f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262c436 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639184.231946:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788639184.231949:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae341480200/0x25c454990262bd7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262bd83 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639184.231955:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae341480200 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:3.0:1788639184.231958:0:8446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae341480200/0x25c454990262bd7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262bd83 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639184.231964:0:8446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae341480200/0x25c454990262bd7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c454990262bd83 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788639184.231971:0:8446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae341480200/0x25c454990262bd7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c454990262bd83 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639184.231977:0:8446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788639184.231979:0:8446:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788639184.231980:0:8446:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788639184.231991:0:8446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae341480200/0x25c454990262bd7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262bd83 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639184.231996:0:8446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788639184.232007:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae341480200/0x25c454990262bd7c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262bd83 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639184.232013:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae341480200/0x25c454990262bd7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x25c454990262bd83 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639184.232034:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639184.232036:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639184.232038:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788639184.232045:0:13809:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae242399000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1788639184.232085:0:13809:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae241e9d800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1788639184.232114:0:13809:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae24239a800 for lustre-MDT0001 00000020:00000080:3.0:1788639184.232138:0:13809:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae241e9f000 for lustre-MDT0001 00000100:00100000:3.0:1788639184.232155:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242f09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523773038336:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788639184.232225:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639184.232258:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788639184.232264:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242f09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523773038464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788639184.232282:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639184.232306:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242f0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523773038592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788639184.232324:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788639184.232484:0:15454:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788639184.232489:0:15454:0:(import.c:65:import_set_state_nolock()) ffff9ae36ddec000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788639184.233180:0:15454:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788639184.233184:0:15454:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:1.0:1788639184.233203:0:15454:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788639184.233271:0:15454:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788639184.233288:0:15454:0:(import.c:65:import_set_state_nolock()) ffff9ae375c2c800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788639184.233300:0:15454:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788639184.233303:0:15454:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:1.0:1788639184.233311:0:15454:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788639184.233369:0:15454:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788639184.233377:0:15454:0:(import.c:65:import_set_state_nolock()) ffff9ae2431af000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788639184.233400:0:15454:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9ae36d183380) has no exports 00000100:00100000:3.0:1788639184.233462:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244125c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773038720:0@lo:9:umount.0 00000100:00100000:3.0:1788639184.233506:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639184.233529:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773038848:0@lo:9:umount.0 00000100:00100000:3.0:1788639184.233549:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639184.233600:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773038720 00000100:00100000:3.0:1788639184.233607:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773038720 00000100:00100000:3.0:1788639184.233673:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773038848 00000100:00100000:3.0:1788639184.233677:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773038848 00000100:00100000:3.0:1788639184.233701:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788639184.233711:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875523773038720:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788639184.233732:0:8431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262bf82 00000100:00080000:3.0:1788639184.233747:0:8431:0:(import.c:65:import_set_state_nolock()) ffff9ae375f8a000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788639184.233784:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1788639184.233908:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3640:x1875523773038720:12345-0@lo:9:umount.0 Request processed in 199us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639184.233916:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788639184.233931:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788639184.233937:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875523773038848:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788639184.233948:0:8431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262c0c4 00000100:00080000:3.0:1788639184.233954:0:8431:0:(import.c:65:import_set_state_nolock()) ffff9ae2431a8000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788639184.233970:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1788639184.234042:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3640:x1875523773038848:12345-0@lo:9:umount.0 Request processed in 102us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639184.234047:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1788639184.234064:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788639184.234068:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788639184.234079:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788639184.236429:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae375c2c800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788639184.236495:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788639184.236569:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788639184.236575:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244125c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773038720:0@lo:9:umount.0 00000100:00080000:3.0:1788639184.236601:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae2431af000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788639184.236632:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788639184.236634:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788639184.236637:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773038848:0@lo:9:umount.0 00010000:00010000:1.0:1788639184.237751:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639184.237759:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639184.237774:0:6501:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788639184.237787:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1788639184.237808:0:6500:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788639184.237819:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773038336 00000100:00100000:1.0:1788639184.237826:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773038336 00000100:00100000:1.0:1788639184.237854:0:6500:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788639184.237860:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773038464 00000100:00100000:1.0:1788639184.237862:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773038464 00000100:00100000:1.0:1788639184.237872:0:6500:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788639184.237875:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773038592 00000100:00100000:1.0:1788639184.237877:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773038592 00000100:00100000:2.0:1788639184.238257:0:15455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788639184.238266:0:15455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3641:x1875523773038208:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788639184.238287:0:15455:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788639184 with bad export cookie 2721393090985376889 00000100:00100000:2.0:1788639184.238375:0:15455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3641:x1875523773038208:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (11784us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788639184.238382:0:15455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788639184.238400:0:15455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788639184.238404:0:15455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3643:x1875523773038336:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788639184.238408:0:15455:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788639184 with bad export cookie 2721393090985376889 00000100:00100000:2.0:1788639184.238450:0:15455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3643:x1875523773038336:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (6225us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788639184.238456:0:15455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788639184.238469:0:15455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788639184.238474:0:15455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3643:x1875523773038464:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788639184.238477:0:15455:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788639184 with bad export cookie 2721393090985376889 00000100:00100000:2.0:1788639184.238502:0:15455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3643:x1875523773038464:12345-0@lo:103:ldlm_bl.0 Request processed in 27us (6219us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788639184.238508:0:15455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788639184.238519:0:15455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788639184.238523:0:15455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3641:x1875523773038592:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788639184.238526:0:15455:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788639184 with bad export cookie 2721393090985376889 00000100:00080000:3.0:1788639184.238527:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.118@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788639184.238532:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9ae367fce000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788639184.238535:0:3641:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:2.0:1788639184.238548:0:15455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3641:x1875523773038592:12345-0@lo:103:ldlm_bl.0 Request processed in 25us (6224us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788639184.238553:0:15455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1788639184.238644:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.118@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00010000:2.0:1788639184.238755:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639184.238761:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639184.243382:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242f08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523773035904:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788639184.245248:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3641:x1875523773038080:12345-0@lo:103:ldlm_bl.0 Request processed in 18531us (18736us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788639184.245261:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788639184.268787:0:3641:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.118@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788639184.268810:0:3641:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788639184.268820:0:3641:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ae2438cd880 x1875523773038080/t0(0) o103->MGC192.168.206.118@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788639200 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639184.268833:0:3641:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ae2438cdc00 x1875523773038208/t0(0) o103->MGC192.168.206.118@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788639200 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639184.268842:0:3641:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ae242f09880 x1875523773038336/t0(0) o103->MGC192.168.206.118@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788639200 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639184.268851:0:3641:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ae242f09500 x1875523773038464/t0(0) o103->MGC192.168.206.118@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788639200 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639184.268860:0:3641:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ae242f0aa00 x1875523773038592/t0(0) o103->MGC192.168.206.118@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788639200 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788639184.268876:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788639184.268880:0:3641:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788639184.268881:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788639184.268887:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9ae367fce000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788639184.268892:0:3641:0:(import.c:545:import_select_connection()) MGC192.168.206.118@tcp: connect to NID 0@lo last attempt 189 00000100:00080000:3.0:1788639184.268901:0:3641:0:(import.c:665:import_select_connection()) MGC192.168.206.118@tcp: import ffff9ae367fce000 using connection 192.168.206.118@tcp/0@lo 00000100:00080000:1.0:1788639184.268915:0:3643:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9ae367fce000 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:2.0:1788639184.269085:0:3641:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae375f39880 x1875523773038976/t0(0) o250->MGC192.168.206.118@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788639184.269155:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523773038080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788639184.269179:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:01f1eef9-e690-4065-bf99-bf821af7b626:3640:1875523773038976:0@lo:250:ptlrpcd_00_00.0 00000100:00100000:2.0:1788639184.269187:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242f0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523773038592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788639184.269192:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01f1eef9-e690-4065-bf99-bf821af7b626:3641:1875523773038208:0@lo:103:ldlm_bl.0 00000400:00000100:1.0:1788639184.269223:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875523773038976 offset 0 length 520: 4 00000100:00100000:0.0:1788639184.270222:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242f09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523773038336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788639184.270241:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242f09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01f1eef9-e690-4065-bf99-bf821af7b626:3643:1875523773038464:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1788639184.275012:0:15454:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9ae36d183380) has no exports 00010000:00010000:3.0:1788639184.311074:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788639184.328451:0:15454:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ae343eb56c0 - data ffff9ae378b26d80/ffff9ae243178800 00000020:01000000:0.0:1788639184.328608:0:15454:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ae370febf60 - data ffff9ae3789b3a20/ffff9ae375e90800 00000001:00000004:0.0:1788639184.336502:0:15454:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:0.0:1788639184.394153:0:15454:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788639184.394162:0:15454:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1788639184.394169:0:15454:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788639184.397007:0:15454:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788639184.397015:0:15454:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:0.0:1788639184.397053:0:15454:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788639184.397056:0:15454:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788639184.405032:0:8822:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788639184.405040:0:8822:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:2.0:1788639184.405065:0:8822:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1788639184.405818:0:15454:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788639184.405824:0:15454:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:0.0:1788639184.405945:0:15454:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788639184.405949:0:15454:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788639184.412799:0:9834:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788639184.412809:0:9834:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:2.0:1788639184.412842:0:9834:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1788639184.415037:0:15454:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262bd9f 00000020:00000080:0.0:1788639184.415049:0:15454:0:(genops.c:885:class_export_put()) final put ffff9ae375138000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788639184.416246:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae375138000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788639184.417155:0:15454:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262bdb4 00000020:00000080:0.0:1788639184.417165:0:15454:0:(genops.c:885:class_export_put()) final put ffff9ae37513b000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788639184.417180:0:15454:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1788639184.417185:0:15454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788639184.417193:0:15454:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788639184.417197:0:15454:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9ae36d1819c0) has no exports 00000020:00000080:3.0:1788639184.417210:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae37513b000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:0.0:1788639184.417383:0:15454:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788639184.417394:0:15454:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262c0bd 00000020:00000080:0.0:1788639184.417398:0:15454:0:(genops.c:885:class_export_put()) final put ffff9ae2431ab800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788639184.417414:0:15454:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:0.0:1788639184.417418:0:15454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788639184.417427:0:15454:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788639184.417430:0:15454:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff9ae37f718000) has no exports 00000020:00000080:0.0:1788639184.417437:0:15454:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262c0b6 00000020:00000080:0.0:1788639184.417441:0:15454:0:(genops.c:885:class_export_put()) final put ffff9ae2431ad800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788639184.417463:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae2431ab800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788639184.417476:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae2431ad800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788639184.418254:0:15454:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1788639184.418259:0:15454:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788639184.418264:0:15454:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:0.0:1788639184.418270:0:15454:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788639184.418273:0:15454:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788639184.418324:0:15454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788639184.418334:0:15454:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788639184.418341:0:15454:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262bf7b 00000020:00000080:0.0:1788639184.418349:0:15454:0:(genops.c:885:class_export_put()) final put ffff9ae375d4b000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788639184.418353:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae2431af000 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788639184.418362:0:38:0:(genops.c:885:class_export_put()) final put ffff9ae36ddef000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788639184.418364:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae36ddef000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1788639184.418369:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788639184.418415:0:15454:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1788639184.418429:0:15454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788639184.418434:0:15454:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788639184.418438:0:15454:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9ae375c58000) has no exports 00000020:00000080:0.0:1788639184.418444:0:15454:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262bf74 00000020:00000080:0.0:1788639184.418448:0:15454:0:(genops.c:885:class_export_put()) final put ffff9ae375c2a800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788639184.419594:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae375d4b000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788639184.421690:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae375c2a800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788639184.422291:0:15454:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1788639184.422296:0:15454:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788639184.422300:0:15454:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:0.0:1788639184.422307:0:15454:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788639184.422309:0:15454:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788639184.422363:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae375c2c800 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1788639184.422367:0:15454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788639184.422379:0:15454:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788639184.422384:0:15454:0:(genops.c:885:class_export_put()) final put ffff9ae375c2b000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788639184.422387:0:15454:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae375c2b000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1788639184.422393:0:15454:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1788639184.422488:0:15454:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1788639184.422498:0:15454:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262bdd7 00000020:00000080:0.0:1788639184.422504:0:15454:0:(genops.c:885:class_export_put()) final put ffff9ae36d232000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788639184.422520:0:15454:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1788639184.422524:0:15454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788639184.422529:0:15454:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788639184.422532:0:15454:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9ae3691cb380) has no exports 00000020:00000080:0.0:1788639184.422537:0:15454:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262bdd0 00000020:00000080:0.0:1788639184.422540:0:15454:0:(genops.c:885:class_export_put()) final put ffff9ae36ddeb800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788639184.423102:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae36d232000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788639184.423112:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae36ddeb800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1788639184.432705:0:15454:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1788639184.432714:0:15454:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788639184.432719:0:15454:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1788639184.432729:0:15454:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788639184.432795:0:15454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788639184.432807:0:15454:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788639184.432837:0:15454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788639184.432840:0:15454:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788639184.432846:0:15454:0:(genops.c:885:class_export_put()) final put ffff9ae36d25a800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788639184.432850:0:15454:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae36d25a800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1788639184.432863:0:15454:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788639184.434262:0:15454:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262bdbb 00000020:00000080:2.0:1788639184.434273:0:15454:0:(genops.c:885:class_export_put()) final put ffff9ae37513a000/lustre-MDD0001_UUID 00000020:01000000:2.0:1788639184.434281:0:15454:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1788639184.434287:0:15454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788639184.434294:0:15454:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788639184.434298:0:15454:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9ae36d184d40) has no exports 00000020:00000080:3.0:1788639184.434420:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae36ddec000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788639184.434429:0:38:0:(genops.c:885:class_export_put()) final put ffff9ae36dded800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788639184.434431:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae36dded800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1788639184.434438:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788639184.434564:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae37513a000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:2.0:1788639184.435290:0:15454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788639184.435299:0:15454:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1788639184.435303:0:15454:0:(genops.c:885:class_export_put()) final put ffff9ae37513f800/lustre-MDD0001_UUID 00000020:00000080:2.0:1788639184.435305:0:15454:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae37513f800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:2.0:1788639184.435311:0:15454:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:2.0:1788639184.435571:0:15454:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262bdc2 00000020:00000080:2.0:1788639184.435577:0:15454:0:(genops.c:885:class_export_put()) final put ffff9ae375138800/lustre-MDT0001-osd_UUID 00000020:01000004:2.0:1788639184.435595:0:15454:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ae3506e9000 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1788639184.435598:0:15454:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ae3506e9000 2 00000020:01000004:2.0:1788639184.435601:0:15454:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ae3506e9000 from lustre-MDT0001 00000020:00000080:2.0:1788639184.435639:0:15454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788639184.435644:0:15454:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1788639184.435647:0:15454:0:(genops.c:885:class_export_put()) final put ffff9ae37513c000/lustre-MDT0001_UUID 00000020:00000080:2.0:1788639184.435649:0:15454:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae37513c000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1788639184.435656:0:15454:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1788639184.435680:0:15454:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1788639184.435685:0:15454:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1788639184.435688:0:15454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788639184.435692:0:15454:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788639184.435698:0:15454:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9ae36d25c800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788639184.435703:0:15454:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9ae375c599c0) has exports, disconnecting them 00000020:00080000:2.0:1788639184.435707:0:15454:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9ae36d25c800), last request at 1788638949 00000020:00000080:2.0:1788639184.435711:0:15454:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262be16 00000020:00080000:2.0:1788639184.435721:0:15454:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ae36d25c800): rc 0 00000020:00000080:2.0:1788639184.435725:0:15454:0:(genops.c:885:class_export_put()) final put ffff9ae36d25c800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788639184.436872:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae375138800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788639184.436885:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae36d25c800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1788639184.440679:0:15454:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1788639184.440687:0:15454:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788639184.440691:0:15454:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788639184.440698:0:15454:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788639184.440726:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae36d25f800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788639184.440916:0:15454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788639184.440925:0:15454:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1788639184.440930:0:15454:0:(genops.c:885:class_export_put()) final put ffff9ae37513a800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1788639184.440934:0:15454:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae37513a800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1788639184.440940:0:15454:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1788639184.441010:0:15454:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ae3506e9000 1 00000020:00000080:3.0:1788639184.441016:0:15454:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262bd52 00000020:00000080:3.0:1788639184.441022:0:15454:0:(genops.c:885:class_export_put()) final put ffff9ae3438ec000/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1788639184.441030:0:15454:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1788639184.441038:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae3438ec000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788639184.441046:0:15454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788639184.441050:0:15454:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788639184.441054:0:15454:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9ae3802a19c0) has no exports 00000020:00000080:2.0:1788639184.505989:0:15454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788639184.506003:0:15454:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1788639184.506008:0:15454:0:(genops.c:885:class_export_put()) final put ffff9ae36d08f800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788639184.506013:0:15454:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae36d08f800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1788639184.506023:0:15454:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1788639184.506150:0:15454:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ae3506ea800 00000020:01000000:2.0:1788639184.506170:0:15454:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788639184.506174:0:15454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788639184.506179:0:15454:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788639184.506183:0:15454:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9ae3802a4d40) has no exports 00000100:00100000:1.0:1788639184.506423:0:11314:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9ae243865c00:11314] 4 exiting: rc = 0 00000100:00100000:1.0:1788639184.506534:0:6518:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9ae342e3be00:6518] 2 exiting: rc = 0 00000100:00100000:0.0:1788639184.506657:0:6516:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9ae3492e2600:6516] 0 exiting: rc = 1 00000100:00100000:2.0:1788639184.506766:0:10169:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9ae2430e9a00:10169] 3 exiting: rc = 0 00000100:00100000:2.0:1788639184.506838:0:6517:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9ae34a99fa00:6517] 1 exiting: rc = 0 00000100:00100000:0.0:1788639184.506995:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507003:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507008:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507014:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507020:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507025:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507031:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507045:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507051:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507056:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507061:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507066:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507071:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507077:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507082:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507088:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507106:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507112:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507117:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507123:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507128:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507134:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507139:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507144:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507150:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507155:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507160:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507165:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507170:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507184:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507191:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507196:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507202:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507207:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507213:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507218:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507223:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507228:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507233:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507239:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507243:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507249:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507260:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507265:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507270:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507276:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507281:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507286:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507291:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507296:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507300:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507306:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507311:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507316:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507322:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507328:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507333:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507338:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507343:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507348:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507353:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507359:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507365:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.507371:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512080:0:6520:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9ae342e3bc00:6520] 1 exiting: rc = 0 00000100:00100000:0.0:1788639184.512274:0:6519:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9ae367e03200:6519] 0 exiting: rc = 1 00000100:00100000:1.0:1788639184.512427:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512435:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512455:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512461:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512466:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512473:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512479:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512486:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512492:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512497:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512503:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512509:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512515:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512520:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512525:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512530:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512535:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512541:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512546:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512552:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512557:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512563:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512568:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512573:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512577:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512582:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512588:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512594:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512599:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512604:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512610:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512640:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512647:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512652:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512658:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512663:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512668:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512821:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512827:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512832:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512838:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512844:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512850:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512856:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512862:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512867:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512873:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512878:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512883:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512888:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512894:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512899:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512905:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512910:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512915:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512920:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512926:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512932:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512937:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512943:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512948:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512953:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512958:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.512963:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.513398:0:6522:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9ae350b39400:6522] 1 exiting: rc = 0 00000100:00100000:1.0:1788639184.513476:0:6521:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9ae367e02a00:6521] 0 exiting: rc = 1 00000100:00100000:0.0:1788639184.513605:0:12414:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9ae2432c1c00:12414] 2 exiting: rc = 0 00000100:00100000:1.0:1788639184.514867:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.514882:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.514890:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.514895:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.514900:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.514905:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.514928:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.514935:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.514941:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.514947:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.514952:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.514959:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.514965:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.514971:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.514977:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.514984:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.514989:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.514995:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.515014:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.515022:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.515028:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.515034:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.515040:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.515045:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.515051:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.515057:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.515063:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.515069:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.515076:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.515082:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.515116:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.515124:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.515130:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.515136:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.515142:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.515147:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.515153:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.515159:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.515164:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.515169:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.515175:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.515186:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.515203:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.515209:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.515214:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.515220:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.515225:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.515230:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.515236:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.515241:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.515247:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.515252:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.515258:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.515263:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.515281:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.515287:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.515292:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.515298:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.515302:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.515308:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.515313:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.515319:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.515324:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788639184.515335:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.521964:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9ae350da1800:6523] 0 exiting: rc = 1 00000100:00100000:3.0:1788639184.522127:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9ae350b39800:6524] 1 exiting: rc = 0 00000100:00100000:2.0:1788639184.522223:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522230:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522236:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522241:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522247:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522252:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522257:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522262:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522268:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522273:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522278:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522283:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522288:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522293:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522299:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522304:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522309:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522314:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522319:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522324:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522329:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522334:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522339:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522344:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522349:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522354:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522360:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522365:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522381:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522386:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522391:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522396:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522401:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522406:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522412:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522417:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522422:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522428:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522433:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522437:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522443:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522448:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522452:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522457:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522462:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522467:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522472:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522477:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522483:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522488:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522493:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522498:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522502:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522507:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522512:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522517:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522522:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522527:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522532:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522537:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522542:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522547:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522552:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.522565:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.523159:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9ae350da1400:6526] 1 exiting: rc = 0 00000100:00100000:3.0:1788639184.523291:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9ae350da0800:6525] 0 exiting: rc = 1 00000100:00100000:2.0:1788639184.523489:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523495:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523501:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523506:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523511:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523516:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523522:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523526:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523531:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523536:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523541:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523546:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523551:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523556:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523561:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523566:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523570:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523575:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523580:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523585:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523590:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523595:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523601:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523606:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523612:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523667:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523673:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523678:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523683:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523688:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523693:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523697:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523713:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523720:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523735:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523740:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523744:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523749:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523753:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523758:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523764:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523768:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523773:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523778:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523782:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523787:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523792:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523796:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523800:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523805:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523811:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523815:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523820:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523825:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523831:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523835:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523840:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523844:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523849:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523854:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523859:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523864:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523869:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.523874:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639184.524306:0:6528:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9ae37b688000:6528] 1 exiting: rc = 0 00000100:00100000:3.0:1788639184.524486:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9ae37b689000:6527] 0 exiting: rc = 1 00000100:00100000:2.0:1788639184.524820:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.524826:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.524832:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.524837:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.524842:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.524856:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.524861:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.524866:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.524872:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.524877:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.524882:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.524886:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.524891:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.524895:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.524900:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.524905:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.524909:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.524914:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.524919:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.524924:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.524929:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.524934:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.524938:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.524943:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.524949:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.524953:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.524958:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.524963:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.524967:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.524971:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.524976:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.524981:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.524986:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.524990:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.524996:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.525001:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.525006:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.525011:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.525017:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.525022:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.525035:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.525040:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.525045:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.525050:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.525055:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.525061:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.525066:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.525071:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.525076:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.525081:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.525086:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.525103:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.525109:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.525114:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.525119:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.525124:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.525128:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.525133:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.525138:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.525142:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.525146:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.525150:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.525155:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.525160:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639184.525707:0:6529:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9ae37b689e00:6529] 0 exiting: rc = 1 00000100:00100000:3.0:1788639184.525870:0:6531:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9ae37b688400:6531] 2 exiting: rc = 0 00000100:00100000:1.0:1788639184.526147:0:6530:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9ae369b33600:6530] 1 exiting: rc = 0 00000100:00100000:2.0:1788639184.526402:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526409:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526416:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526422:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526427:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526433:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526439:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526445:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526451:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526456:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526462:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526478:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526483:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526490:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526496:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526513:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526519:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526524:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526530:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526535:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526541:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526546:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526552:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526557:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526563:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526568:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526572:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526577:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526581:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526586:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526592:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526598:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526603:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526608:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526780:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526788:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526793:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526799:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526805:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526823:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526829:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526835:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526841:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526846:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526852:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526857:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526868:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526873:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526879:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526887:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526892:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526897:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526902:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526908:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526913:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526919:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526924:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526930:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526936:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526942:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526947:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526952:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526957:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639184.526962:0:15454:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788639184.530940:0:15454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788639184.530953:0:15454:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788639184.530959:0:15454:0:(genops.c:885:class_export_put()) final put ffff9ae3438ed000/MDS_uuid 00000020:00000080:2.0:1788639184.530964:0:15454:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae3438ed000/MDS_uuid for MDS 00000020:01000000:2.0:1788639184.530972:0:15454:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788639184.531149:0:15454:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00000100:00080000:0.0:1788639184.569870:0:13809:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788639184.569882:0:13809:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788639184.569886:0:13809:0:(import.c:65:import_set_state_nolock()) ffff9ae3438e8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788639184.569894:0:13809:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 438 00000100:00080000:0.0:1788639184.569900:0:13809:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788639184.569916:0:13809:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ae3438e8000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:0.0:1788639184.570024:0:13809:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae2438cc380 x1875523773039104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788639184.570087:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875523773039104:0@lo:38:kworker.0 00000400:00000100:1.0:1788639184.570154:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875523773039104 offset 0 length 520: 4 00000100:00080000:0.0:1788639184.570255:0:13809:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788639184.570258:0:13809:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788639184.570260:0:13809:0:(import.c:65:import_set_state_nolock()) ffff9ae242df6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788639184.570264:0:13809:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 438 00000100:00080000:0.0:1788639184.570267:0:13809:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788639184.570271:0:13809:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ae242df6000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:0.0:1788639184.570283:0:13809:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae2438cc000 x1875523773039360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788639184.570323:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875523773039232:0@lo:400:kworker.0 00000400:00000100:2.0:1788639184.570348:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875523773039232 offset 0 length 224: 4 00000100:00100000:1.0:1788639184.570424:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875523773039360:0@lo:38:kworker.0 00000400:00000100:1.0:1788639184.570444:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875523773039360 offset 0 length 520: 4 00000100:00100000:3.0:1788639184.570557:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875523773039488:0@lo:400:kworker.0 00000400:00000100:3.0:1788639184.570581:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875523773039488 offset 0 length 224: 4 00010000:00010000:3.0:1788639185.332718:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639186.357810:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639187.380961:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788639187.560040:0:15655:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788639187.568694:0:15655:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788639187.568745:0:15655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae375f55600/0x25c454990262c18f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c196 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639187.568759:0:15655:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae375f55600/0x25c454990262c18f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262c196 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639187.568765:0:15655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae375f55600/0x25c454990262c18f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262c196 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639187.568771:0:15655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9ae375f55600/0x25c454990262c18f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262c196 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639187.568786:0:15655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788639187.568791:0:15655:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788639187.568814:0:15655:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788639187.568825:0:15655:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ae2438cc380 x1875523773039104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788639199 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639187.568859:0:15655:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788639187.568866:0:15655:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788639187.568872:0:15655:0:(import.c:65:import_set_state_nolock()) ffff9ae3438e8000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788639187.568876:0:15655:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788639187.568880:0:15655:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ae2438cc380 x1875523773039104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788639199 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639187.568887:0:15655:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788639187.568890:0:15655:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:0.0:1788639187.568940:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875523773039104:0@lo:38:kworker.0 00010000:00010000:3.0:1788639187.569338:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788639187.569347:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae375f55600/0x25c454990262c18f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262c196 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639187.569354:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375f55600 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:3.0:1788639187.569357:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae375f55600/0x25c454990262c18f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262c196 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639187.569367:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae375f55600/0x25c454990262c18f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c454990262c196 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788639187.569376:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae375f55600/0x25c454990262c18f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c454990262c196 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639187.569382:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788639187.569384:0:6503:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788639187.569386:0:6503:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788639187.569399:0:6503:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ae367fce000 00010000:00010000:3.0:1788639187.569403:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae375f55600/0x25c454990262c18f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x25c454990262c196 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639187.569421:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae375f55600/0x25c454990262c18f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x25c454990262c196 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639187.569433:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639187.569435:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639187.569437:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788639187.570238:0:15655:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788639187.570249:0:15655:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ae2438ced80 x1875523773039232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639200 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639187.570267:0:15655:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788639187.570272:0:15655:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788639187.570292:0:15655:0:(import.c:65:import_set_state_nolock()) ffff9ae241e99800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788639187.570323:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875523773039616:0@lo:39:umount.0 00000400:00000100:0.0:1788639187.570368:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875523773039616 offset 0 length 224: 4 00000100:00100000:2.0:1788639187.571729:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875523773039232:0@lo:400:kworker.0 00010000:00010000:3.0:1788639188.405103:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639189.428833:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788639189.685160:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 01f1eef9-e690-4065-bf99-bf821af7b626->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788639189.685167:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 01f1eef9-e690-4065-bf99-bf821af7b626->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788639189.685171:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788639189.685193:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788639189.685362:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788639189.685384:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875523773039744:0@lo:400:kworker.0 00000400:00000100:0.0:1788639189.685437:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875523773039744 offset 0 length 224: 4 00000001:00100000:3.0:1788639190.199657:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788639190.199667:0:8425:0:(genops.c:885:class_export_put()) final put ffff9ae375f88800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788639190.199746:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae375f88800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788639190.199826:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae375f8a000 for lustre-OST0000 00000001:00100000:3.0:1788639190.199900:0:9509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788639190.199904:0:9509:0:(genops.c:885:class_export_put()) final put ffff9ae2431ac000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788639190.199961:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae2431ac000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788639190.199994:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae2431a8000 for lustre-OST0001 00010000:00010000:3.0:1788639190.452818:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639191.476940:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639192.501018:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639193.526922:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639194.552883:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639194.741004:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788639184/real 1788639184] req@ffff9ae375f39880 x1875523773038976/t0(0) o250->MGC192.168.206.118@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788639194 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639194.741035:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ae375f39880 x1875523773038976/t0(0) o250->MGC192.168.206.118@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788639194 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788639194.741089:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae367fce000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788639194.741117:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788639194.741121:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:01f1eef9-e690-4065-bf99-bf821af7b626:3640:1875523773038976:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:2.0:1788639194.741178:0:13809:0:(pinger.c:229:ptlrpc_pinger_process_import()) 01f1eef9-e690-4065-bf99-bf821af7b626->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788639194.741183:0:13809:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788639194.741186:0:13809:0:(import.c:65:import_set_state_nolock()) ffff9ae367fce000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788639194.741191:0:13809:0:(import.c:545:import_select_connection()) MGC192.168.206.118@tcp: connect to NID 0@lo last attempt 443 00000100:00080000:2.0:1788639194.741197:0:13809:0:(import.c:630:import_select_connection()) MGC192.168.206.118@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788639194.741203:0:13809:0:(import.c:665:import_select_connection()) MGC192.168.206.118@tcp: import ffff9ae367fce000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788639194.741233:0:13809:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae375f39880 x1875523773039872/t0(0) o250->MGC192.168.206.118@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788639194.741259:0:13809:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788639194.741264:0:13809:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788639194.741320:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:01f1eef9-e690-4065-bf99-bf821af7b626:3640:1875523773039872:0@lo:250:kworker.0 00000400:00000100:0.0:1788639194.741362:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875523773039872 offset 0 length 520: 4 00000100:00100000:3.0:1788639194.741376:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875523773040000:0@lo:400:kworker.0 00000400:00000100:3.0:1788639194.741409:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875523773040000 offset 0 length 224: 4 00010000:00010000:3.0:1788639195.573139:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639196.597935:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639197.621456:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639197.813886:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788639187/real 1788639187] req@ffff9ae2438cc380 x1875523773039616/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788639197 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639197.813921:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ae2438cc380 x1875523773039616/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788639197 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788639197.813941:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae241e99800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788639197.813969:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875523773039616:0@lo:39:umount.0 00000100:00080000:0.0:1788639197.814145:0:15655:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788639197.814149:0:15655:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788639197.814154:0:15655:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788639197.815687:0:15655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae375f54c00/0x25c454990262c19d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c1a4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639197.815705:0:15655:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae375f54c00/0x25c454990262c19d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262c1a4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639197.815713:0:15655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae375f54c00/0x25c454990262c19d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262c1a4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639197.815720:0:15655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9ae375f54c00/0x25c454990262c19d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262c1a4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639197.815751:0:15655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788639197.815759:0:15655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae38217be00/0x25c454990262c421 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c428 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639197.815766:0:15655:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae38217be00/0x25c454990262c421 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262c428 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639197.815792:0:15655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae38217be00/0x25c454990262c421 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262c428 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639197.815798:0:15655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9ae38217be00/0x25c454990262c421 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262c428 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639197.815820:0:15655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788639197.815826:0:15655:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788639197.815852:0:15655:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788639197.815856:0:15655:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1788639197.815860:0:15655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788639197.815865:0:15655:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788639197.815869:0:15655:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9ae3691ccd40) has no exports 00000020:00080000:0.0:1788639197.815890:0:15655:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9ae3691ccd40) has no exports 00000020:01000000:0.0:1788639197.817563:0:15655:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ae24315d660 - data ffff9ae378b31438/ffff9ae243050c00 00010000:00010000:3.0:1788639197.817648:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788639197.817658:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae375f54c00/0x25c454990262c19d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262c1a4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639197.817668:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375f54c00 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:3.0:1788639197.817672:0:8446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae375f54c00/0x25c454990262c19d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262c1a4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639197.817674:0:9520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788639197.817680:0:9520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae38217be00/0x25c454990262c421 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262c428 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639197.817698:0:9520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae38217be00 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:1.0:1788639197.817700:0:9520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae38217be00/0x25c454990262c421 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262c428 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639197.817701:0:8446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae375f54c00/0x25c454990262c19d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c454990262c1a4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639197.817707:0:9520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae38217be00/0x25c454990262c421 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c454990262c428 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788639197.817709:0:8446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae375f54c00/0x25c454990262c19d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c454990262c1a4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788639197.817714:0:9520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae38217be00/0x25c454990262c421 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c454990262c428 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639197.817715:0:8446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788639197.817718:0:8446:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1788639197.817719:0:9520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788639197.817721:0:8446:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:1.0:1788639197.817721:0:9520:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788639197.817722:0:9520:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788639197.817735:0:8446:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ae367fce000 00010000:00010000:1.0:1788639197.817735:0:9520:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ae367fce000 00010000:00010000:1.0:1788639197.817739:0:9520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae38217be00/0x25c454990262c421 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x25c454990262c428 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639197.817740:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae375f54c00/0x25c454990262c19d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x25c454990262c1a4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639197.817747:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae375f54c00/0x25c454990262c19d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x25c454990262c1a4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639197.817747:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae38217be00/0x25c454990262c421 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x25c454990262c428 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639197.817762:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639197.817762:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639197.817765:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639197.817765:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639197.817767:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639197.817767:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788639197.821083:0:15655:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ae241dc1240 - data ffff9ae378a6b360/ffff9ae241e50400 00100000:10000000:0.0:1788639197.835366:0:15655:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788639197.847432:0:15655:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262beef 00000020:00000080:2.0:1788639197.847452:0:15655:0:(genops.c:885:class_export_put()) final put ffff9ae2416eb000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788639197.847474:0:15655:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ae375ea2800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788639197.847478:0:15655:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ae375ea2800 2 00000020:01000004:2.0:1788639197.847482:0:15655:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ae375ea2800 from lustre-OST0000 00000020:00000080:2.0:1788639197.847517:0:15655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788639197.847526:0:15655:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788639197.847530:0:15655:0:(genops.c:885:class_export_put()) final put ffff9ae2416ee800/lustre-OST0000_UUID 00000020:00000080:2.0:1788639197.847532:0:15655:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae2416ee800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788639197.847539:0:15655:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788639197.847589:0:15655:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788639197.847593:0:15655:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788639197.847596:0:15655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788639197.847600:0:15655:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788639197.847606:0:15655:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9ae36ddee800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788639197.847612:0:15655:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9ae36a0e8000) has exports, disconnecting them 00000020:00080000:2.0:1788639197.847646:0:15655:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9ae36ddee800), last request at 1788638973 00000020:00000080:2.0:1788639197.847650:0:15655:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262bf19 00000020:00080000:2.0:1788639197.847659:0:15655:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ae36ddee800): rc 0 00000020:00000080:2.0:1788639197.847664:0:15655:0:(genops.c:885:class_export_put()) final put ffff9ae36ddee800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788639197.848338:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae2416eb000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788639197.848352:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae36ddee800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1788639197.848380:0:15655:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788639197.848384:0:15655:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788639197.848389:0:15655:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788639197.848394:0:15655:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788639197.848412:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae3438e8000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788639197.848529:0:15655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788639197.848534:0:15655:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788639197.848538:0:15655:0:(genops.c:885:class_export_put()) final put ffff9ae36d233000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788639197.848549:0:15655:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae36d233000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788639197.848553:0:15655:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1788639197.848598:0:15655:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788639197.848602:0:15655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788639197.848606:0:15655:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788639197.848611:0:15655:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9ae241e9f800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788639197.848635:0:15655:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff9ae241ee19c0) has exports, disconnecting them 00000020:00080000:3.0:1788639197.848639:0:15655:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9ae241e9f800), last request at 1788638973 00000020:00000080:3.0:1788639197.848642:0:15655:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262bf2e 00000020:00080000:3.0:1788639197.848652:0:15655:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ae241e9f800): rc 0 00000020:00000080:3.0:1788639197.848656:0:15655:0:(genops.c:885:class_export_put()) final put ffff9ae241e9f800/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788639197.848683:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae241e9f800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1788639197.852135:0:15655:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788639197.852142:0:15655:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788639197.852147:0:15655:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788639197.852153:0:15655:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788639197.852341:0:15655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788639197.852350:0:15655:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1788639197.852369:0:15655:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ae375ea2800 1 00000020:00000080:1.0:1788639197.852376:0:15655:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262beb7 00000020:00000080:1.0:1788639197.852385:0:15655:0:(genops.c:885:class_export_put()) final put ffff9ae375cae000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788639197.852391:0:15655:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788639197.852395:0:15655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788639197.852400:0:15655:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788639197.852403:0:15655:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9ae375c5cd40) has no exports 00000020:00000080:1.0:1788639197.856848:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae241e99800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788639197.856863:0:38:0:(genops.c:885:class_export_put()) final put ffff9ae241e9c000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1788639197.856867:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae241e9c000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1788639197.856877:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1788639197.856944:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae375cae000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788639198.012455:0:15655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788639198.012471:0:15655:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788639198.012477:0:15655:0:(genops.c:885:class_export_put()) final put ffff9ae375ea6800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788639198.012481:0:15655:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae375ea6800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788639198.012607:0:15655:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788639198.012817:0:15655:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ae375ea0800 00000020:02000400:1.0:1788639198.012861:0:15655:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1788639198.644756:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639199.669850:0:9519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639199.861289:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788639184/real 1788639184] req@ffff9ae2438cc000 x1875523773039360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788639199 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639199.861318:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ae2438cc000 x1875523773039360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788639199 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788639199.861345:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae242df6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788639199.861371:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788639199.861375:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875523773039360:0@lo:38:kworker.0 00000100:00080000:2.0:1788639199.861530:0:13809:0:(pinger.c:229:ptlrpc_pinger_process_import()) 01f1eef9-e690-4065-bf99-bf821af7b626->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788639199.861535:0:13809:0:(pinger.c:247:ptlrpc_pinger_process_import()) 01f1eef9-e690-4065-bf99-bf821af7b626->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788639199.861537:0:13809:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788639199.861540:0:13809:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788639199.861543:0:13809:0:(import.c:65:import_set_state_nolock()) ffff9ae242df6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788639199.861548:0:13809:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 443 00000100:00080000:2.0:1788639199.861554:0:13809:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788639199.861560:0:13809:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ae242df6000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788639199.861591:0:13809:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae375f3a680 x1875523773040128/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788639199.861700:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875523773040128:0@lo:38:kworker.0 00000400:00000100:2.0:1788639199.861747:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875523773040128 offset 0 length 520: 4 00000100:00100000:2.0:1788639199.861812:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875523773040256:0@lo:400:kworker.0 00000400:00000100:2.0:1788639199.861831:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875523773040256 offset 0 length 224: 4 00010000:00010000:3.0:1788639200.693609:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:0.0:1788639200.948760:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788639184/real 1788639184] req@ffff9ae2438cce00 x1875523773039488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788639200 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639200.980885:0:3643:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9ae2438cce00 x1875523773039488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788639200 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788639200.980911:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9ae242398000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788639200.980916:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788639200.996951:0:3643:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00100000:1.0:1788639200.997067:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875523773039488:0@lo:400:kworker.0 00000100:00080000:2.0:1788639200.997326:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 01f1eef9-e690-4065-bf99-bf821af7b626->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788639200.997331:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 01f1eef9-e690-4065-bf99-bf821af7b626->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788639200.997334:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788639200.997337:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788639200.997340:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788639200.997343:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788639200.997346:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ae242398000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788639200.997352:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 253 00000100:00080000:2.0:1788639200.997360:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9ae242398000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788639200.997395:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae375f39c00 x1875523773040384/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788639200.997698:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875523773040384:0@lo:38:kworker.0 00000400:00000100:0.0:1788639200.997793:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875523773040384 offset 0 length 520: 4 00000020:01000004:3.0:1788639201.430177:0:15857:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788639201.449970:0:15857:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788639201.450080:0:15857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262c173 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c17a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639201.450095:0:15857:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262c173 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262c17a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639201.450102:0:15857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262c173 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262c17a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639201.450109:0:15857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262c173 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262c17a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639201.450137:0:15857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788639201.450157:0:15857:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788639201.450183:0:15857:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788639201.450194:0:15857:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ae375f3a680 x1875523773040128/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788639219 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639201.450218:0:15857:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788639201.450223:0:15857:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788639201.450230:0:15857:0:(import.c:65:import_set_state_nolock()) ffff9ae242df6000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788639201.450234:0:15857:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788639201.450238:0:15857:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ae375f3a680 x1875523773040128/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788639219 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639201.450244:0:15857:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788639201.450247:0:15857:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00010000:00010000:0.0:1788639201.450404:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639201.450413:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262c173 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262c17a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639201.450427:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fb800 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:0.0:1788639201.450431:0:8446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262c173 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262c17a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639201.450440:0:8446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262c173 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c454990262c17a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788639201.450447:0:8446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262c173 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c454990262c17a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639201.450456:0:8446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788639201.450460:0:8446:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788639201.450463:0:8446:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788639201.450478:0:8446:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ae367fce000 00010000:00010000:0.0:1788639201.450482:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262c173 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x25c454990262c17a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639201.450493:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875523773040128:0@lo:38:kworker.0 00010000:00010000:0.0:1788639201.450508:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262c173 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x25c454990262c17a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639201.450520:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639201.450522:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639201.450524:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788639201.452673:0:15857:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788639201.452688:0:15857:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ae375f38000 x1875523773039744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639205 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639201.452785:0:15857:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ae375f3b800 x1875523773040000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639210 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639201.452805:0:15857:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ae375f3aa00 x1875523773040256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639215 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639201.452840:0:15857:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ae375f39c00 x1875523773040384/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788639210 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639201.452851:0:15857:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788639201.452858:0:15857:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788639201.452863:0:15857:0:(import.c:65:import_set_state_nolock()) ffff9ae242398000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788639201.452870:0:15857:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788639201.452874:0:15857:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ae375f38000 x1875523773039744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639205 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639201.452879:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875523773040256:0@lo:400:kworker.0 00000100:00100000:2.0:1788639201.452940:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875523773040000:0@lo:400:kworker.0 00000100:00100000:1.0:1788639201.453182:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875523773039744:0@lo:400:kworker.0 00000100:00100000:3.0:1788639201.453204:0:15857:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ae375f3b800 x1875523773040000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639210 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639201.453212:0:15857:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ae375f3aa00 x1875523773040256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639215 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639201.453220:0:15857:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ae375f39c00 x1875523773040384/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788639210 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639201.453227:0:15857:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788639201.455697:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875523773040384:0@lo:38:kworker.0 00000100:00100000:3.0:1788639201.459376:0:15857:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788639201.460847:0:15857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb200/0x25c454990262c181 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c188 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639201.460864:0:15857:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb200/0x25c454990262c181 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262c188 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639201.460871:0:15857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb200/0x25c454990262c181 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262c188 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639201.460878:0:15857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb200/0x25c454990262c181 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262c188 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639201.461197:0:15857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788639201.461206:0:15857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae340030c00/0x25c454990262c413 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262c41a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639201.461213:0:15857:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae340030c00/0x25c454990262c413 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262c41a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639201.461219:0:15857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae340030c00/0x25c454990262c413 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262c41a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639201.461239:0:15857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9ae340030c00/0x25c454990262c413 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x25c454990262c41a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639201.461269:0:9520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788639201.461276:0:9520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb200/0x25c454990262c181 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262c188 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639201.461283:0:9520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fb200 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:1.0:1788639201.461286:0:9520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb200/0x25c454990262c181 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262c188 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639201.461303:0:9520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb200/0x25c454990262c181 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c454990262c188 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788639201.461310:0:9520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb200/0x25c454990262c181 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c454990262c188 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788639201.461316:0:9520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788639201.461318:0:9520:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1788639201.461329:0:9520:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ae367fce000 00010000:00010000:1.0:1788639201.461333:0:9520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb200/0x25c454990262c181 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x25c454990262c188 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639201.461340:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb200/0x25c454990262c181 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x25c454990262c188 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639201.461354:0:9520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788639201.461357:0:9520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae340030c00/0x25c454990262c413 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262c41a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639201.461362:0:9520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae340030c00 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:1.0:1788639201.461365:0:9520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae340030c00/0x25c454990262c413 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x25c454990262c41a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639201.461371:0:9520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae340030c00/0x25c454990262c413 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c454990262c41a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788639201.461377:0:9520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae340030c00/0x25c454990262c413 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c454990262c41a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788639201.461391:0:9520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788639201.461393:0:9520:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1788639201.461398:0:9520:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ae367fce000 00010000:00010000:1.0:1788639201.461401:0:9520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae340030c00/0x25c454990262c413 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x25c454990262c41a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639201.461409:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639201.461410:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639201.461413:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639201.461449:0:15857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788639201.461454:0:15857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae340030c00/0x25c454990262c413 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x25c454990262c41a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639201.461469:0:15857:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1788639201.461642:0:15857:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1788639201.461647:0:15857:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788639201.461675:0:15857:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788639201.461680:0:15857:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788639201.461685:0:15857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788639201.461690:0:15857:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788639201.461695:0:15857:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9ae36a0eb380) has no exports 00000020:00080000:3.0:1788639201.461718:0:15857:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9ae36a0eb380) has no exports 00010000:00010000:1.0:1788639201.462177:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788639201.465251:0:15857:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ae24315d360 - data ffff9ae378b31a20/ffff9ae375f58c00 00000020:01000000:3.0:1788639201.465427:0:15857:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ae370feb900 - data ffff9ae24180b360/ffff9ae243050000 00100000:10000000:2.0:1788639201.477685:0:15857:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788639201.486638:0:15857:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262c015 00000020:00000080:3.0:1788639201.486650:0:15857:0:(genops.c:885:class_export_put()) final put ffff9ae242398800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788639201.486669:0:15857:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ae375f89000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1788639201.486672:0:15857:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ae375f89000 2 00000020:01000004:3.0:1788639201.486675:0:15857:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ae375f89000 from lustre-OST0001 00000020:00000080:3.0:1788639201.486698:0:15857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788639201.486708:0:15857:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1788639201.486711:0:15857:0:(genops.c:885:class_export_put()) final put ffff9ae24239d800/lustre-OST0001_UUID 00000020:00000080:3.0:1788639201.486714:0:15857:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae24239d800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1788639201.486721:0:15857:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:0.0:1788639201.486729:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae242398800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:3.0:1788639201.486813:0:15857:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 01f1eef9-e690-4065-bf99-bf821af7b626->MGS 00010000:00010000:3.0:1788639201.486834:0:15857:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae341480c00/0x25c454990262bd6e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c454990262bd75 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788639201.486846:0:15857:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae341480c00/0x25c454990262bd6e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c454990262bd75 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639201.486852:0:15857:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788639201.486855:0:15857:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788639201.486858:0:15857:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788639201.486869:0:15857:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ae367fce000 00010000:00010000:3.0:1788639201.486873:0:15857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae341480c00/0x25c454990262bd6e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x25c454990262bd75 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639201.486887:0:15857:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4200/0x25c454990262c1e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x25c454990262c1ea expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788639201.486894:0:15857:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4200/0x25c454990262c1e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x25c454990262c1ea expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639201.486899:0:15857:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788639201.486901:0:15857:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1788639201.486903:0:15857:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788639201.486911:0:15857:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ae367fce000 00010000:00010000:3.0:1788639201.486913:0:15857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae3429e4200/0x25c454990262c1e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x25c454990262c1ea expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788639201.486927:0:15857:0:(import.c:65:import_set_state_nolock()) ffff9ae367fce000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788639201.486931:0:15857:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788639201.486933:0:15857:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788639201.486935:0:15857:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788639201.486938:0:15857:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788639201.486948:0:15857:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ae375f39880 x1875523773039872/t0(0) o250->MGC192.168.206.118@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788639209 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788639201.487387:0:15857:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788639201.487390:0:15857:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00000100:00100000:0.0:1788639201.487854:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:01f1eef9-e690-4065-bf99-bf821af7b626:3640:1875523773039872:0@lo:250:kworker.0 10000000:01000000:3.0:1788639201.487916:0:15857:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788639201.487926:0:15857:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262bc6b 00000020:00000080:3.0:1788639201.487932:0:15857:0:(genops.c:885:class_export_put()) final put ffff9ae3438eb000/01f1eef9-e690-4065-bf99-bf821af7b626 00000020:01000000:3.0:1788639201.487950:0:15857:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.118@tcp (flags='') 00000020:00000080:3.0:1788639201.487956:0:15857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788639201.487970:0:15857:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.118@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788639201.487974:0:15857:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9ae342e50000) has no exports 10000000:01000000:1.0:1788639201.488011:0:6513:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1788639201.488081:0:15857:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.206.118@tcp: client import never connected 00000100:00080000:1.0:1788639201.488084:0:15857:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788639201.488086:0:15857:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788639201.488088:0:15857:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788639201.488090:0:15857:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788639201.488109:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae3438eb000/01f1eef9-e690-4065-bf99-bf821af7b626 for MGC192.168.206.118@tcp 00000020:00000080:0.0:1788639201.488121:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae367fce000 for MGC192.168.206.118@tcp 00000020:00000080:1.0:1788639201.488125:0:15857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788639201.488132:0:15857:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.118@tcp (uuid 01f1eef9-e690-4065-bf99-bf821af7b626) 00000020:00000080:1.0:1788639201.488136:0:15857:0:(genops.c:885:class_export_put()) final put ffff9ae367fcc000/01f1eef9-e690-4065-bf99-bf821af7b626 00000020:00000080:1.0:1788639201.488139:0:15857:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae367fcc000/01f1eef9-e690-4065-bf99-bf821af7b626 for MGC192.168.206.118@tcp 00000020:01000000:1.0:1788639201.488147:0:15857:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.118@tcp (01f1eef9-e690-4065-bf99-bf821af7b626) 00000020:01000000:1.0:1788639201.488408:0:15857:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788639201.488413:0:15857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788639201.488418:0:15857:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788639201.488422:0:15857:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9ae242df1000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788639201.488428:0:15857:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff9ae241ee3380) has exports, disconnecting them 00000020:00080000:1.0:1788639201.488443:0:15857:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9ae242df1000), last request at 1788638994 00000020:00000080:1.0:1788639201.488447:0:15857:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262c03f 00000020:00080000:1.0:1788639201.488471:0:15857:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ae242df1000): rc 0 00000020:00000080:1.0:1788639201.488476:0:15857:0:(genops.c:885:class_export_put()) final put ffff9ae242df1000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788639201.488597:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae242df1000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788639201.490697:0:15857:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788639201.490705:0:15857:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788639201.490709:0:15857:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788639201.490715:0:15857:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788639201.490787:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae242df6000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788639201.490883:0:15857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788639201.490891:0:15857:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1788639201.490897:0:15857:0:(genops.c:885:class_export_put()) final put ffff9ae242df2000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1788639201.490900:0:15857:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae242df2000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1788639201.490905:0:15857:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1788639201.490968:0:15857:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788639201.490972:0:15857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788639201.490977:0:15857:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788639201.490983:0:15857:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9ae24239e000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788639201.491015:0:15857:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff9ae242f40000) has exports, disconnecting them 00000020:00080000:0.0:1788639201.491019:0:15857:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9ae24239e000), last request at 1788638994 00000020:00000080:0.0:1788639201.491023:0:15857:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262c054 00000020:00080000:0.0:1788639201.491038:0:15857:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ae24239e000): rc 0 00000020:00000080:0.0:1788639201.491043:0:15857:0:(genops.c:885:class_export_put()) final put ffff9ae24239e000/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1788639201.491378:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae24239e000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:0.0:1788639201.562232:0:15857:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788639201.562241:0:15857:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788639201.562246:0:15857:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788639201.562253:0:15857:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788639201.562320:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ae242398000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1788639201.562363:0:9519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1788639201.562493:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1788639201.562571:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:3.0:1788639201.562654:0:9520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00010000:00010000:3.0:1788639201.562723:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-5 blwis in pool) 00000100:00100000:3.0:1788639201.562904:0:6498:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9ae34ad31400:6498] 0 exiting: rc = 1 00000100:00100000:3.0:1788639201.562968:0:6499:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9ae362608000:6499] 1 exiting: rc = 0 00000100:00100000:3.0:1788639201.563027:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563397:0:15455:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9ae3627de400:15455] 3 exiting: rc = 0 00000100:00100000:3.0:1788639201.563472:0:6500:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9ae36a0ffc00:6500] 0 exiting: rc = 1 00000100:00100000:3.0:1788639201.563520:0:6501:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9ae36a0ff400:6501] 1 exiting: rc = 0 00000100:00100000:3.0:1788639201.563582:0:6502:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9ae36a0fee00:6502] 2 exiting: rc = 0 00000100:00100000:3.0:1788639201.563653:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563660:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563666:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563672:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563678:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563684:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563702:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563708:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563715:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563720:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563725:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563730:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563736:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563742:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563749:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563755:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563760:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563766:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563772:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563778:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563785:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563790:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563795:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563800:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563805:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563810:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563815:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563821:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563826:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563831:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563837:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563842:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563847:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563852:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563857:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563863:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563868:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563874:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563878:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563883:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563888:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563901:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563906:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563912:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563917:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563922:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563927:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563933:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563938:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563943:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563949:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563955:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563960:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563965:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563975:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563980:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563986:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563991:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.563996:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.564011:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.564017:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.564022:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.564026:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788639201.564031:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788639201.564822:0:15857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788639201.564831:0:15857:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1788639201.564836:0:15857:0:(genops.c:885:class_export_put()) final put ffff9ae24239b800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1788639201.564841:0:15857:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae24239b800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1788639201.564845:0:15857:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1788639201.564892:0:15857:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ae375f89000 1 00000020:00000080:3.0:1788639201.564898:0:15857:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x25c454990262bfe4 00000020:00000080:3.0:1788639201.564904:0:15857:0:(genops.c:885:class_export_put()) final put ffff9ae37f754000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788639201.564917:0:15857:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788639201.564928:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae37f754000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788639201.564939:0:15857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788639201.564951:0:15857:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788639201.564955:0:15857:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff9ae36a0e99c0) has no exports 00000020:00000080:3.0:1788639201.592941:0:15857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788639201.592955:0:15857:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788639201.592961:0:15857:0:(genops.c:885:class_export_put()) final put ffff9ae375f8f800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788639201.592965:0:15857:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae375f8f800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788639201.592971:0:15857:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788639201.595904:0:15857:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ae375f89800 00000020:01000000:2.0:1788639201.595951:0:15857:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788639201.595968:0:15857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788639201.595973:0:15857:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788639201.595978:0:15857:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9ae3802a3380) has no exports 00000020:00000080:2.0:1788639201.596049:0:15857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788639201.596060:0:15857:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788639201.596065:0:15857:0:(genops.c:885:class_export_put()) final put ffff9ae375caa000/OSS_uuid 00000020:00000080:2.0:1788639201.596069:0:15857:0:(genops.c:844:class_export_destroy()) destroying export ffff9ae375caa000/OSS_uuid for OSS 00000020:01000000:2.0:1788639201.596079:0:15857:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1788639201.596235:0:8829:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9ae241ff0c00:8829] 3 exiting: rc = 0 00000100:00100000:2.0:1788639201.596362:0:8432:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9ae38020ca00:8432] 2 exiting: rc = 0 00000100:00100000:1.0:1788639201.596873:0:8430:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9ae375ca5400:8430] 0 exiting: rc = 1 00000100:00080000:0.0:1788639201.597032:0:6512:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788639201.597213:0:8431:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9ae38020cc00:8431] 1 exiting: rc = 0 00000100:00100000:2.0:1788639201.598845:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.598857:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.598863:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.598874:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.598883:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.598889:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.598895:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.598900:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.598905:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.598910:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.598915:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.598920:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.598926:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.598931:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.598937:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.598942:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.598947:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.598953:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.598958:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.598962:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.598967:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.598973:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.598978:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.598983:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.598989:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.598995:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.599026:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.599032:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.599038:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.599044:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.599049:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.599055:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.599061:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.599066:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.599072:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.599077:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.599083:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.599088:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.599093:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.599099:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.599105:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.599110:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.599114:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.599120:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.599125:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.599130:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.599136:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.599141:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.599147:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.599152:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.599157:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.599162:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.599167:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.599172:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.599178:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.599183:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.599189:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.599209:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.599216:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.599221:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.599227:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.599240:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.599245:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.599250:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.600778:0:13805:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9ae243145e00:13805] 2 exiting: rc = 0 00000100:00100000:2.0:1788639201.600865:0:8434:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9ae38020d600:8434] 1 exiting: rc = 0 00000100:00100000:2.0:1788639201.601791:0:8433:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9ae38020c400:8433] 0 exiting: rc = 1 00000100:00100000:2.0:1788639201.601873:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.601881:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.601889:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.601895:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.601900:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.601905:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.601911:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.601917:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.601922:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.601928:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.601933:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.601938:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.601944:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.601948:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.601953:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.601958:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.601963:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.601968:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.601973:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.601978:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.601983:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.601988:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.601993:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.601998:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.602014:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.602019:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.602024:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.602029:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.602047:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.602052:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.602057:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.602062:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.602067:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.602072:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.602078:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.602084:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.602089:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.602094:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.602100:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.602106:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.602111:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.602116:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.602121:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.602127:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.602132:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.602137:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.602143:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.602148:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.602153:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.602158:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.602164:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.602169:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.602174:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.602179:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.602184:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.602189:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.602194:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.602300:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.602305:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.602310:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.602315:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.602321:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.602326:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.602340:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.603464:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9ae34436e800:8437] 2 exiting: rc = 0 00000100:00100000:2.0:1788639201.605755:0:8435:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9ae34377c200:8435] 0 exiting: rc = 1 00000100:00100000:1.0:1788639201.609796:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9ae38020d800:8436] 1 exiting: rc = 0 00000100:00100000:2.0:1788639201.609955:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.609963:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.609969:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.609976:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.609993:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610009:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610016:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610021:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610026:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610032:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610038:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610043:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610049:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610062:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610070:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610076:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610082:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610087:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610093:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610098:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610104:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610109:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610115:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610121:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610127:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610133:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610138:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610144:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610150:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610156:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610162:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610167:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610185:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610191:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610207:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610214:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610219:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610238:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610245:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610251:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610256:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610262:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610267:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610273:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610279:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610285:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610291:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610296:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610303:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610309:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610314:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610322:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610327:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610332:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610337:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610345:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610352:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610357:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610362:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610368:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610374:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610379:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610385:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.610391:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.615262:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9ae3802ae000:8438] 0 exiting: rc = 1 00000100:00100000:1.0:1788639201.615675:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9ae3802aec00:8439] 1 exiting: rc = 0 00000100:00100000:2.0:1788639201.617449:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617458:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617463:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617489:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617494:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617500:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617505:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617510:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617515:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617531:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617538:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617555:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617565:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617572:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617577:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617581:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617586:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617590:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617595:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617600:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617604:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617609:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617711:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617721:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617728:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617736:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617775:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617781:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617787:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617791:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617796:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617801:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617806:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617810:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617829:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617833:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617838:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617842:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617854:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617858:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617864:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617868:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617873:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617877:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617882:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617887:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617892:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617896:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617901:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617905:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617909:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617913:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617918:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617923:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617927:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617931:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617936:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617940:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617945:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617950:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617954:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617959:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617964:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788639201.617974:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.619460:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9ae375ca5200:8440] 0 exiting: rc = 1 00000100:00100000:1.0:1788639201.621462:0:8441:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9ae3750eac00:8441] 1 exiting: rc = 0 00000100:00100000:0.0:1788639201.623212:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623223:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623229:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623235:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623241:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623246:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623252:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623286:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623294:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623299:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623305:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623310:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623316:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623321:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623327:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623333:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623339:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623344:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623350:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623387:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623394:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623400:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623407:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623413:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623420:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623426:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623431:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623437:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623443:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623448:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623454:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623475:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623483:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623489:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623495:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623501:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623506:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623511:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623517:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623522:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623528:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623533:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623546:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623567:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623574:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623579:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623585:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623591:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623597:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623602:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623608:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623632:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623639:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623646:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623659:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623677:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623685:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623691:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623697:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623702:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623708:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623714:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623719:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788639201.623734:0:15857:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1788639201.642563:0:15857:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788639218.423241:0:16621:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg618-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788639227.049963:0:17220:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788639227.049969:0:17220:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788639227.049970:0:17220:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788639227.050378:0:17220:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ae243aeb000 00000020:01000004:3.0:1788639227.050396:0:17220:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788639227.050403:0:17220:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788639227.050417:0:17220:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9ae3691cb380) 00000020:00000080:3.0:1788639227.050430:0:17220:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788639227.142280:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1788639227.144494:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788639227.149711:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1788639227.153234:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1788639227.153438:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1788639227.153709:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1788639227.154158:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1788639227.154355:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1788639227.154599:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1788639227.154984:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1788639227.155177:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1788639227.155403:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1788639227.155635:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1788639227.155919:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1788639227.156114:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1788639227.156309:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1788639227.156587:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1788639227.156972:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1788639227.157161:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1788639227.157342:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1788639227.157642:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1788639227.157922:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1788639227.158111:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1788639227.158727:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1788639227.159007:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1788639227.159202:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1788639227.159511:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1788639227.159942:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1788639227.160145:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1788639227.160314:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1788639227.160570:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1788639227.160911:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1788639227.161137:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1788639227.161341:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1788639227.161554:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1788639227.162719:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1788639227.163213:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1788639227.163449:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1788639227.163688:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1788639227.163886:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788639227.164122:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788639227.164300:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788639227.164487:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1788639227.164769:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1788639227.165091:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1788639227.165283:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1788639227.165515:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1788639227.165997:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1788639227.166726:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1788639227.167034:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:0.0:1788639227.167483:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1788639227.167711:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1788639227.167997:0:17220:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:0.0:1788639227.169208:0:17220:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788639227.169417:0:17220:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788639227.169424:0:17220:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788639227.169435:0:17220:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x25c454990262d228 00000020:01000004:0.0:1788639227.169441:0:17220:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1788639227.169446:0:17220:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788639227.169451:0:17220:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ae243aeb000 from MGS 00000020:01000004:0.0:1788639227.169454:0:17220:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788639227.169464:0:17220:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9ae242f419c0) 00000020:00000080:0.0:1788639227.169473:0:17220:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788639227.169532:0:17220:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ae243aeb000 from MGS, refs=2 00080000:01000000:0.0:1788639227.169537:0:17220:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788639227.169541:0:17220:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x25c454990262d236 00000100:00100000:0.0:1788639227.169666:0:17220:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788639227.169806:0:17220:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788639227.169811:0:17220:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788639227.170576:0:17220:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788639227.170584:0:17220:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788639227.171517:0:17220:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788639227.171759:0:17220:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788639227.171765:0:17220:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788639227.172360:0:17220:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788639227.172430:0:17220:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788639227.172764:0:17220:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788639227.172770:0:17220:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788639227.173361:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639227.173364:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639227.173366:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639227.174141:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639227.174145:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639227.174147:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639227.175278:0:17220:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788639227.177323:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788639227.183508:0:17220:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1788639227.184580:0:17232:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788639227.184662:0:17220:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788639227.184707:0:17220:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788639227.185536:0:17220:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788639227.186009:0:17220:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788639227.186161:0:17220:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788639227.186168:0:17220:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788639227.189605:0:17220:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788639227.189647:0:17220:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788639227.190311:0:17220:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788639227.190318:0:17220:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788639227.191362:0:17220:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788639227.191383:0:17220:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.118@tcp' 00000020:01000004:3.0:1788639227.191385:0:17220:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788639227.191414:0:17220:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.118@tcp (typ=mgc) 00000020:00000080:3.0:1788639227.191428:0:17220:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.118@tcp (ffff9ae3691c99c0) 00000020:00000080:3.0:1788639227.191442:0:17220:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788639227.191523:0:17220:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ae2416eb000@MGC192.168.206.118@tcp: add connection 192.168.206.118@tcp at head 00010000:00010000:3.0:1788639227.191733:0:17220:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.118@tcp-0 is initialized 00000040:01000000:3.0:1788639227.191739:0:17220:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.118@tcp ctxt 1 is initialized 00000100:00080000:2.0:1788639227.192262:0:17237:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1788639227.198002:0:17238:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788639227.198161:0:17220:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.118@tcp (uuid 4d225031-35be-4b74-b245-637fda218215) 00000020:00000080:3.0:1788639227.198184:0:17220:0:(genops.c:1385:class_connect()) connect: client 4d225031-35be-4b74-b245-637fda218215, cookie 0x25c454990262d244 00000100:00080000:3.0:1788639227.198196:0:17220:0:(import.c:545:import_select_connection()) MGC192.168.206.118@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788639227.198202:0:17220:0:(import.c:665:import_select_connection()) MGC192.168.206.118@tcp: import ffff9ae2416eb000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:3.0:1788639227.198230:0:17220:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae24233c700 x1875523773040512/t0(0) o250->MGC192.168.206.118@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788639227.198260:0:17220:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 4d225031-35be-4b74-b245-637fda218215->MGS 00000100:00100000:2.0:1788639227.198841:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4d225031-35be-4b74-b245-637fda218215:3640:1875523773040512:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788639227.198920:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639227.198986:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773040512 00000100:00100000:2.0:1788639227.198992:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773040512 00000100:00100000:2.0:1788639227.199018:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788639227.199025:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243174050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3640:x1875523773040512:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788639227.199045:0:17233:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 4d225031-35be-4b74-b245-637fda218215@0@lo t0 exp 0000000000000000 cur 485 last 0 00000020:00000080:2.0:1788639227.199066:0:17233:0:(genops.c:1385:class_connect()) connect: client 4d225031-35be-4b74-b245-637fda218215, cookie 0x25c454990262d24b 00000100:00080000:2.0:1788639227.199181:0:17233:0:(import.c:65:import_set_state_nolock()) ffff9ae2439a1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788639227.199229:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243174050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+5:3640:x1875523773040512:12345-0@lo:250:mount.lustre.0 Request processed in 204us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639227.199236:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788639227.199279:0:3640:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.206.118@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788639227.199288:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.206.118@tcp: connect to target with instance 0 00000100:00080000:2.0:1788639227.199294:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.206.118@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788639227.199298:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788639227.199301:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae2416eb000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788639227.199304:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788639227.199311:0:3640:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788639227.199316:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4d225031-35be-4b74-b245-637fda218215:3640:1875523773040512:0@lo:250:mount.lustre.0 00000020:01000004:3.0:1788639227.201653:0:17220:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788639227.201663:0:17220:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788639227.201687:0:17220:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9ae3691c8000) 00000020:00000080:3.0:1788639227.201705:0:17220:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788639227.215436:0:17220:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788639227.215823:0:17220:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788639227.215830:0:17220:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788639227.219093:0:17220:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788639227.219105:0:17220:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788639227.219473:0:17220:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788639227.219479:0:17220:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788639227.222134:0:17220:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788639227.222315:0:17220:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788639227.222321:0:17220:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788639227.224272:0:17220:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788639227.224284:0:17220:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788639227.275095:0:17220:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788639227.275306:0:17220:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788639227.275320:0:17220:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788639227.277280:0:17220:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788639227.277291:0:17220:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788639227.282562:0:17220:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788639227.283146:0:17220:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788639227.283153:0:17220:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788639227.293590:0:17220:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788639227.293636:0:17220:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788639227.294610:0:17220:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788639227.295029:0:17220:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788639227.295034:0:17220:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788639227.295958:0:17220:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788639227.296037:0:17220:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788639227.298460:0:17220:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788639227.299100:0:17220:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788639227.299107:0:17220:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788639227.300062:0:17220:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788639227.300072:0:17220:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788639227.378132:0:17220:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788639227.378339:0:17220:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788639227.378346:0:17220:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788639227.380458:0:17220:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788639227.380471:0:17220:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788639227.385265:0:17220:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788639227.385280:0:17220:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788639227.391404:0:17220:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788639227.391442:0:17220:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788639227.391457:0:17220:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.118@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788639227.391557:0:17220:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.118@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788639227.391599:0:17220:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.118@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788639227.391603:0:17220:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788639227.391604:0:17220:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788639227.391605:0:17220:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788639227.391606:0:17220:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788639227.391608:0:17220:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788639227.391609:0:17220:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788639227.391610:0:17220:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788639227.391612:0:17220:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788639227.391634:0:17220:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788639227.391636:0:17220:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788639227.391645:0:17220:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788639227.391647:0:17220:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788639227.391648:0:17220:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788639227.391649:0:17220:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788639227.391650:0:17220:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788639227.391651:0:17220:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788639227.391652:0:17220:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788639227.391652:0:17220:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788639227.391653:0:17220:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788639227.391654:0:17220:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788639227.391655:0:17220:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788639227.391688:0:17220:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788639227.391708:0:17220:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17220:1875523773040640:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788639227.391782:0:17220:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639227.391846:0:17220:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2438173c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788639227.392021:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773040640 00000100:00100000:2.0:1788639227.392030:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773040640 00000100:00100000:2.0:1788639227.392076:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788639227.392086:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243176850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+5:17220:x1875523773040640:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788639227.392132:0:17236:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788639227.392135:0:17236:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788639227.392138:0:17236:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788639227.392573:0:17256:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788639227.393185:0:17236:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:2.0:1788639227.395403:0:17257:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788639227.395411:0:17257:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1788639227.395414:0:17257:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788639227.395417:0:17257:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788639227.395816:0:17257:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1788639227.396035:0:17236:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788639227.396048:0:17236:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788639227.397998:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243176850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+5:17220:x1875523773040640:12345-0@lo:253:mount.lustre.0 Request processed in 5905us (6207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639227.398017:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788639227.398119:0:17220:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17220:1875523773040640:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788639227.398135:0:17220:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788639227.398139:0:17220:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788639227.398141:0:17220:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788639227.398142:0:17220:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788639227.398143:0:17220:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788639227.398144:0:17220:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788639227.398145:0:17220:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788639227.398147:0:17220:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788639227.398148:0:17220:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788639227.398150:0:17220:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788639227.398151:0:17220:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788639227.398182:0:17220:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ae243aeb000 from lustre-MDT0000 10000000:01000000:2.0:1788639227.398214:0:17220:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788639227.398217:0:17220:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788639227.398222:0:17220:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9ae3691c99c0 10000000:01000000:2.0:1788639227.398227:0:17220:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788639227.398235:0:17220:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ae3691c99c0 from 1 10000000:01000000:2.0:1788639227.398238:0:17220:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788639227.398277:0:17220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b400/0x25c454990262d259 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639227.398289:0:17220:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b400/0x25c454990262d259 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639227.398299:0:17220:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b400/0x25c454990262d259 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639227.398320:0:17220:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f3ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17220:1875523773040768:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788639227.398357:0:17220:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639227.398504:0:17220:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344253180 going to sleep for 11 seconds 00000100:00100000:0.0:1788639227.399804:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773040768 00000100:00100000:0.0:1788639227.399813:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773040768 00000100:00100000:0.0:1788639227.399926:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788639227.399936:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243175c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+5:17220:x1875523773040768:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788639227.399950:0:17235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639227.399969:0:17235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae375ef5a00/0x25c454990262d260 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262d259 expref: -99 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639227.399994:0:17235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae375ef5a00/0x25c454990262d260 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262d259 expref: 6 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639227.400006:0:17235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae375ef5a00/0x25c454990262d260 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262d259 expref: 6 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639227.400015:0:17235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375ef5a00, rc 0) 00000100:00100000:0.0:1788639227.400081:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243175c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+6:17220:x1875523773040768:12345-0@lo:101:mount.lustre.0 Request processed in 146us (1723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639227.400102:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788639227.400182:0:17220:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f3ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17220:1875523773040768:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788639227.400199:0:17220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b400/0x25c454990262d259 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d260 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639227.400208:0:17220:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b400/0x25c454990262d259 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262d260 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639227.400273:0:17220:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f3ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17220:1875523773040896:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788639227.400303:0:17220:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639227.400856:0:17220:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344253180 going to sleep for 11 seconds 00000100:00100000:3.0:1788639227.402730:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773040896 00000100:00100000:3.0:1788639227.402745:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773040896 00000100:00100000:0.0:1788639227.403256:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788639227.403274:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243176050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+6:17220:x1875523773040896:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788639227.403707:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243176050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+6:17220:x1875523773040896:12345-0@lo:501:mount.lustre.0 Request processed in 440us (3400us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788639227.403715:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788639227.403978:0:17220:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f3ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17220:1875523773040896:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788639227.404017:0:17220:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788639227.404039:0:17220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b400/0x25c454990262d259 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d260 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639227.404048:0:17220:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b400/0x25c454990262d259 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d260 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788639227.404056:0:17220:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ae243aeb000 10000000:01000000:2.0:1788639227.404061:0:17220:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788639227.404065:0:17220:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ae243aeb000 10000000:01000000:2.0:1788639227.404068:0:17220:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788639227.404071:0:17220:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9ae243aeb000 from 1 10000000:01000000:2.0:1788639227.404073:0:17220:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788639227.404102:0:17220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78ba00/0x25c454990262d267 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639227.404110:0:17220:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae37f78ba00/0x25c454990262d267 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639227.404119:0:17220:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae37f78ba00/0x25c454990262d267 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639227.404137:0:17220:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f3ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17220:1875523773041024:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788639227.404172:0:17220:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639227.404266:0:17220:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344253180 going to sleep for 11 seconds 00000100:00100000:3.0:1788639227.404296:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773041024 00000100:00100000:3.0:1788639227.404301:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773041024 00000100:00100000:3.0:1788639227.404364:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788639227.404381:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243176c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+6:17220:x1875523773041024:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788639227.404390:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639227.404407:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae2421f8e00/0x25c454990262d26e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262d267 expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639227.404427:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae2421f8e00/0x25c454990262d26e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262d267 expref: 7 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639227.404456:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae2421f8e00/0x25c454990262d26e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262d267 expref: 7 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639227.404465:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f8e00, rc 0) 00000100:00100000:3.0:1788639227.404516:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243176c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+7:17220:x1875523773041024:12345-0@lo:101:mount.lustre.0 Request processed in 136us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639227.404521:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788639227.404578:0:17220:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f3ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17220:1875523773041024:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788639227.404590:0:17220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae37f78ba00/0x25c454990262d267 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d26e expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639227.404609:0:17220:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae37f78ba00/0x25c454990262d267 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262d26e expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788639227.404644:0:17220:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788639227.404664:0:17220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78ba00/0x25c454990262d267 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d26e expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639227.404672:0:17220:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae37f78ba00/0x25c454990262d267 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d26e expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788639227.404686:0:17220:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788639227.404690:0:17220:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788639227.404694:0:17220:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ae243aeb000 10000000:01000000:2.0:1788639227.404697:0:17220:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788639227.404700:0:17220:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788639227.404702:0:17220:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788639227.404718:0:17220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a400/0x25c454990262d275 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639227.404724:0:17220:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a400/0x25c454990262d275 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639227.404731:0:17220:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a400/0x25c454990262d275 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639227.404742:0:17220:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f3ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17220:1875523773041152:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788639227.404768:0:17220:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639227.405221:0:17220:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344253180 going to sleep for 11 seconds 00000100:00100000:0.0:1788639227.405309:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773041152 00000100:00100000:0.0:1788639227.405314:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773041152 00000100:00100000:0.0:1788639227.405345:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788639227.405353:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243177850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+7:17220:x1875523773041152:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788639227.405362:0:17235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639227.405447:0:17235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae375ef4e00/0x25c454990262d27c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262d275 expref: -99 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639227.405477:0:17235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae375ef4e00/0x25c454990262d27c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262d275 expref: 8 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639227.405488:0:17235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae375ef4e00/0x25c454990262d27c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262d275 expref: 8 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639227.405495:0:17235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375ef4e00, rc 0) 00000100:00100000:0.0:1788639227.405541:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243177850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+8:17220:x1875523773041152:12345-0@lo:101:mount.lustre.0 Request processed in 189us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639227.405547:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788639227.405707:0:17220:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f3ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17220:1875523773041152:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788639227.405721:0:17220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a400/0x25c454990262d275 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d27c expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639227.405729:0:17220:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a400/0x25c454990262d275 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262d27c expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639227.405788:0:17220:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f3ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17220:1875523773041280:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788639227.405815:0:17220:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639227.405832:0:17220:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344253180 going to sleep for 11 seconds 00000100:00100000:0.0:1788639227.405949:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773041280 00000100:00100000:0.0:1788639227.405953:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773041280 00000100:00100000:0.0:1788639227.405973:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788639227.405989:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+8:17220:x1875523773041280:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788639227.406121:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+9:17220:x1875523773041280:12345-0@lo:501:mount.lustre.0 Request processed in 133us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639227.406127:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788639227.406193:0:17220:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f3ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17220:1875523773041280:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788639227.406218:0:17220:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f3ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17220:1875523773041408:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788639227.406255:0:17220:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639227.406276:0:17220:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344253180 going to sleep for 11 seconds 00000100:00100000:0.0:1788639227.406318:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773041408 00000100:00100000:0.0:1788639227.406323:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773041408 00000100:00100000:0.0:1788639227.406341:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788639227.406347:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243174850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+9:17220:x1875523773041408:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788639227.408425:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243174850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+9:17220:x1875523773041408:12345-0@lo:503:mount.lustre.0 Request processed in 2071us (2162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639227.408440:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788639227.408582:0:17220:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f3ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17220:1875523773041408:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788639227.409119:0:17258:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4d225031-35be-4b74-b245-637fda218215:17258:1875523773041536:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788639227.409185:0:17258:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639227.409223:0:17258:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243817e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788639227.409363:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773041536 00000100:00100000:2.0:1788639227.409379:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773041536 00000100:00100000:2.0:1788639227.409420:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788639227.409429:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243177c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+9:17258:x1875523773041536:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788639227.410167:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243177c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+9:17258:x1875523773041536:12345-0@lo:502:llog_process_th.0 Request processed in 736us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639227.410175:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788639227.410271:0:17258:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4d225031-35be-4b74-b245-637fda218215:17258:1875523773041536:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788639227.410301:0:17258:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788639227.410311:0:17258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788639227.410313:0:17258:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788639227.410319:0:17258:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788639227.410323:0:17258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788639227.410338:0:17258:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9ae3691ccd40) 00000020:00000080:3.0:1788639227.410354:0:17258:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788639227.410360:0:17258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788639227.410501:0:17258:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788639227.410509:0:17258:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x25c454990262d28a 00000020:00000080:3.0:1788639227.410816:0:17258:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788639227.410821:0:17258:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788639227.410824:0:17258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788639227.410826:0:17258:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788639227.410829:0:17258:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788639227.410840:0:17258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788639227.410841:0:17258:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788639227.410845:0:17258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788639227.410853:0:17258:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9ae375c5cd40) 00000020:00000080:3.0:1788639227.410874:0:17258:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788639227.410880:0:17258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788639227.410882:0:17258:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788639227.410884:0:17258:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788639227.410890:0:17258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788639227.410938:0:17258:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ae243aeb000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788639227.410950:0:17258:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9ae375c599c0) 00000020:00000080:3.0:1788639227.410958:0:17258:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788639227.411018:0:17258:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788639227.411024:0:17258:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x25c454990262d29f 00000020:00000080:3.0:1788639227.411114:0:17258:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788639227.411121:0:17258:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788639227.411126:0:17258:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x25c454990262d2a6 00080000:01000000:3.0:1788639227.411131:0:17258:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788639227.411135:0:17258:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x25c454990262d2ad 00010000:00010000:2.0:1788639227.486993:0:17258:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788639227.487445:0:17258:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967529 00000001:00080000:2.0:1788639227.487834:0:17258:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788639227.488290:0:17258:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9ae241ee4d40) 00000020:00000080:2.0:1788639227.488309:0:17258:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788639227.489795:0:17258:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788639227.489809:0:17258:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x25c454990262d2bb 00000020:00000080:0.0:1788639227.490402:0:17258:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788639227.500257:0:17258:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x25c454990262d2c2 00000020:00000080:1.0:1788639227.500893:0:17258:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788639227.500906:0:17258:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788639227.500913:0:17258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788639227.500914:0:17258:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788639227.500917:0:17258:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788639227.500920:0:17258:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1788639227.500921:0:17258:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788639227.500923:0:17258:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788639227.500924:0:17258:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788639227.500926:0:17258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788639227.500928:0:17258:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788639227.500930:0:17258:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788639227.500934:0:17258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788639227.500935:0:17258:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788639227.500939:0:17258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788639227.500978:0:17258:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788639227.501005:0:17258:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788639227.501009:0:17258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788639227.501010:0:17258:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788639227.501012:0:17258:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788639227.501015:0:17258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788639227.501017:0:17258:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788639227.501019:0:17258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788639227.501024:0:17258:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.118@tcp to nid 0x20000c0a8ce76 (192.168.206.118@tcp) 00000020:00000080:1.0:1788639227.501048:0:17258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788639227.501062:0:17258:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9ae37f71b380) 00000020:00000080:1.0:1788639227.501075:0:17258:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788639227.501080:0:17258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788639227.501131:0:17258:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788639227.501137:0:17258:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788639227.501143:0:17258:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x25c454990262d2d0 00010000:00080000:1.0:1788639227.501173:0:17258:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ae36ddee000@lustre-MDT0001-osp-MDT0000: add connection 192.168.206.118@tcp at head 00010000:00010000:1.0:1788639227.505292:0:17258:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1788639227.506391:0:17258:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788639227.506404:0:17258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788639227.506440:0:17258:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788639227.506459:0:17258:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x25c454990262d2d7 00000100:00080000:2.0:1788639227.506469:0:17258:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788639227.506475:0:17258:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ae36ddee000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788639227.506508:0:17258:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae375f39180 x1875523773041664/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788639227.506540:0:17258:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1788639227.506658:0:17258:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788639227.506664:0:17258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639227.506666:0:17258:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788639227.506668:0:17258:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788639227.506671:0:17258:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1788639227.506673:0:17258:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788639227.506675:0:17258:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788639227.506676:0:17258:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788639227.506691:0:17258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639227.506692:0:17258:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788639227.506695:0:17258:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788639227.506700:0:17258:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788639227.506703:0:17258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639227.506704:0:17258:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788639227.506706:0:17258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788639227.506710:0:17258:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.118@tcp to nid 0x20000c0a8ce76 (192.168.206.118@tcp) 00000020:01000000:2.0:1788639227.506734:0:17258:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788639227.506743:0:17258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788639227.506756:0:17258:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9ae241ee0000) 00000020:00000080:2.0:1788639227.506769:0:17258:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788639227.506775:0:17258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788639227.506829:0:17258:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788639227.506835:0:17258:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788639227.506840:0:17258:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x25c454990262d2e5 00010000:00080000:2.0:1788639227.506887:0:17258:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ae36ddef800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.118@tcp at head 00010000:00010000:2.0:1788639227.507094:0:17258:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:0.0:1788639227.507984:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773041664:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788639227.508049:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639227.508126:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773041664 00000100:00100000:0.0:1788639227.508134:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773041664 00000100:00100000:0.0:1788639227.508163:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788639227.508170:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875523773041664:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1788639227.508186:0:17245:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788639227.508229:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875523773041664:12345-0@lo:38:llog_process_th.0 Request processed in 58us (179us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788639227.508237:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788639227.508278:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae36ddee000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788639227.508284:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788639227.508287:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773041664:0@lo:38:llog_process_th.0 00000040:01000000:2.0:1788639227.508530:0:17258:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788639227.509043:0:17258:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788639227.512587:0:17258:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788639227.513069:0:17258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788639227.517288:0:17258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788639227.518042:0:17264:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788639227.518047:0:17264:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788639227.518975:0:17258:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788639227.518989:0:17258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788639227.519027:0:17258:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788639227.519048:0:17258:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x25c454990262d2ec 00000100:00080000:2.0:1788639227.519058:0:17258:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788639227.519065:0:17258:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ae36ddef800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788639227.519100:0:17258:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae375f3b100 x1875523773041792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788639227.519151:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773041792:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788639227.519205:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875523773041792 offset 0 length 520: 4 00000100:00080000:2.0:1788639227.519257:0:17258:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788639227.519358:0:17258:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788639227.519362:0:17258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639227.519364:0:17258:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788639227.519448:0:17258:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788639227.519450:0:17258:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1788639227.519452:0:17258:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788639227.519453:0:17258:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788639227.519454:0:17258:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788639227.519468:0:17258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639227.519470:0:17258:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788639227.519473:0:17258:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788639227.519477:0:17258:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788639227.519480:0:17258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639227.519481:0:17258:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788639227.519484:0:17258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788639227.519487:0:17258:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.118@tcp to nid 0x20000c0a8ce76 (192.168.206.118@tcp) 00000020:01000000:2.0:1788639227.519506:0:17258:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788639227.519508:0:17258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788639227.519521:0:17258:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9ae241ee3380) 00000020:00000080:2.0:1788639227.519533:0:17258:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1788639227.519538:0:17258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788639227.519611:0:17258:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788639227.519641:0:17258:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788639227.519648:0:17258:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x25c454990262d2fa 00010000:00080000:2.0:1788639227.519675:0:17258:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ae375cad000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.118@tcp at head 00010000:00010000:2.0:1788639227.519968:0:17258:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1788639227.520034:0:17258:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788639227.520050:0:17258:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788639227.522002:0:17258:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788639227.522251:0:17258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1788639227.522429:0:17258:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1788639227.522946:0:17266:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788639227.522951:0:17266:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788639227.523597:0:17258:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788639227.523609:0:17258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788639227.523838:0:17258:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788639227.523858:0:17258:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x25c454990262d301 00000100:00080000:2.0:1788639227.523880:0:17258:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788639227.523885:0:17258:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ae375cad000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788639227.523919:0:17258:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae375f3b480 x1875523773041920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788639227.523992:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773041920:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788639227.524048:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875523773041920 offset 0 length 520: 4 00000100:00080000:2.0:1788639227.524104:0:17258:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788639227.524293:0:17258:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788639227.524298:0:17258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639227.524300:0:17258:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788639227.524303:0:17258:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788639227.524307:0:17258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639227.524309:0:17258:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788639227.524312:0:17258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788639227.524313:0:17258:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788639227.524316:0:17258:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788639227.524318:0:17258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639227.524319:0:17258:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788639227.524322:0:17258:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788639227.524324:0:17258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639227.524325:0:17258:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788639227.524329:0:17258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788639227.524356:0:17258:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f39500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4d225031-35be-4b74-b245-637fda218215:17258:1875523773042048:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788639227.524556:0:17258:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639227.524583:0:17258:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae370fe43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788639227.524659:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773042048 00000100:00100000:0.0:1788639227.524666:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773042048 00000100:00100000:0.0:1788639227.524804:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788639227.524813:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243174450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+9:17258:x1875523773042048:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788639227.524955:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243174450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+9:17258:x1875523773042048:12345-0@lo:502:llog_process_th.0 Request processed in 143us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639227.524963:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788639227.525059:0:17258:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f39500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4d225031-35be-4b74-b245-637fda218215:17258:1875523773042048:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788639227.525084:0:17258:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788639227.525088:0:17258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788639227.525090:0:17258:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788639227.525095:0:17258:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1788639227.525275:0:17220:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1788639227.525298:0:17220:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788639227.525322:0:17220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a400/0x25c454990262d275 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d27c expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639227.525332:0:17220:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a400/0x25c454990262d275 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d27c expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788639227.525340:0:17220:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ae243aeb000 from 1 10000000:01000000:2.0:1788639227.525342:0:17220:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788639227.525439:0:17220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a200/0x25c454990262d308 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639227.525453:0:17220:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a200/0x25c454990262d308 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639227.525462:0:17220:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a200/0x25c454990262d308 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639227.525478:0:17220:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f38e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17220:1875523773042176:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788639227.525508:0:17220:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639227.525574:0:17220:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae370fe4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788639227.525889:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773042176 00000100:00100000:3.0:1788639227.525895:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773042176 00000100:00100000:3.0:1788639227.525957:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788639227.525966:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243177050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+9:17220:x1875523773042176:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788639227.525976:0:17236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639227.525996:0:17236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae2421f9000/0x25c454990262d30f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262d308 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639227.526017:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae2421f9000/0x25c454990262d30f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262d308 expref: 10 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639227.526028:0:17236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae2421f9000/0x25c454990262d30f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262d308 expref: 10 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639227.526036:0:17236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f9000, rc 0) 00000100:00100000:3.0:1788639227.526082:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243177050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+10:17220:x1875523773042176:12345-0@lo:101:mount.lustre.0 Request processed in 117us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639227.526088:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788639227.526145:0:17220:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f38e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17220:1875523773042176:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788639227.526159:0:17220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a200/0x25c454990262d308 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d30f expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639227.526168:0:17220:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a200/0x25c454990262d308 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262d30f expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639227.526766:0:17220:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f38e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17220:1875523773042304:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788639227.526807:0:17220:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639227.527142:0:17220:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae370fe4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788639227.527209:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773042304 00000100:00100000:0.0:1788639227.527215:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773042304 00000100:00100000:0.0:1788639227.527244:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788639227.527252:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+10:17220:x1875523773042304:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788639227.527268:0:17235:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788639227.527274:0:17235:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788639227.527351:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+10:17220:x1875523773042304:12345-0@lo:256:mount.lustre.0 Request processed in 99us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639227.527357:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788639227.527503:0:17220:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f38e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17220:1875523773042304:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788639227.528128:0:17220:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788639227.528141:0:17220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a200/0x25c454990262d308 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d30f expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639227.528152:0:17220:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a200/0x25c454990262d308 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d30f expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788639227.529959:0:17220:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae243aeb000 from 1 10000000:01000000:2.0:1788639227.529963:0:17220:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788639227.530003:0:17220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a800/0x25c454990262d316 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639227.530011:0:17220:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a800/0x25c454990262d316 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639227.530021:0:17220:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a800/0x25c454990262d316 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639227.530043:0:17220:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f38e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17220:1875523773042432:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788639227.530104:0:17220:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639227.530147:0:17220:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae370fe4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788639227.530279:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773042432 00000100:00100000:0.0:1788639227.530286:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773042432 00000100:00100000:0.0:1788639227.530328:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788639227.530337:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+10:17220:x1875523773042432:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788639227.530349:0:17235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639227.530374:0:17235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae375ef5800/0x25c454990262d31d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262d316 expref: -99 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639227.530399:0:17235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae375ef5800/0x25c454990262d31d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262d316 expref: 11 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639227.530429:0:17235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae375ef5800/0x25c454990262d31d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262d316 expref: 11 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639227.530437:0:17235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375ef5800, rc 0) 00000100:00100000:0.0:1788639227.530474:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+11:17220:x1875523773042432:12345-0@lo:101:mount.lustre.0 Request processed in 139us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639227.530481:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788639227.530645:0:17220:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f38e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17220:1875523773042432:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788639227.530660:0:17220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a800/0x25c454990262d316 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d31d expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639227.530670:0:17220:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a800/0x25c454990262d316 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262d31d expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639227.530797:0:17220:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f38e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17220:1875523773042560:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788639227.530823:0:17220:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639227.530841:0:17220:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae370fe4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788639227.530895:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773042560 00000100:00100000:3.0:1788639227.530900:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773042560 00000100:00100000:3.0:1788639227.530925:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788639227.530932:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+11:17220:x1875523773042560:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788639227.531062:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+11:17220:x1875523773042560:12345-0@lo:501:mount.lustre.0 Request processed in 130us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639227.531068:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788639227.531135:0:17220:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f38e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17220:1875523773042560:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788639227.531163:0:17220:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f38e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17220:1875523773042688:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788639227.531208:0:17220:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639227.531228:0:17220:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae370fe4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788639227.531272:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773042688 00000100:00100000:0.0:1788639227.531276:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773042688 00000100:00100000:0.0:1788639227.531300:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788639227.531307:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+11:17220:x1875523773042688:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788639227.531393:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+11:17220:x1875523773042688:12345-0@lo:503:mount.lustre.0 Request processed in 86us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639227.531400:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788639227.531526:0:17220:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f38e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17220:1875523773042688:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788639227.532058:0:17268:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f38e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4d225031-35be-4b74-b245-637fda218215:17268:1875523773042816:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788639227.532092:0:17268:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639227.532122:0:17268:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae370fe43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788639227.532163:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773042816 00000100:00100000:0.0:1788639227.532168:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773042816 00000100:00100000:0.0:1788639227.532199:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788639227.532207:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+11:17268:x1875523773042816:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788639227.532958:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+11:17268:x1875523773042816:12345-0@lo:502:llog_process_th.0 Request processed in 750us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639227.532967:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788639227.533121:0:17268:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f38e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4d225031-35be-4b74-b245-637fda218215:17268:1875523773042816:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788639227.533152:0:17268:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788639227.533161:0:17268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639227.533164:0:17268:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788639227.533170:0:17268:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ae243aeb000 00000020:00000080:2.0:1788639227.533174:0:17268:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788639227.533182:0:17268:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788639227.533184:0:17268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639227.533186:0:17268:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788639227.533188:0:17268:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788639227.533191:0:17268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639227.533193:0:17268:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788639227.533196:0:17268:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ae243aeb000 00000020:00000080:2.0:1788639227.533198:0:17268:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788639227.533290:0:17268:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788639227.533293:0:17268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639227.533295:0:17268:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788639227.533297:0:17268:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788639227.533299:0:17268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639227.533301:0:17268:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788639227.533304:0:17268:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ae243aeb000 00000020:00000080:2.0:1788639227.533306:0:17268:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788639227.534479:0:17268:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788639227.534486:0:17268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639227.534493:0:17268:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788639227.534496:0:17268:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788639227.534499:0:17268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639227.534500:0:17268:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788639227.534503:0:17268:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ae243aeb000 00000020:00000080:2.0:1788639227.534505:0:17268:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788639227.534567:0:17268:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f38e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4d225031-35be-4b74-b245-637fda218215:17268:1875523773042944:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788639227.534644:0:17268:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639227.534815:0:17268:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae370fe43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788639227.536314:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773042944 00000100:00100000:1.0:1788639227.536326:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773042944 00000100:00100000:1.0:1788639227.536376:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788639227.536385:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+11:17268:x1875523773042944:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788639227.536638:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+11:17268:x1875523773042944:12345-0@lo:502:llog_process_th.0 Request processed in 252us (1993us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639227.536646:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788639227.537185:0:17268:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f38e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4d225031-35be-4b74-b245-637fda218215:17268:1875523773042944:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788639227.537219:0:17268:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788639227.537226:0:17268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639227.537229:0:17268:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788639227.537233:0:17268:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788639227.537478:0:17220:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788639227.537500:0:17220:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788639227.537771:0:17220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a800/0x25c454990262d316 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d31d expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639227.537789:0:17220:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a800/0x25c454990262d316 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d31d expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788639227.537840:0:17220:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788639227.537844:0:17220:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ae243aeb000 10000000:01000000:1.0:1788639227.537847:0:17220:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ae243aeb000 10000000:01000000:1.0:1788639227.537850:0:17220:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788639227.537855:0:17220:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ae243aeb000 from 1 10000000:01000000:1.0:1788639227.537858:0:17220:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788639227.537899:0:17220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262d324 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639227.537907:0:17220:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262d324 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639227.537916:0:17220:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262d324 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639227.537936:0:17220:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244124e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17220:1875523773043072:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788639227.537980:0:17220:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639227.538012:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773043072 00000100:00100000:1.0:1788639227.538017:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773043072 00000100:00100000:1.0:1788639227.538048:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788639227.538056:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+11:17220:x1875523773043072:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788639227.538066:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639227.538080:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae3750fae00/0x25c454990262d32b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262d324 expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639227.538112:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae3750fae00/0x25c454990262d32b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262d324 expref: 12 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639227.538123:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae3750fae00/0x25c454990262d32b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262d324 expref: 12 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639227.538132:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fae00, rc 0) 00000100:00100000:1.0:1788639227.538161:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+12:17220:x1875523773043072:12345-0@lo:101:mount.lustre.0 Request processed in 106us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639227.538167:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788639227.538208:0:17220:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae342c283c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788639227.538224:0:17220:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244124e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17220:1875523773043072:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788639227.538236:0:17220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262d324 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d32b expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639227.538245:0:17220:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262d324 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262d32b expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639227.538292:0:17220:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244124e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17220:1875523773043200:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788639227.538316:0:17220:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639227.538330:0:17220:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae342c283c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788639227.538364:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773043200 00000100:00100000:1.0:1788639227.538448:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773043200 00000100:00100000:1.0:1788639227.538474:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788639227.538480:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+12:17220:x1875523773043200:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788639227.538585:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+12:17220:x1875523773043200:12345-0@lo:501:mount.lustre.0 Request processed in 104us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639227.538597:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788639227.538655:0:17220:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244124e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17220:1875523773043200:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788639227.538763:0:17220:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244124e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17220:1875523773043328:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788639227.538803:0:17220:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639227.538826:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773043328 00000100:00100000:1.0:1788639227.538830:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773043328 00000100:00100000:1.0:1788639227.538853:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788639227.538859:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+12:17220:x1875523773043328:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788639227.538953:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+12:17220:x1875523773043328:12345-0@lo:503:mount.lustre.0 Request processed in 93us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639227.538959:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788639227.538992:0:17220:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae342c283c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788639227.539004:0:17220:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244124e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17220:1875523773043328:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788639227.540057:0:17271:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244124e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4d225031-35be-4b74-b245-637fda218215:17271:1875523773043456:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788639227.540109:0:17271:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639227.540135:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773043456 00000100:00100000:1.0:1788639227.540140:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773043456 00000100:00100000:1.0:1788639227.540166:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788639227.540173:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+12:17271:x1875523773043456:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788639227.540262:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+12:17271:x1875523773043456:12345-0@lo:502:llog_process_th.0 Request processed in 89us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639227.540269:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788639227.540312:0:17271:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae342c28600 going to sleep for 11 seconds 00000100:00100000:1.0:1788639227.540326:0:17271:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244124e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4d225031-35be-4b74-b245-637fda218215:17271:1875523773043456:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788639227.540451:0:17271:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788639227.540466:0:17271:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9ae37f718000) 00000020:00000080:1.0:1788639227.540485:0:17271:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1788639227.540567:0:17271:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ae243aeb000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788639227.540571:0:17271:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ae243aeb000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788639227.540573:0:17271:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ae243aeb000 4 00010000:00080000:1.0:1788639227.540600:0:17271:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ae3506eb000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.118@tcp at head 00010000:00010000:1.0:1788639227.546974:0:17271:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1788639227.547149:0:17271:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788639227.547195:0:17271:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788639227.547210:0:17271:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x25c454990262d339 00000100:00080000:1.0:1788639227.547220:0:17271:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788639227.547226:0:17271:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9ae3506eb000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:1.0:1788639227.547261:0:17271:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae244124e00 x1875523773043584/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788639227.547290:0:17271:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788639227.549835:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875523773043584:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788639227.549919:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639227.551151:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773043584 00000100:00100000:2.0:1788639227.551161:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773043584 00000100:00100000:2.0:1788639227.551208:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788639227.551217:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875523773043584:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788639227.551302:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875523773043584:12345-0@lo:38:llog_process_th.0 Request processed in 84us (1382us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788639227.551309:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788639227.551527:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788639227.551536:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae3506eb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788639227.551546:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788639227.551550:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875523773043584:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788639227.562946:0:17271:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244126300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4d225031-35be-4b74-b245-637fda218215:17271:1875523773043712:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788639227.563024:0:17271:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639227.563067:0:17271:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae342c28b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788639227.563092:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773043712 00000100:00100000:1.0:1788639227.563099:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773043712 00000100:00100000:1.0:1788639227.563139:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788639227.563147:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+12:17271:x1875523773043712:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788639227.563260:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+12:17271:x1875523773043712:12345-0@lo:502:llog_process_th.0 Request processed in 113us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639227.563267:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788639227.563320:0:17271:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244126300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4d225031-35be-4b74-b245-637fda218215:17271:1875523773043712:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788639227.563541:0:17271:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244126300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4d225031-35be-4b74-b245-637fda218215:17271:1875523773043840:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788639227.563579:0:17271:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639227.563595:0:17271:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae350c4fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788639227.563608:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773043840 00000100:00100000:1.0:1788639227.563612:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773043840 00000100:00100000:1.0:1788639227.563670:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788639227.563752:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+12:17271:x1875523773043840:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788639227.563828:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+12:17271:x1875523773043840:12345-0@lo:502:llog_process_th.0 Request processed in 151us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639227.563834:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788639227.563896:0:17271:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244126300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4d225031-35be-4b74-b245-637fda218215:17271:1875523773043840:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788639227.563917:0:17271:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788639227.564116:0:17220:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788639227.564135:0:17220:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788639227.564151:0:17220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262d324 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d32b expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639227.564161:0:17220:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb800/0x25c454990262d324 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d32b expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788639227.564204:0:17220:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788639227.564206:0:17220:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788639227.564207:0:17220:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788639227.564209:0:17220:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788639227.564210:0:17220:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788639227.564211:0:17220:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788639227.564212:0:17220:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788639227.564214:0:17220:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788639227.564215:0:17220:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788639227.564222:0:17220:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788639227.564225:0:17220:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1788639227.564227:0:17220:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788639227.564229:0:17220:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788639227.564230:0:17220:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788639227.564231:0:17220:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788639227.564232:0:17220:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788639227.564233:0:17220:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788639227.564234:0:17220:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788639227.564234:0:17220:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788639227.564236:0:17220:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788639227.564236:0:17220:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788639227.564250:0:17220:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788639227.564261:0:17220:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244126300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17220:1875523773043968:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788639227.564291:0:17220:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639227.564305:0:17220:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae350c4fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788639227.564324:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773043968 00000100:00100000:1.0:1788639227.564328:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773043968 00000100:00100000:1.0:1788639227.564350:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788639227.564356:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+12:17220:x1875523773043968:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788639227.565610:0:17233:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788639227.565640:0:17233:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788639227.567926:0:17233:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788639227.567945:0:17233:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788639227.568202:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+12:17220:x1875523773043968:12345-0@lo:253:mount.lustre.0 Request processed in 3842us (3906us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639227.568214:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788639227.568276:0:17220:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244126300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17220:1875523773043968:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788639227.568289:0:17220:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788639227.568292:0:17220:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788639227.568293:0:17220:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788639227.568295:0:17220:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 20000000:01000000:0.0:1788639227.568460:0:17256:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788639227.568465:0:17256:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788639227.568486:0:17256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ae375ef5200/0x25c454990262d340 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639227.568501:0:17256:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae2421f9000/0x25c454990262d30f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262d308 expref: 11 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639227.568509:0:17256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ae375ef5200/0x25c454990262d340 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639227.568546:0:17256:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae2421f9000/0x25c454990262d30f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262d308 expref: 11 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639227.568577:0:17256:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae2421f9000/0x25c454990262d30f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262d308 expref: 11 pid: 17236 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639227.568591:0:17256:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17256:1875523773044096:0@lo:104: 00000100:00100000:0.0:1788639227.568654:0:17256:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639227.568806:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773044096 00000100:00100000:3.0:1788639227.568813:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773044096 00000020:01000004:1.0:1788639227.569163:0:17220:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788639227.569164:0:17220:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788639227.569166:0:17220:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788639227.569167:0:17220:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788639227.569169:0:17220:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788639227.569171:0:17220:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788639227.569172:0:17220:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788639227.569189:0:17220:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788639227.570551:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788639227.570567:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4d225031-35be-4b74-b245-637fda218215+3:17256:x1875523773044096:12345-0@lo:104: 00010000:00010000:2.0:1788639227.570584:0:17224:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a200/0x25c454990262d308 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262d30f expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639227.570761:0:17224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788639227.570768:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4d225031-35be-4b74-b245-637fda218215+3:17256:x1875523773044096:12345-0@lo:104: Request processed in 207us (2114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639227.570789:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788639227.570859:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788639227.570876:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a200/0x25c454990262d308 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262d30f expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639227.570883:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78a200 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:3.0:1788639227.570887:0:17230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a200/0x25c454990262d308 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262d30f expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639227.570905:0:17230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a200/0x25c454990262d308 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262d30f expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788639227.570911:0:17230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a200/0x25c454990262d308 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262d30f expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639227.570917:0:17230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788639227.570960:0:17230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a200/0x25c454990262d308 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262d30f expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639227.570968:0:17230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788639227.570993:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a200/0x25c454990262d308 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262d30f expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639227.571000:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a200/0x25c454990262d308 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262d30f expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639227.571017:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639227.571019:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639227.571021:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639227.571048:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788639227.571060:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4d225031-35be-4b74-b245-637fda218215:3644:1875523773044224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788639227.571095:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639227.571825:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773044224 00000100:00100000:2.0:1788639227.571833:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773044224 00010000:00010000:2.0:1788639227.571871:0:17226:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae2421f9000/0x25c454990262d30f lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262d308 expref: 12 pid: 17236 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639227.571902:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788639227.571911:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d225031-35be-4b74-b245-637fda218215+12:3644:x1875523773044224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788639227.571922:0:17226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788639227.571928:0:17226:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae2421f9000/0x25c454990262d30f lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262d308 expref: 12 pid: 17236 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639227.571940:0:17226:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae2421f9000/0x25c454990262d30f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262d308 expref: 12 pid: 17236 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639227.571959:0:17226:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ae375ef5200/0x25c454990262d340 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639227.571967:0:17226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae375ef5200/0x25c454990262d340 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788639227.571982:0:17226:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003517559s 00010000:00010000:2.0:1788639227.571986:0:17226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae375ef5200/0x25c454990262d340 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639227.571994:0:17226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae375ef5200/0x25c454990262d340 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639227.572000:0:17226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ae375ef5200/0x25c454990262d340 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639227.572020:0:17226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ae375ef5200/0x25c454990262d340 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639227.572024:0:17226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef5200 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:2.0:1788639227.572028:0:17226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ae375ef5200/0x25c454990262d340 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639227.572036:0:17226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ae375ef5200/0x25c454990262d340 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639227.572045:0:17226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ae375ef5200/0x25c454990262d340 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639227.572054:0:17226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788639227.572094:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d225031-35be-4b74-b245-637fda218215+12:3644:x1875523773044224:12345-0@lo:103:ldlm_bl.0 Request processed in 185us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639227.572101:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788639227.573492:0:17256:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae38007d900 going to sleep for 11 seconds 00010000:00010000:0.0:1788639227.573533:0:17256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae2421f9000/0x25c454990262d30f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262d308 expref: 11 pid: 17236 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639227.573550:0:17256:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17256:1875523773044096:0@lo:104: 00010000:00010000:0.0:1788639227.573572:0:17256:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ae375ef5200/0x25c454990262d340 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639227.573586:0:17256:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ae375ef5200/0x25c454990262d340 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639227.573606:0:17256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ae375ef5200/0x25c454990262d340 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639227.573613:0:17256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae375ef5200/0x25c454990262d340 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639227.577498:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4d225031-35be-4b74-b245-637fda218215:3644:1875523773044224:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1788639227.586490:0:17220:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1788639227.592144:0:17220:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788639227.592338:0:17278:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1788639227.592342:0:17278:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1788639227.592507:0:17280:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788639227.592798:0:17220:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1788639227.593101:0:17280:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1788639227.594112:0:17220:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788639227.594160:0:17220:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788639227.594576:0:17220:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788639227.594583:0:17220:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788639227.594655:0:17220:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788639227.595600:0:17220:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788639227.596159:0:17220:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788639227.596190:0:17220:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000100:00080000:1.0:1788639227.596454:0:17281:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9ae244126300 x1875523773044352/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639227.596466:0:17281:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243259900 going to sleep for 0 seconds 00000040:00080000:2.0:1788639227.600179:0:17280:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788639227.600263:0:17280:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:1.0:1788639227.602018:0:17220:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:1.0:1788639227.603029:0:17220:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:0.0:1788639227.608853:0:17220:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1788639227.610419:0:17220:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788639227.610454:0:17220:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaea581c67988 00100000:10000000:0.0:1788639227.610463:0:17220:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788639227.611446:0:17220:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788639227.611464:0:17220:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.118@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788639227.611481:0:17220:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788639227.611500:0:17220:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1788639227.637547:0:17220:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788639227.637874:0:17220:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788639228.212875:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788639228.597366:0:17279:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788639228.597375:0:17279:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1788639228.599044:0:17281:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243259900 going to sleep for 0 seconds 00000040:00080000:3.0:1788639228.604098:0:17279:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1788639228.604122:0:17279:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:2.0:1788639228.983680:0:17238:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788639228.983687:0:17238:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ae243aeb000 from 7 10000000:01000000:2.0:1788639228.983692:0:17238:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788639228.983730:0:17238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78aa00/0x25c454990262d347 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639228.983751:0:17238:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae37f78aa00/0x25c454990262d347 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639228.983761:0:17238:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae37f78aa00/0x25c454990262d347 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639228.983783:0:17238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773044480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788639228.983845:0:17238:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639228.983907:0:17238:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae34b06a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788639228.983946:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773044480 00000100:00100000:3.0:1788639228.983954:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773044480 00000100:00100000:3.0:1788639228.983999:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788639228.984008:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+11:17238:x1875523773044480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788639228.984020:0:17235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639228.984033:0:17235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae2421f8600/0x25c454990262d34e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262d347 expref: -99 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639228.984054:0:17235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae2421f8600/0x25c454990262d34e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262d347 expref: 12 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639228.984063:0:17235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae2421f8600/0x25c454990262d34e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262d347 expref: 12 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639228.984071:0:17235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f8600, rc 0) 00000100:00100000:3.0:1788639228.984121:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+12:17238:x1875523773044480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639228.984128:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788639228.984176:0:17238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773044480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788639228.984190:0:17238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae37f78aa00/0x25c454990262d347 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d34e expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639228.984200:0:17238:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae37f78aa00/0x25c454990262d347 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262d34e expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639228.984247:0:17238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773044608:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788639228.984275:0:17238:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639228.984301:0:17238:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae34b06a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788639228.984340:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773044608 00000100:00100000:0.0:1788639228.984344:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773044608 00000100:00100000:0.0:1788639228.984408:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788639228.984417:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+12:17238:x1875523773044608:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788639228.984430:0:17233:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788639228.984445:0:17233:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788639228.984448:0:17233:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1788639228.984527:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+12:17238:x1875523773044608:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 111us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639228.984534:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788639228.984592:0:17238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773044608:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788639228.984649:0:17238:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788639228.984655:0:17238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78aa00/0x25c454990262d347 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d34e expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639228.984674:0:17238:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae37f78aa00/0x25c454990262d347 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d34e expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639229.237142:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788639229.620840:0:17279:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788639229.620849:0:17279:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788639229.620995:0:17279:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1788639229.621035:0:17279:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788639229.621186:0:17279:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00000100:00100000:1.0:1788639229.623738:0:17281:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243259900 going to sleep for 0 seconds 00010000:00010000:2.0:1788639230.261795:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639230.645235:0:17281:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243259900 going to sleep for 0 seconds 00010000:00010000:1.0:1788639231.285455:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788639231.578199:0:17525:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg618-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788639231.670058:0:17281:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243259900 going to sleep for 0 seconds 00010000:00010000:3.0:1788639232.310648:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788639232.389041:0:17577:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788639232.389236:0:17577:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788639232.692882:0:17281:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243259900 going to sleep for 0 seconds 00000100:00080000:3.0:1788639232.694300:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788639232.694306:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788639232.694310:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ae36ddee000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788639232.694330:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 486 00000100:00080000:3.0:1788639232.694335:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788639232.694350:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ae36ddee000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:3.0:1788639232.694374:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae24233d500 x1875523773044864/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788639232.694389:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788639232.694392:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788639232.694394:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788639232.694397:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788639232.694399:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788639232.694402:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788639232.694403:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ae3506eb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788639232.694408:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9ae3506eb000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:3.0:1788639232.694418:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae24233e300 x1875523773044992/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788639232.694447:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4d225031-35be-4b74-b245-637fda218215:3644:1875523773044736:0@lo:400:kworker.0 00000100:00100000:3.0:1788639232.694515:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639232.694585:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773044736 00000100:00100000:3.0:1788639232.694592:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773044736 00000100:00100000:3.0:1788639232.694652:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788639232.695218:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773044864:0@lo:38:kworker.0 00000100:00100000:0.0:1788639232.695259:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639232.695294:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875523773044992:0@lo:38:kworker.0 00000100:00100000:1.0:1788639232.695310:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+12:3644:x1875523773044736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639232.695329:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639232.695372:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+12:3644:x1875523773044736:12345-0@lo:400:kworker.0 Request processed in 310us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639232.695380:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788639232.695380:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773044992 00000100:00100000:0.0:1788639232.695384:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773044992 00000100:00100000:0.0:1788639232.695405:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788639232.695410:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875523773044992:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788639232.695421:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4d225031-35be-4b74-b245-637fda218215:3644:1875523773044736:0@lo:400:kworker.0 00010000:00080000:0.0:1788639232.695430:0:17242:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 491 last 0 00000020:00000080:0.0:1788639232.695462:0:17242:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x25c454990262d355 00000004:00100000:0.0:1788639232.695477:0:17242:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1788639232.695543:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773044864 00000100:00100000:3.0:1788639232.695547:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773044864 00000100:00100000:3.0:1788639232.695575:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788639232.695580:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875523773044864:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788639232.695591:0:17245:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1788639232.695605:0:17242:0:(import.c:65:import_set_state_nolock()) ffff9ae3490b0800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788639232.695661:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875523773044992:12345-0@lo:38:kworker.0 Request processed in 249us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639232.695667:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788639232.695695:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ae24233e300 x1875523773044992/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788639242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788639232.695708:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788639232.695714:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788639232.695718:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788639232.695720:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae3506eb000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788639232.695725:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875523773044992:0@lo:38:kworker.0 00000100:00100000:2.0:1788639232.727388:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875523773044864:12345-0@lo:38:kworker.0 Request processed in 31800us (32122us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788639232.727407:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788639232.728964:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae36ddee000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788639232.728974:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788639232.728980:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773044864:0@lo:38:kworker.0 00000020:00000004:1.0:1788639233.159957:0:17627:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788639233.160141:0:17627:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788639233.335911:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639233.719417:0:17281:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243259900 going to sleep for 0 seconds 00010000:00010000:3.0:1788639234.357146:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639234.741970:0:17281:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243259900 going to sleep for 0 seconds 00010000:00010000:1.0:1788639235.381969:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639235.768432:0:17281:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243259900 going to sleep for 0 seconds 00010000:00010000:3.0:1788639236.410736:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639236.793789:0:17281:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243259900 going to sleep for 0 seconds 00010000:00010000:1.0:1788639237.431257:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788639237.812775:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788639237.812784:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788639237.812789:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ae36ddee000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788639237.812801:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 491 00000100:00080000:3.0:1788639237.812818:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788639237.812826:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ae36ddee000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:3.0:1788639237.812856:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae24233c000 x1875523773045248/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788639237.812871:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788639237.812875:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788639237.812878:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788639237.812881:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788639237.813275:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788639227/real 1788639227] req@ffff9ae375f3b480 x1875523773041920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788639237 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639237.813319:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ae375f3b480 x1875523773041920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788639237 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639237.813333:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788639227/real 1788639227] req@ffff9ae375f3b100 x1875523773041792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788639237 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639237.813356:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ae375f3b100 x1875523773041792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788639237 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639237.813386:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773045248:0@lo:38:kworker.0 00000100:00100000:3.0:1788639237.813479:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788639237.813593:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae375cad000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788639237.813936:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788639237.813941:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773041920:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788639237.813947:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae36ddef800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788639237.813954:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788639237.813957:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773041792:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788639237.814390:0:17281:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243259900 going to sleep for 0 seconds 00000100:00100000:3.0:1788639237.814391:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4d225031-35be-4b74-b245-637fda218215:3641:1875523773045120:0@lo:400:kworker.0 00000100:00100000:3.0:1788639237.814460:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639237.814465:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773045248 00000100:00100000:2.0:1788639237.814478:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773045248 00000100:00100000:2.0:1788639237.814542:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788639237.814548:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788639237.814556:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875523773045248:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788639237.814567:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875523773045376:0@lo:400:kworker.0 00010000:00020000:2.0:1788639237.814583:0:17246:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788639237.814863:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639237.814918:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773045120 00000100:00100000:1.0:1788639237.814919:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773045376 00000100:00100000:1.0:1788639237.814926:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773045376 00000100:00100000:0.0:1788639237.814926:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773045120 00000100:00100000:1.0:1788639237.814975:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788639237.814975:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788639237.814984:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875523773045376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639237.814985:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+12:3641:x1875523773045120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639237.815079:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875523773045376:12345-0@lo:400:kworker.0 Request processed in 96us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639237.815079:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+12:3641:x1875523773045120:12345-0@lo:400:kworker.0 Request processed in 96us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639237.815090:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788639237.815090:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1788639237.815113:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ae24233f480 x1875523773045376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639237.815129:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875523773045376:0@lo:400:kworker.0 00000100:00100000:3.0:1788639237.815155:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4d225031-35be-4b74-b245-637fda218215:3641:1875523773045120:0@lo:400:kworker.0 00000100:00080000:0.0:1788639237.815173:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788639237.815180:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788639237.815184:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ae36ddef800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788639237.815189:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 486 00000100:00080000:0.0:1788639237.815194:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788639237.815199:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ae36ddef800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:0.0:1788639237.815233:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae2438cc700 x1875523773045504/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788639237.815308:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788639237.815312:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788639237.815313:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ae375cad000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788639237.815316:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 486 00000100:00080000:0.0:1788639237.815319:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788639237.815323:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ae375cad000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:0.0:1788639237.815338:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae2438cfb80 x1875523773045632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788639237.816519:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773045504:0@lo:8:kworker.0 00000400:00000100:3.0:1788639237.816573:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875523773045504 offset 0 length 520: 4 00000100:00100000:3.0:1788639237.816610:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773045632:0@lo:8:kworker.0 00000400:00000100:3.0:1788639237.816698:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875523773045632 offset 0 length 520: 4 00000100:00100000:2.0:1788639237.838932:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875523773045248:12345-0@lo:38:kworker.0 Request processed in 24371us (25451us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788639237.838951:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788639237.839043:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae36ddee000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788639237.839050:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788639237.839055:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773045248:0@lo:38:kworker.0 00010000:00010000:3.0:1788639238.459054:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639238.837730:0:17281:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243259900 going to sleep for 0 seconds 00000020:01000004:3.0:1788639239.091209:0:17972:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788639239.091214:0:17972:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788639239.091220:0:17972:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788639239.091418:0:17972:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ae34303d000 00000020:01000004:3.0:1788639239.091432:0:17972:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1788639239.091445:0:17972:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788639239.091459:0:17972:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9ae375c58000) 00000020:00000080:3.0:1788639239.091476:0:17972:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788639239.156066:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788639239.156957:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1788639239.157959:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1788639239.158380:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788639239.159080:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788639239.159392:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788639239.159708:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1788639239.159909:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1788639239.160077:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788639239.160415:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1788639239.161703:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1788639239.162378:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788639239.162932:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788639239.166169:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788639239.166872:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788639239.167115:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788639239.167366:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1788639239.167597:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1788639239.168513:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1788639239.168924:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788639239.169338:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788639239.169608:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788639239.169938:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1788639239.170259:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788639239.170524:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788639239.170818:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788639239.171015:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788639239.171262:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788639239.171500:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1788639239.171781:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788639239.172385:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1788639239.172678:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788639239.172863:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788639239.173105:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788639239.174554:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788639239.175036:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788639239.175265:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1788639239.175515:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788639239.175793:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1788639239.176001:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788639239.176236:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788639239.176448:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788639239.178792:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788639239.179084:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1788639239.179383:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788639239.179698:0:17972:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:3.0:1788639239.182078:0:17972:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788639239.182403:0:17972:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1788639239.182414:0:17972:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788639239.182426:0:17972:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x25c454990262d363 00000020:01000004:3.0:1788639239.182433:0:17972:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788639239.182454:0:17972:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.118@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788639239.182467:0:17972:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.118@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788639239.182473:0:17972:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1788639239.182500:0:17972:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1788639239.182504:0:17972:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.118@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1788639239.186184:0:17972:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.118@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788639239.186227:0:17972:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.206.118@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1788639239.186231:0:17972:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788639239.186233:0:17972:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788639239.186234:0:17972:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788639239.186235:0:17972:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788639239.186236:0:17972:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788639239.186237:0:17972:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788639239.186238:0:17972:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788639239.186239:0:17972:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788639239.186240:0:17972:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788639239.186244:0:17972:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1788639239.186245:0:17972:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788639239.186247:0:17972:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788639239.186248:0:17972:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788639239.186249:0:17972:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788639239.186249:0:17972:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788639239.186250:0:17972:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788639239.186251:0:17972:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788639239.186252:0:17972:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788639239.186253:0:17972:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788639239.186278:0:17972:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788639239.186296:0:17972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17972:1875523773045760:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788639239.186415:0:17972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639239.186555:0:17972:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae34a92d300 going to sleep for 11 seconds 00000100:00100000:2.0:1788639239.186711:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773045760 00000100:00100000:2.0:1788639239.186718:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773045760 00000100:00100000:2.0:1788639239.186854:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788639239.186863:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+12:17972:x1875523773045760:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788639239.186893:0:17236:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788639239.186896:0:17236:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1788639239.186902:0:17236:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1788639239.187186:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+12:17972:x1875523773045760:12345-0@lo:253:mount.lustre.0 Request processed in 323us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639239.187193:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788639239.187259:0:17972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17972:1875523773045760:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788639239.187270:0:17972:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788639239.187273:0:17972:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788639239.187274:0:17972:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788639239.187276:0:17972:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788639239.187277:0:17972:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788639239.187287:0:17972:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788639239.187288:0:17972:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788639239.187289:0:17972:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788639239.187291:0:17972:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788639239.187292:0:17972:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788639239.187319:0:17972:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ae34303d000 from lustre-MDT0001 10000000:01000000:3.0:1788639239.187343:0:17972:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1788639239.187346:0:17972:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788639239.187352:0:17972:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ae3691c99c0 local copy 00010000:00010000:3.0:1788639239.187361:0:17972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b400/0x25c454990262d259 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d260 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639239.187431:0:17972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17972:1875523773045888:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788639239.187456:0:17972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639239.187734:0:17972:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788639239.192989:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773045888 00000100:00100000:1.0:1788639239.193004:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773045888 00000100:00100000:1.0:1788639239.193068:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788639239.193078:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+12:17972:x1875523773045888:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788639239.193222:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+12:17972:x1875523773045888:12345-0@lo:501:mount.lustre.0 Request processed in 145us (5764us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788639239.193230:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788639239.193430:0:17972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17972:1875523773045888:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788639239.193451:0:17972:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.118@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788639239.193474:0:17972:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.118@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788639239.193482:0:17972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b400/0x25c454990262d259 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d260 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639239.193491:0:17972:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b400/0x25c454990262d259 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d260 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639239.193518:0:17972:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ae34303d000 10000000:01000000:3.0:1788639239.193522:0:17972:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788639239.193527:0:17972:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9ae3691c99c0 10000000:01000000:3.0:1788639239.193529:0:17972:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788639239.193532:0:17972:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9ae3691c99c0 from 1 10000000:01000000:3.0:1788639239.193535:0:17972:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788639239.193562:0:17972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9400/0x25c454990262d36a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639239.193717:0:17972:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9400/0x25c454990262d36a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639239.193727:0:17972:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9400/0x25c454990262d36a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639239.193745:0:17972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17972:1875523773046016:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788639239.193777:0:17972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639239.193813:0:17972:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788639239.193869:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773046016 00000100:00100000:1.0:1788639239.193874:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773046016 00000100:00100000:1.0:1788639239.193893:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788639239.193900:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+12:17972:x1875523773046016:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788639239.193909:0:17235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639239.193921:0:17235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae3750fbc00/0x25c454990262d371 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262d36a expref: -99 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639239.193940:0:17235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae3750fbc00/0x25c454990262d371 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262d36a expref: 13 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639239.193951:0:17235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae3750fbc00/0x25c454990262d371 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262d36a expref: 13 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639239.193959:0:17235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fbc00, rc 0) 00000100:00100000:1.0:1788639239.193995:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+13:17972:x1875523773046016:12345-0@lo:101:mount.lustre.0 Request processed in 95us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639239.194001:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788639239.194071:0:17972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17972:1875523773046016:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788639239.194082:0:17972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9400/0x25c454990262d36a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d371 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639239.194091:0:17972:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9400/0x25c454990262d36a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262d371 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639239.194104:0:17972:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788639239.194119:0:17972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9400/0x25c454990262d36a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d371 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639239.194126:0:17972:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9400/0x25c454990262d36a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d371 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639239.194140:0:17972:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ae34303d000 10000000:01000000:3.0:1788639239.194143:0:17972:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788639239.194146:0:17972:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9ae34303d000 from 1 10000000:01000000:3.0:1788639239.194148:0:17972:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788639239.194167:0:17972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9c00/0x25c454990262d378 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639239.194173:0:17972:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9c00/0x25c454990262d378 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639239.194179:0:17972:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9c00/0x25c454990262d378 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639239.194189:0:17972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17972:1875523773046144:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788639239.194210:0:17972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639239.194220:0:17972:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788639239.194314:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773046144 00000100:00100000:1.0:1788639239.194319:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773046144 00000100:00100000:1.0:1788639239.194339:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788639239.194352:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+13:17972:x1875523773046144:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788639239.194359:0:17235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639239.194367:0:17235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae3750fa800/0x25c454990262d37f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262d378 expref: -99 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639239.194378:0:17235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae3750fa800/0x25c454990262d37f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262d378 expref: 14 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639239.194385:0:17235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae3750fa800/0x25c454990262d37f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262d378 expref: 14 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639239.194391:0:17235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fa800, rc 0) 00000100:00100000:1.0:1788639239.194423:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+14:17972:x1875523773046144:12345-0@lo:101:mount.lustre.0 Request processed in 72us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639239.194428:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788639239.194555:0:17972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17972:1875523773046144:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788639239.194566:0:17972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9c00/0x25c454990262d378 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d37f expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639239.194573:0:17972:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9c00/0x25c454990262d378 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262d37f expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639239.194593:0:17972:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788639239.194603:0:17972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9c00/0x25c454990262d378 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d37f expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639239.194609:0:17972:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9c00/0x25c454990262d378 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d37f expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639239.194634:0:17972:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788639239.194637:0:17972:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788639239.194641:0:17972:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ae34303d000 10000000:01000000:3.0:1788639239.194648:0:17972:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788639239.194651:0:17972:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1788639239.194653:0:17972:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788639239.194666:0:17972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9e00/0x25c454990262d386 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639239.194671:0:17972:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9e00/0x25c454990262d386 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639239.194678:0:17972:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9e00/0x25c454990262d386 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639239.194688:0:17972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17972:1875523773046272:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788639239.194709:0:17972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639239.194726:0:17972:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788639239.194833:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773046272 00000100:00100000:1.0:1788639239.194837:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773046272 00000100:00100000:1.0:1788639239.194853:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788639239.194858:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+14:17972:x1875523773046272:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788639239.194863:0:17235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639239.194870:0:17235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae3750fa000/0x25c454990262d38d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262d386 expref: -99 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639239.194881:0:17235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae3750fa000/0x25c454990262d38d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262d386 expref: 15 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639239.194887:0:17235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae3750fa000/0x25c454990262d38d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262d386 expref: 15 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639239.194902:0:17235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fa000, rc 0) 00000100:00100000:1.0:1788639239.194934:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+15:17972:x1875523773046272:12345-0@lo:101:mount.lustre.0 Request processed in 76us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639239.194939:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788639239.195000:0:17972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17972:1875523773046272:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788639239.195009:0:17972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9e00/0x25c454990262d386 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d38d expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639239.195016:0:17972:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9e00/0x25c454990262d386 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262d38d expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788639239.197109:0:17972:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:3.0:1788639239.198026:0:17972:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788639239.207941:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788639239.207993:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1788639239.208004:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1788639239.208016:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1788639239.208027:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:0.0:1788639239.208036:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:0.0:1788639239.208046:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:0.0:1788639239.208067:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1788639239.208082:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1788639239.208093:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:0.0:1788639239.208106:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:0.0:1788639239.208120:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:0.0:1788639239.208145:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:0.0:1788639239.208159:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1788639239.208171:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1788639239.208184:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:0.0:1788639239.208196:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1788639239.208208:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1788639239.208219:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:0.0:1788639239.208232:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1788639239.208244:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1788639239.208257:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1788639239.208270:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1788639239.208298:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:0.0:1788639239.208303:0:17972:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:0.0:1788639239.208402:0:17972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17972:1875523773046400:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788639239.208464:0:17972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639239.208511:0:17972:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2423510c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788639239.208839:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773046400 00000100:00100000:2.0:1788639239.208853:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773046400 00000100:00100000:2.0:1788639239.208906:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788639239.208915:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+15:17972:x1875523773046400:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788639239.209107:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+15:17972:x1875523773046400:12345-0@lo:501:mount.lustre.0 Request processed in 193us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639239.209115:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788639239.209202:0:17972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17972:1875523773046400:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788639239.209238:0:17972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17972:1875523773046528:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788639239.209279:0:17972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639239.209319:0:17972:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235a900 going to sleep for 11 seconds 00000100:00100000:1.0:1788639239.209376:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773046528 00000100:00100000:1.0:1788639239.209381:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773046528 00000100:00100000:1.0:1788639239.209415:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788639239.209422:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+15:17972:x1875523773046528:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788639239.210140:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+15:17972:x1875523773046528:12345-0@lo:503:mount.lustre.0 Request processed in 716us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639239.210147:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788639239.210633:0:17972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17972:1875523773046528:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788639239.211026:0:17972:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788639239.211104:0:17972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17972:1875523773046656:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788639239.211153:0:17972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639239.211180:0:17972:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788639239.211452:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773046656 00000100:00100000:2.0:1788639239.211457:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773046656 00000100:00100000:2.0:1788639239.211485:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788639239.211492:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+15:17972:x1875523773046656:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788639239.212259:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+15:17972:x1875523773046656:12345-0@lo:502:mount.lustre.0 Request processed in 763us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639239.212267:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788639239.212442:0:17972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17972:1875523773046656:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788639239.212855:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788639239.212882:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:3.0:1788639239.212892:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:3.0:1788639239.212902:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:3.0:1788639239.212911:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:3.0:1788639239.212921:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:3.0:1788639239.212931:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:3.0:1788639239.212942:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:3.0:1788639239.212952:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:3.0:1788639239.212961:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:3.0:1788639239.212970:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:3.0:1788639239.212979:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:3.0:1788639239.212988:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:3.0:1788639239.212997:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:3.0:1788639239.213006:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:3.0:1788639239.213015:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:3.0:1788639239.213024:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:3.0:1788639239.213034:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:3.0:1788639239.213043:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:3.0:1788639239.213053:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:3.0:1788639239.213064:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:3.0:1788639239.213076:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:3.0:1788639239.213087:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:3.0:1788639239.213098:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:3.0:1788639239.213122:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:3.0:1788639239.213138:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:3.0:1788639239.213150:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:3.0:1788639239.213163:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:3.0:1788639239.213175:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:3.0:1788639239.213188:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:3.0:1788639239.213198:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:3.0:1788639239.213207:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:3.0:1788639239.213216:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:3.0:1788639239.213227:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:3.0:1788639239.213237:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:3.0:1788639239.213246:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:3.0:1788639239.213256:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:3.0:1788639239.213266:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:3.0:1788639239.213280:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:3.0:1788639239.213291:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:3.0:1788639239.214353:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:3.0:1788639239.214406:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:3.0:1788639239.214417:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:3.0:1788639239.214427:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:3.0:1788639239.214468:0:17972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17972:1875523773046784:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788639239.214548:0:17972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639239.214719:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773046784 00000100:00100000:1.0:1788639239.214726:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773046784 00000100:00100000:1.0:1788639239.214771:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788639239.214779:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+15:17972:x1875523773046784:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788639239.214970:0:17972:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788639239.215996:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+15:17972:x1875523773046784:12345-0@lo:502:mount.lustre.0 Request processed in 1213us (1444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639239.216006:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788639239.216102:0:17972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17972:1875523773046784:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788639239.216179:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:3.0:1788639239.216193:0:17972:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1788639239.217443:0:17976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788639239.217455:0:17976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788639239.217457:0:17976:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788639239.217466:0:17976:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1788639239.217468:0:17976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788639239.217481:0:17976:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9ae242f43380) 00000020:00000080:0.0:1788639239.217500:0:17976:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1788639239.217504:0:17976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788639239.217699:0:17976:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788639239.217709:0:17976:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x25c454990262d39b 00000020:00000080:0.0:1788639239.217929:0:17976:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788639239.217942:0:17976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788639239.217946:0:17976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788639239.217948:0:17976:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788639239.217951:0:17976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788639239.217955:0:17976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788639239.217957:0:17976:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1788639239.217960:0:17976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788639239.217967:0:17976:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9ae242f44d40) 00000020:00000080:0.0:1788639239.217979:0:17976:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1788639239.217983:0:17976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788639239.217985:0:17976:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1788639239.217988:0:17976:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1788639239.217993:0:17976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788639239.218052:0:17976:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ae34303d000 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1788639239.218065:0:17976:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9ae242f40000) 00000020:00000080:0.0:1788639239.218073:0:17976:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1788639239.218121:0:17976:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788639239.218127:0:17976:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x25c454990262d3b0 00000020:00000080:0.0:1788639239.218217:0:17976:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1788639239.218224:0:17976:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788639239.218227:0:17976:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x25c454990262d3b7 00080000:01000000:0.0:1788639239.218231:0:17976:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788639239.218234:0:17976:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x25c454990262d3be 00010000:00010000:2.0:1788639239.396271:0:17976:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1788639239.397897:0:17976:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1788639239.401584:0:17976:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788639239.402927:0:17976:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1788639239.402938:0:17976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788639239.402944:0:17976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788639239.402946:0:17976:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1788639239.402949:0:17976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788639239.402955:0:17976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788639239.402956:0:17976:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1788639239.402959:0:17976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788639239.402969:0:17976:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.118@tcp to nid 0x20000c0a8ce76 (192.168.206.118@tcp) 00000020:00000080:1.0:1788639239.402995:0:17976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788639239.403010:0:17976:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9ae37f71cd40) 00000020:00000080:1.0:1788639239.403032:0:17976:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1788639239.403039:0:17976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788639239.403113:0:17976:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1788639239.403120:0:17976:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788639239.403127:0:17976:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x25c454990262d3cc 00010000:00080000:1.0:1788639239.403159:0:17976:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ae375c2e000@lustre-MDT0000-osp-MDT0001: add connection 192.168.206.118@tcp at head 00010000:00010000:1.0:1788639239.408137:0:17976:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1788639239.411026:0:17976:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788639239.411042:0:17976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788639239.411080:0:17976:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788639239.411101:0:17976:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x25c454990262d3d3 00000100:00080000:2.0:1788639239.411111:0:17976:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788639239.411117:0:17976:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9ae375c2e000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788639239.411150:0:17976:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae375f3a300 x1875523773046912/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788639239.411175:0:17976:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1788639239.411229:0:17976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788639239.411233:0:17976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639239.411242:0:17976:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1788639239.411246:0:17976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788639239.411249:0:17976:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788639239.411250:0:17976:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788639239.411252:0:17976:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788639239.411253:0:17976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788639239.411256:0:17976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639239.411257:0:17976:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788639239.411260:0:17976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788639239.411264:0:17976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639239.411266:0:17976:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1788639239.411269:0:17976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788639239.411299:0:17976:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788639239.411312:0:17976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788639239.411315:0:17976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639239.411316:0:17976:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1788639239.411319:0:17976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788639239.411320:0:17976:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:2.0:1788639239.411322:0:17976:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788639239.411323:0:17976:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788639239.411324:0:17976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788639239.411327:0:17976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639239.411339:0:17976:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788639239.411343:0:17976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788639239.411346:0:17976:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788639239.411350:0:17976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639239.411351:0:17976:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788639239.411354:0:17976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788639239.411423:0:17976:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.118@tcp to nid 0x20000c0a8ce76 (192.168.206.118@tcp) 00000020:01000000:2.0:1788639239.411448:0:17976:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788639239.411451:0:17976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788639239.411462:0:17976:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9ae241ee19c0) 00000100:00100000:3.0:1788639239.411579:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773046912:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788639239.411657:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639239.411725:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773046912 00000100:00100000:3.0:1788639239.411730:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773046912 00000100:00100000:3.0:1788639239.411767:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788639239.411774:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875523773046912:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788639239.411796:0:17245:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 498 last 0 00000020:00000080:3.0:1788639239.411836:0:17245:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x25c454990262d3e1 00000004:00100000:3.0:1788639239.411849:0:17245:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788639239.411855:0:17245:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1788639239.411990:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788639239.411996:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788639239.411999:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ae36ddee000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788639239.412003:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 496 00000100:00080000:1.0:1788639239.412008:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788639239.412012:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ae36ddee000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:1.0:1788639239.412031:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae244124380 x1875523773047040/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788639239.412047:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788639239.412050:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788639239.412052:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788639239.412055:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788639239.412087:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523773047168:0@lo:400:kworker.0 00000100:00100000:1.0:1788639239.412120:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639239.412154:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773047168 00000100:00100000:1.0:1788639239.412158:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773047168 00000100:00100000:1.0:1788639239.412193:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788639239.412200:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523773047168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639239.412241:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523773047168:12345-0@lo:400:kworker.0 Request processed in 41us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639239.412248:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788639239.412280:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ae244127800 x1875523773047168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639239.412294:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523773047168:0@lo:400:kworker.0 00000100:00100000:1.0:1788639239.412315:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244124380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773047040:0@lo:38:kworker.0 00000100:00100000:1.0:1788639239.412353:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639239.416652:0:17246:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1788639239.416664:0:17246:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1788639239.416788:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773047040 00000100:00100000:1.0:1788639239.416796:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773047040 00000100:00100000:1.0:1788639239.416903:0:17981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788639239.416910:0:17981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875523773047040:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788639239.416990:0:17981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875523773047040:12345-0@lo:38:kworker.0 Request processed in 78us (4635us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788639239.416996:0:17981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788639239.417034:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788639239.417042:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae36ddee000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788639239.417046:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788639239.417049:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244124380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773047040:0@lo:38:kworker.0 00000020:00000080:2.0:1788639239.417163:0:17976:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1788639239.417181:0:17976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788639239.417267:0:17976:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1788639239.417275:0:17976:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788639239.417286:0:17976:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x25c454990262d3e8 00010000:00080000:2.0:1788639239.417316:0:17976:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ae36d232000@lustre-OST0000-osc-MDT0001: add connection 192.168.206.118@tcp at head 00010000:00010000:0.0:1788639239.419229:0:17976:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:0.0:1788639239.420910:0:17245:0:(import.c:65:import_set_state_nolock()) ffff9ae346550000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788639239.420995:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1875523773046912:12345-0@lo:38:llog_process_th.0 Request processed in 9218us (9335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639239.421006:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788639239.421056:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788639239.421064:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1788639239.421071:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788639239.421076:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788639239.421087:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae375c2e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788639239.421099:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773046912:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788639239.421250:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773047296:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788639239.421288:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:1.0:1788639239.422011:0:17976:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788639239.422251:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773047296 00000100:00100000:0.0:1788639239.422259:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773047296 00000100:00100000:0.0:1788639239.422351:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788639239.422430:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1875523773047296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788639239.422463:0:17246:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788639239.422690:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1875523773047296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 263us (1400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639239.422698:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000040:01000000:0.0:1788639239.422881:0:17976:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:2.0:1788639239.425917:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773047296:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1788639239.427165:0:17976:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788639239.427392:0:17976:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788639239.427936:0:17976:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:0.0:1788639239.433861:0:17982:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788639239.433870:0:17982:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788639239.434529:0:17976:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788639239.434541:0:17976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788639239.434583:0:17976:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788639239.434608:0:17976:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x25c454990262d3ef 00000100:00080000:2.0:1788639239.434650:0:17976:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788639239.434657:0:17976:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9ae36d232000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788639239.434693:0:17976:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae375f39c00 x1875523773047424/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788639239.434715:0:17976:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788639239.434769:0:17976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788639239.434773:0:17976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639239.434775:0:17976:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788639239.434778:0:17976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788639239.434781:0:17976:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1788639239.434783:0:17976:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788639239.434784:0:17976:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788639239.434785:0:17976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788639239.434788:0:17976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639239.434789:0:17976:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788639239.434791:0:17976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788639239.434795:0:17976:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788639239.434808:0:17976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639239.434809:0:17976:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788639239.434822:0:17976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788639239.434826:0:17976:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.118@tcp to nid 0x20000c0a8ce76 (192.168.206.118@tcp) 00000020:01000000:2.0:1788639239.434847:0:17976:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788639239.434850:0:17976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788639239.434864:0:17976:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9ae36a0e99c0) 00000020:00000080:2.0:1788639239.434876:0:17976:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1788639239.434881:0:17976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788639239.434953:0:17976:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1788639239.434961:0:17976:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788639239.434967:0:17976:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x25c454990262d3fd 00010000:00080000:2.0:1788639239.434997:0:17976:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ae36d235800@lustre-OST0001-osc-MDT0001: add connection 192.168.206.118@tcp at head 00010000:00010000:2.0:1788639239.435208:0:17976:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1788639239.435276:0:17976:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788639239.435290:0:17976:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:3.0:1788639239.435577:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788639239.435582:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788639239.435585:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788639239.435588:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788639239.435712:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773047424:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788639239.435773:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875523773047424 offset 0 length 520: 4 00000040:00080000:3.0:1788639239.440232:0:17976:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788639239.442739:0:17976:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788639239.442926:0:17976:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788639239.444703:0:17984:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788639239.444710:0:17984:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788639239.446043:0:17976:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788639239.446059:0:17976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788639239.446104:0:17976:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788639239.446129:0:17976:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x25c454990262d404 00000100:00080000:3.0:1788639239.446141:0:17976:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788639239.446147:0:17976:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ae36d235800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:3.0:1788639239.446197:0:17976:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae24233f480 x1875523773047552/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788639239.446226:0:17976:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788639239.446284:0:17976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788639239.446288:0:17976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788639239.446290:0:17976:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788639239.446293:0:17976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788639239.446302:0:17976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788639239.446303:0:17976:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788639239.446306:0:17976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788639239.446319:0:17976:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788639239.446323:0:17976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788639239.446326:0:17976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788639239.446327:0:17976:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788639239.446329:0:17976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788639239.446332:0:17976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788639239.446333:0:17976:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788639239.446336:0:17976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788639239.446545:0:17976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788639239.446550:0:17976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788639239.446551:0:17976:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788639239.446555:0:17976:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:3.0:1788639239.446641:0:17972:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1788639239.446670:0:17972:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788639239.446683:0:17972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9e00/0x25c454990262d386 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d38d expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639239.446694:0:17972:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9e00/0x25c454990262d386 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d38d expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639239.446703:0:17972:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ae34303d000 from 1 10000000:01000000:3.0:1788639239.446705:0:17972:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788639239.446728:0:17972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9000/0x25c454990262d40b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639239.446735:0:17972:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9000/0x25c454990262d40b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639239.446745:0:17972:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9000/0x25c454990262d40b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639239.446775:0:17972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17972:1875523773047680:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788639239.446847:0:17972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639239.446880:0:17972:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235a3c0 going to sleep for 11 seconds 00000100:00080000:2.0:1788639239.447010:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788639239.447015:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788639239.447018:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788639239.447021:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788639239.447098:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773047552:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788639239.447135:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875523773047552 offset 0 length 520: 4 00000100:00100000:0.0:1788639239.447252:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773047680 00000100:00100000:0.0:1788639239.447259:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773047680 00000100:00100000:0.0:1788639239.447304:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788639239.447322:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243192050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+15:17972:x1875523773047680:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788639239.447334:0:17236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639239.447346:0:17236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae375ef4a00/0x25c454990262d412 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262d40b expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639239.447996:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae375ef4a00/0x25c454990262d412 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262d40b expref: 16 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639239.448024:0:17236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae375ef4a00/0x25c454990262d412 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262d40b expref: 16 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639239.448032:0:17236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375ef4a00, rc 0) 00000100:00100000:0.0:1788639239.448090:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243192050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+16:17972:x1875523773047680:12345-0@lo:101:mount.lustre.0 Request processed in 778us (1242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639239.448098:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788639239.448215:0:17972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17972:1875523773047680:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788639239.448233:0:17972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9000/0x25c454990262d40b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d412 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639239.448242:0:17972:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9000/0x25c454990262d40b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262d412 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639239.448852:0:17972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17972:1875523773047808:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788639239.448896:0:17972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639239.448925:0:17972:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788639239.449077:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773047808 00000100:00100000:1.0:1788639239.449084:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773047808 00000100:00100000:1.0:1788639239.449128:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788639239.449137:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+16:17972:x1875523773047808:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788639239.449154:0:17233:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788639239.449170:0:17233:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788639239.449174:0:17233:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1788639239.449256:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+16:17972:x1875523773047808:12345-0@lo:256:mount.lustre.0 Request processed in 121us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639239.449263:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788639239.449566:0:17972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17972:1875523773047808:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788639239.450189:0:17972:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788639239.450245:0:17972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9000/0x25c454990262d40b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d412 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639239.450257:0:17972:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9000/0x25c454990262d40b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d412 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639239.450265:0:17972:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae34303d000 from 1 10000000:01000000:3.0:1788639239.450268:0:17972:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788639239.450299:0:17972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8000/0x25c454990262d419 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639239.450318:0:17972:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8000/0x25c454990262d419 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639239.450327:0:17972:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8000/0x25c454990262d419 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639239.450342:0:17972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17972:1875523773047936:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788639239.450599:0:17972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639239.450751:0:17972:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788639239.451168:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773047936 00000100:00100000:0.0:1788639239.451175:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773047936 00000100:00100000:0.0:1788639239.451233:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788639239.451242:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+16:17972:x1875523773047936:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788639239.451253:0:17236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639239.451268:0:17236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae375ef5000/0x25c454990262d420 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262d419 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639239.451292:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae375ef5000/0x25c454990262d420 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262d419 expref: 17 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639239.451311:0:17236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae375ef5000/0x25c454990262d420 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262d419 expref: 17 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639239.451321:0:17236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375ef5000, rc 0) 00000100:00100000:0.0:1788639239.451743:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+17:17972:x1875523773047936:12345-0@lo:101:mount.lustre.0 Request processed in 500us (1142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639239.451750:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788639239.454104:0:17972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17972:1875523773047936:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788639239.454133:0:17972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8000/0x25c454990262d419 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d420 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639239.454145:0:17972:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8000/0x25c454990262d419 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262d420 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788639239.454279:0:17972:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788639239.454533:0:17972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17972:1875523773048064:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788639239.454587:0:17972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639239.454728:0:17972:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788639239.454772:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773048064 00000100:00100000:2.0:1788639239.454779:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773048064 00000100:00100000:2.0:1788639239.454877:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788639239.454887:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+17:17972:x1875523773048064:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788639239.454993:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+17:17972:x1875523773048064:12345-0@lo:501:mount.lustre.0 Request processed in 108us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639239.455001:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788639239.455064:0:17972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17972:1875523773048064:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788639239.455093:0:17972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17972:1875523773048192:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788639239.455136:0:17972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639239.455525:0:17972:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1788639239.455643:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773048192 00000100:00100000:1.0:1788639239.455648:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773048192 00000100:00100000:1.0:1788639239.455677:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788639239.455685:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+17:17972:x1875523773048192:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788639239.455781:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+17:17972:x1875523773048192:12345-0@lo:503:mount.lustre.0 Request processed in 97us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639239.455788:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788639239.455930:0:17972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17972:1875523773048192:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788639239.456311:0:17972:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788639239.456509:0:17972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17972:1875523773048320:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788639239.456552:0:17972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639239.456585:0:17972:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788639239.456657:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773048320 00000100:00100000:2.0:1788639239.456663:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773048320 00000100:00100000:2.0:1788639239.456694:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788639239.456701:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+17:17972:x1875523773048320:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788639239.456786:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+17:17972:x1875523773048320:12345-0@lo:502:mount.lustre.0 Request processed in 86us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639239.456793:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788639239.456849:0:17972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17972:1875523773048320:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788639239.457017:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788639239.457039:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:2.0:1788639239.457053:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:2.0:1788639239.457067:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:2.0:1788639239.457080:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:2.0:1788639239.457095:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:2.0:1788639239.457108:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:2.0:1788639239.457122:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:2.0:1788639239.457135:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788639239.457147:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:2.0:1788639239.457174:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:2.0:1788639239.457198:0:17972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f3b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17972:1875523773048448:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788639239.457232:0:17972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639239.457247:0:17972:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae360f4fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788639239.457262:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773048448 00000100:00100000:2.0:1788639239.457266:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773048448 00000100:00100000:2.0:1788639239.457284:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788639239.457290:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+17:17972:x1875523773048448:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788639239.459171:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+17:17972:x1875523773048448:12345-0@lo:502:mount.lustre.0 Request processed in 1874us (1931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639239.459184:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788639239.460012:0:17972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f3b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17972:1875523773048448:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788639239.460100:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:0.0:1788639239.460123:0:17972:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788639239.460754:0:17986:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788639239.460764:0:17986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788639239.460767:0:17986:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788639239.460773:0:17986:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ae34303d000 00000020:00000080:0.0:1788639239.460776:0:17986:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788639239.460784:0:17986:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788639239.460787:0:17986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788639239.460788:0:17986:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788639239.460791:0:17986:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788639239.460793:0:17986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788639239.460794:0:17986:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788639239.460807:0:17986:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ae34303d000 00000020:00000080:0.0:1788639239.460811:0:17986:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788639239.460873:0:17986:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788639239.460877:0:17986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788639239.460878:0:17986:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788639239.460881:0:17986:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788639239.460884:0:17986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788639239.460885:0:17986:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788639239.460888:0:17986:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ae34303d000 00000020:00000080:0.0:1788639239.460890:0:17986:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788639239.460907:0:17986:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788639239.460910:0:17986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788639239.460912:0:17986:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788639239.460914:0:17986:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788639239.460917:0:17986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788639239.460918:0:17986:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788639239.460921:0:17986:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ae34303d000 00000020:00000080:0.0:1788639239.460923:0:17986:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788639239.460941:0:17986:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788639239.460945:0:17986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788639239.460946:0:17986:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788639239.460948:0:17986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:2.0:1788639239.461137:0:17972:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788639239.461167:0:17972:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788639239.461192:0:17972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8000/0x25c454990262d419 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d420 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639239.461202:0:17972:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8000/0x25c454990262d419 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d420 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788639239.461244:0:17972:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788639239.461247:0:17972:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ae34303d000 10000000:01000000:2.0:1788639239.461249:0:17972:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ae34303d000 10000000:01000000:2.0:1788639239.461253:0:17972:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788639239.461258:0:17972:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ae34303d000 from 1 10000000:01000000:2.0:1788639239.461261:0:17972:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788639239.461294:0:17972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a000/0x25c454990262d427 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639239.461312:0:17972:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a000/0x25c454990262d427 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639239.461323:0:17972:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a000/0x25c454990262d427 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639239.461344:0:17972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17972:1875523773048576:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788639239.461406:0:17972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639239.461444:0:17972:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae360f4fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788639239.461608:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773048576 00000100:00100000:0.0:1788639239.461642:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773048576 00000100:00100000:0.0:1788639239.461684:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788639239.461694:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+17:17972:x1875523773048576:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788639239.461706:0:17236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639239.461720:0:17236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae375ef4600/0x25c454990262d42e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262d427 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639239.461741:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae375ef4600/0x25c454990262d42e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262d427 expref: 18 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639239.461750:0:17236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae375ef4600/0x25c454990262d42e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262d427 expref: 18 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639239.461758:0:17236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375ef4600, rc 0) 00000100:00100000:0.0:1788639239.461792:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+18:17972:x1875523773048576:12345-0@lo:101:mount.lustre.0 Request processed in 101us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639239.461809:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788639239.462913:0:17972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17972:1875523773048576:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788639239.462936:0:17972:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a000/0x25c454990262d427 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d42e expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639239.462947:0:17972:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a000/0x25c454990262d427 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262d42e expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788639239.466660:0:17972:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1788639239.466967:0:17972:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788639239.467148:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788639239.467174:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:2.0:1788639239.467188:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:2.0:1788639239.467202:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:2.0:1788639239.467213:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:2.0:1788639239.467225:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:2.0:1788639239.467237:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:2.0:1788639239.467248:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:2.0:1788639239.467260:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:2.0:1788639239.467274:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:2.0:1788639239.467317:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:2.0:1788639239.467335:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:2.0:1788639239.467348:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:2.0:1788639239.467764:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:2.0:1788639239.467792:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:2.0:1788639239.467825:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:2.0:1788639239.467846:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:2.0:1788639239.467988:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:2.0:1788639239.468003:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:2.0:1788639239.468017:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:2.0:1788639239.468033:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:2.0:1788639239.468047:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:2.0:1788639239.468062:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:2.0:1788639239.468077:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:2.0:1788639239.468093:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:2.0:1788639239.468106:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:2.0:1788639239.468140:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:2.0:1788639239.468157:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:2.0:1788639239.468183:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:2.0:1788639239.468196:0:17972:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1788639239.468280:0:17972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17972:1875523773048704:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788639239.468548:0:17972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639239.468647:0:17972:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae360f4f600 going to sleep for 11 seconds 00000100:00100000:1.0:1788639239.468997:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773048704 00000100:00100000:1.0:1788639239.469006:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773048704 00000100:00100000:1.0:1788639239.469102:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788639239.469113:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+18:17972:x1875523773048704:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788639239.469245:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+18:17972:x1875523773048704:12345-0@lo:501:mount.lustre.0 Request processed in 134us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639239.469253:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788639239.469331:0:17972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17972:1875523773048704:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788639239.469381:0:17972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17972:1875523773048832:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788639239.469424:0:17972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639239.469795:0:17972:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788639239.469834:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773048832 00000100:00100000:2.0:1788639239.469839:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773048832 00000100:00100000:2.0:1788639239.474829:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788639239.474859:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+18:17972:x1875523773048832:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788639239.475022:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+18:17972:x1875523773048832:12345-0@lo:503:mount.lustre.0 Request processed in 180us (5596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639239.475030:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788639239.475972:0:17972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17972:1875523773048832:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788639239.477020:0:17972:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788639239.477136:0:17972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17972:1875523773048960:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788639239.477205:0:17972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639239.477250:0:17972:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788639239.477335:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773048960 00000100:00100000:2.0:1788639239.477342:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773048960 00000100:00100000:2.0:1788639239.477458:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788639239.477468:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+18:17972:x1875523773048960:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788639239.477573:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+18:17972:x1875523773048960:12345-0@lo:502:mount.lustre.0 Request processed in 106us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639239.477580:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:1.0:1788639239.477989:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639239.478161:0:17972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17972:1875523773048960:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788639239.478826:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788639239.479701:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:3.0:1788639239.479722:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:3.0:1788639239.479734:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:3.0:1788639239.480459:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:3.0:1788639239.480633:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:3.0:1788639239.480651:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:3.0:1788639239.480665:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:3.0:1788639239.480677:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:3.0:1788639239.480689:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:3.0:1788639239.480722:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:3.0:1788639239.481447:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:3.0:1788639239.481553:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:3.0:1788639239.481571:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:3.0:1788639239.481585:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:3.0:1788639239.481596:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:3.0:1788639239.481606:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:3.0:1788639239.481642:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:3.0:1788639239.481658:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:3.0:1788639239.481671:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:3.0:1788639239.481684:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:3.0:1788639239.481697:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:3.0:1788639239.481708:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:3.0:1788639239.481719:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:3.0:1788639239.481730:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:3.0:1788639239.482458:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:3.0:1788639239.482585:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:3.0:1788639239.482600:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:3.0:1788639239.482613:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:3.0:1788639239.482649:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:3.0:1788639239.482662:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:3.0:1788639239.482675:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:3.0:1788639239.482687:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:3.0:1788639239.482701:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:3.0:1788639239.482713:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:3.0:1788639239.482724:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:3.0:1788639239.482735:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:3.0:1788639239.483445:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:3.0:1788639239.483737:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:3.0:1788639239.483836:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:3.0:1788639239.483922:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:3.0:1788639239.483943:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:3.0:1788639239.483970:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:3.0:1788639239.483985:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:3.0:1788639239.483997:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:3.0:1788639239.484016:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:3.0:1788639239.484028:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:3.0:1788639239.484041:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:3.0:1788639239.484093:0:17972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17972:1875523773049088:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788639239.484165:0:17972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639239.484216:0:17972:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788639239.484269:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773049088 00000100:00100000:2.0:1788639239.484276:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773049088 00000100:00100000:2.0:1788639239.484341:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788639239.484350:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+18:17972:x1875523773049088:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788639239.485452:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+18:17972:x1875523773049088:12345-0@lo:502:mount.lustre.0 Request processed in 1097us (1281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639239.485464:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788639239.485754:0:17972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17972:1875523773049088:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788639239.485960:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:3.0:1788639239.485986:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:3.0:1788639239.486015:0:17972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17972:1875523773049216:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788639239.486065:0:17972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639239.486103:0:17972:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788639239.486215:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773049216 00000100:00100000:2.0:1788639239.486221:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773049216 00000100:00100000:2.0:1788639239.486261:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788639239.486269:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+18:17972:x1875523773049216:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788639239.486485:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+18:17972:x1875523773049216:12345-0@lo:502:mount.lustre.0 Request processed in 88us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639239.486493:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788639239.488048:0:17972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17972:1875523773049216:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788639239.488262:0:17972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:3.0:1788639239.488277:0:17972:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788639239.495847:0:17991:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1788639239.495865:0:17991:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9ae375c5b380) 00000020:00000080:3.0:1788639239.495888:0:17991:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1788639239.495981:0:17991:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ae34303d000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788639239.495986:0:17991:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ae34303d000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788639239.495989:0:17991:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ae34303d000 3 00010000:00080000:3.0:1788639239.496018:0:17991:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ae2432a2800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.206.118@tcp at head 00010000:00010000:3.0:1788639239.497835:0:17991:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1788639239.498011:0:17991:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1788639239.498049:0:17991:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788639239.498060:0:17991:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x25c454990262d43c 00000100:00080000:3.0:1788639239.498070:0:17991:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788639239.498075:0:17991:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9ae2432a2800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:3.0:1788639239.498116:0:17991:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae24233fb80 x1875523773049344/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788639239.498144:0:17991:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788639239.498468:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875523773049344:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788639239.498540:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639239.498600:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773049344 00000100:00100000:1.0:1788639239.498646:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773049344 00000100:00100000:1.0:1788639239.498679:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788639239.498687:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875523773049344:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788639239.498711:0:17240:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 498 last 0 00000020:00000080:1.0:1788639239.498742:0:17240:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x25c454990262d443 00000004:00100000:1.0:1788639239.498757:0:17240:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788639239.498787:0:17240:0:(import.c:65:import_set_state_nolock()) ffff9ae3506e8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788639239.498924:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875523773049344:12345-0@lo:38:llog_process_th.0 Request processed in 236us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639239.498931:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788639239.498972:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae24233fb80 x1875523773049344/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788639249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639239.498981:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788639239.498988:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1788639239.498994:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788639239.498997:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788639239.499000:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae2432a2800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788639239.499005:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875523773049344:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788639239.504302:0:17991:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:3.0:1788639239.504360:0:17972:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788639239.504392:0:17972:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788639239.504422:0:17972:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a000/0x25c454990262d427 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d42e expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639239.504434:0:17972:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a000/0x25c454990262d427 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d42e expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788639239.504485:0:17972:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788639239.504487:0:17972:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788639239.504489:0:17972:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788639239.504490:0:17972:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788639239.504491:0:17972:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788639239.504493:0:17972:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788639239.504494:0:17972:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788639239.504496:0:17972:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788639239.504497:0:17972:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788639239.504502:0:17972:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1788639239.504504:0:17972:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788639239.504505:0:17972:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788639239.504506:0:17972:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788639239.504507:0:17972:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788639239.504509:0:17972:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788639239.504510:0:17972:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788639239.504511:0:17972:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788639239.504512:0:17972:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788639239.504513:0:17972:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788639239.504536:0:17972:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788639239.504630:0:17972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17972:1875523773049472:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788639239.504691:0:17972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639239.504729:0:17972:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24235ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788639239.504853:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773049472 00000100:00100000:0.0:1788639239.504860:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773049472 00000100:00100000:0.0:1788639239.504902:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788639239.504912:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+18:17972:x1875523773049472:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788639239.504938:0:17233:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788639239.504950:0:17233:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:0.0:1788639239.505474:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788639239.505479:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788639239.505482:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788639239.505484:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000001:00100000:0.0:1788639239.506587:0:17221:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1788639239.506696:0:17233:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788639239.506706:0:17233:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1788639239.506853:0:17256:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788639239.506857:0:17256:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788639239.506876:0:17256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ae375ef4400/0x25c454990262d44a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639239.506892:0:17256:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae2421f8600/0x25c454990262d34e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262d347 expref: 18 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639239.506899:0:17256:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae375ef4a00/0x25c454990262d412 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262d40b expref: 18 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639239.506906:0:17256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ae375ef4400/0x25c454990262d44a lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639239.506937:0:17256:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae375ef4a00/0x25c454990262d412 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262d40b expref: 18 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639239.506952:0:17256:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae375ef4a00/0x25c454990262d412 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262d40b expref: 18 pid: 17236 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639239.506965:0:17256:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cf800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17256:1875523773049600:0@lo:104: 00000100:00100000:0.0:1788639239.507019:0:17256:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639239.507058:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773049600 00000100:00100000:2.0:1788639239.507065:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773049600 00010000:00010000:0.0:1788639239.507066:0:17256:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae2421f8600/0x25c454990262d34e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262d347 expref: 18 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639239.507073:0:17256:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae2421f8600/0x25c454990262d34e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262d347 expref: 18 pid: 17235 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639239.507091:0:17256:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cc380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17256:1875523773049728:0@lo:104: 00000100:00100000:2.0:1788639239.507098:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788639239.507112:0:17256:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639239.507122:0:17256:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344c9ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788639239.507184:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+18:17972:x1875523773049472:12345-0@lo:253:mount.lustre.0 Request processed in 2274us (2492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639239.507193:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788639239.507807:0:17972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:17972:1875523773049472:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788639239.507819:0:17972:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788639239.507822:0:17972:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788639239.507824:0:17972:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788639239.507825:0:17972:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788639239.507826:0:17972:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788639239.507828:0:17972:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788639239.507829:0:17972:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788639239.507830:0:17972:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788639239.507831:0:17972:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788639239.507833:0:17972:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788639239.507846:0:17972:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788639239.508234:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4d225031-35be-4b74-b245-637fda218215+3:17256:x1875523773049600:12345-0@lo:104: 00010000:00010000:2.0:1788639239.508252:0:17225:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9000/0x25c454990262d40b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262d412 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639239.508307:0:17225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788639239.508313:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4d225031-35be-4b74-b245-637fda218215+3:17256:x1875523773049600:12345-0@lo:104: Request processed in 1207us (1294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639239.508320:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788639239.508337:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773049728 00000100:00100000:2.0:1788639239.508341:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773049728 00000100:00100000:2.0:1788639239.508358:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788639239.508366:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4d225031-35be-4b74-b245-637fda218215+3:17256:x1875523773049728:12345-0@lo:104: 00010000:00010000:2.0:1788639239.508374:0:17225:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae37f78aa00/0x25c454990262d347 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262d34e expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639239.508419:0:17225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788639239.508425:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4d225031-35be-4b74-b245-637fda218215+3:17256:x1875523773049728:12345-0@lo:104: Request processed in 60us (1312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639239.508431:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788639239.508463:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788639239.508476:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9000/0x25c454990262d40b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262d412 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639239.508484:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f9000 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:2.0:1788639239.508487:0:17229:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9000/0x25c454990262d40b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262d412 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639239.508496:0:17229:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9000/0x25c454990262d40b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262d412 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788639239.508503:0:17229:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9000/0x25c454990262d40b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262d412 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788639239.508508:0:17229:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788639239.508540:0:17229:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9000/0x25c454990262d40b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262d412 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639239.508546:0:17229:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788639239.508555:0:17256:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cf800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17256:1875523773049600:0@lo:104: 00010000:00010000:2.0:1788639239.508565:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9000/0x25c454990262d40b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262d412 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639239.508565:0:17256:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cc380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17256:1875523773049728:0@lo:104: 00010000:00010000:2.0:1788639239.508572:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae2421f9000/0x25c454990262d40b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262d412 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639239.508583:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639239.508583:0:17256:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ae375ef4400/0x25c454990262d44a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639239.508586:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae37f78aa00/0x25c454990262d347 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262d34e expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639239.508592:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78aa00 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:2.0:1788639239.508595:0:17229:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae37f78aa00/0x25c454990262d347 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262d34e expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639239.508611:0:17229:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae37f78aa00/0x25c454990262d347 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262d34e expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788639239.508638:0:17229:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae37f78aa00/0x25c454990262d347 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262d34e expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788639239.508643:0:17229:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788639239.508659:0:17229:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae37f78aa00/0x25c454990262d347 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262d34e expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639239.508666:0:17229:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788639239.508672:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae37f78aa00/0x25c454990262d347 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262d34e expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639239.508679:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae37f78aa00/0x25c454990262d347 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262d34e expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639239.508693:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639239.508695:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639239.508697:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639239.508705:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639239.508725:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4d225031-35be-4b74-b245-637fda218215:3641:1875523773049856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788639239.508758:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639239.508788:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788639239.508794:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4d225031-35be-4b74-b245-637fda218215:3641:1875523773049984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788639239.508827:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639239.508853:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773049856 00000100:00100000:2.0:1788639239.508856:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773049856 00010000:00010000:2.0:1788639239.508878:0:17226:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae375ef4a00/0x25c454990262d412 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262d40b expref: 18 pid: 17236 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639239.508897:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773049984 00000100:00100000:2.0:1788639239.508900:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773049984 00010000:00010000:2.0:1788639239.508909:0:17226:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae2421f8600/0x25c454990262d34e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262d347 expref: 19 pid: 17235 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639239.508922:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788639239.508928:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d225031-35be-4b74-b245-637fda218215+19:3641:x1875523773049856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788639239.508937:0:17226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788639239.508942:0:17226:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae375ef4a00/0x25c454990262d412 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262d40b expref: 19 pid: 17236 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639239.508953:0:17226:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae375ef4a00/0x25c454990262d412 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262d40b expref: 19 pid: 17236 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639239.508967:0:17226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae375ef4a00/0x25c454990262d412 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262d40b expref: 19 pid: 17236 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639239.508980:0:17226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788639239.509005:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d225031-35be-4b74-b245-637fda218215+18:3641:x1875523773049856:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639239.509012:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788639239.509024:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788639239.509029:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d225031-35be-4b74-b245-637fda218215+17:3641:x1875523773049984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788639239.509036:0:17226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788639239.509041:0:17226:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae2421f8600/0x25c454990262d34e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262d347 expref: 17 pid: 17235 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639239.509059:0:17226:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae2421f8600/0x25c454990262d34e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262d347 expref: 17 pid: 17235 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639239.509069:0:17226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae2421f8600/0x25c454990262d34e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262d347 expref: 17 pid: 17235 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639239.509079:0:17226:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ae375ef4400/0x25c454990262d44a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639239.509087:0:17226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae375ef4400/0x25c454990262d44a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788639239.509099:0:17226:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003517559s 00010000:00010000:2.0:1788639239.509102:0:17226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae375ef4400/0x25c454990262d44a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639239.509124:0:17226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae375ef4400/0x25c454990262d44a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639239.509130:0:17226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ae375ef4400/0x25c454990262d44a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639239.509136:0:17226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ae375ef4400/0x25c454990262d44a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639239.509141:0:17226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef4400 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:2.0:1788639239.509144:0:17226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ae375ef4400/0x25c454990262d44a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639239.509152:0:17226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ae375ef4400/0x25c454990262d44a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639239.509178:0:17226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ae375ef4400/0x25c454990262d44a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639239.509187:0:17226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788639239.509210:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d225031-35be-4b74-b245-637fda218215+16:3641:x1875523773049984:12345-0@lo:103:ldlm_bl.0 Request processed in 181us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639239.509216:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788639239.509245:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4d225031-35be-4b74-b245-637fda218215:3641:1875523773049984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788639239.509252:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4d225031-35be-4b74-b245-637fda218215:3641:1875523773049856:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788639239.509455:0:17256:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ae375ef4400/0x25c454990262d44a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639239.509464:0:17256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ae375ef4400/0x25c454990262d44a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639239.509481:0:17256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae375ef4400/0x25c454990262d44a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:2.0:1788639239.522315:0:17972:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1788639239.523075:0:17997:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1788639239.523080:0:17997:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1788639239.523146:0:17998:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:1.0:1788639239.523836:0:17998:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1788639239.526727:0:17972:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:1.0:1788639239.527635:0:17998:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788639239.527697:0:17998:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:3.0:1788639239.528970:0:18000:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233ea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18000:1875523773050112:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788639239.529036:0:18000:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639239.529075:0:18000:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3750e2180 going to sleep for 11 seconds 00000100:00100000:1.0:1788639239.529123:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773050112 00000100:00100000:1.0:1788639239.529130:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773050112 00000100:00100000:1.0:1788639239.529172:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788639239.529180:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:18000:x1875523773050112:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788639239.529261:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:18000:x1875523773050112:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 81us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639239.529269:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788639239.529755:0:18000:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233ea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18000:1875523773050112:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1788639239.529781:0:18000:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788639239.529820:0:18000:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233ea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18000:1875523773050240:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788639239.529852:0:18000:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639239.529869:0:18000:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3750e2180 going to sleep for 11 seconds 00000100:00100000:1.0:1788639239.531292:0:17981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773050240 00000040:01000000:2.0:1788639239.531588:0:17972:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:1.0:1788639239.531835:0:17981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773050240 00000100:00100000:1.0:1788639239.531883:0:17981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788639239.531892:0:17981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:18000:x1875523773050240:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788639239.532040:0:17981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:18000:x1875523773050240:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 149us (2187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639239.532048:0:17981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788639239.532121:0:18000:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233ea00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18000:1875523773050240:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788639239.532194:0:18000:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244124a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:18000:1875523773050368:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788639239.532227:0:18000:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639239.532249:0:18000:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243817c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788639239.532326:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773050368 00000100:00100000:2.0:1788639239.532330:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773050368 00000100:00100000:2.0:1788639239.532368:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788639239.532376:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:18000:x1875523773050368:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788639239.532417:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:18000:x1875523773050368:12345-0@lo:900:lod0001_rec0000.0 Request processed in 41us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639239.532423:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788639239.532489:0:18000:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae244124a80 x1875523773050368/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788639255 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639239.532500:0:18000:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244124a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:18000:1875523773050368:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788639239.532540:0:18000:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244124a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18000:1875523773050496:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788639239.532581:0:18000:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639239.532604:0:18000:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae34653f180 going to sleep for 11 seconds 00000100:00100000:2.0:1788639239.533027:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773050496 00000100:00100000:2.0:1788639239.533033:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773050496 00000100:00100000:2.0:1788639239.533062:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788639239.533069:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:18000:x1875523773050496:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788639239.533126:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:18000:x1875523773050496:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 57us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639239.533133:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788639239.533382:0:18000:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244124a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18000:1875523773050496:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1788639239.533424:0:18000:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788639239.535524:0:17972:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788639239.536752:0:17972:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788639239.536766:0:17972:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1788639239.536856:0:17972:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788639239.538224:0:17972:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788639239.538865:0:18000:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788639239.538913:0:18000:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788639239.538918:0:18000:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000040:00080000:3.0:1788639239.539057:0:17972:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788639239.539091:0:17972:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1788639239.539229:0:17972:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788639239.539990:0:17972:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:0.0:1788639239.542006:0:17972:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1788639239.556873:0:17972:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788639239.556912:0:17972:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffaea581ca7988 00100000:10000000:0.0:1788639239.556920:0:17972:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1788639239.557851:0:17972:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788639239.557884:0:17972:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.118@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788639239.557903:0:17972:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788639239.557925:0:17972:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1788639239.561845:0:17972:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788639239.562078:0:17972:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788639239.860723:0:17281:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243259900 going to sleep for 0 seconds 00000040:00080000:0.0:1788639239.861940:0:17279:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788639240.502477:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788639240.565166:0:17238:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788639240.565174:0:17238:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ae34303d000 from 8 10000000:01000000:0.0:1788639240.565179:0:17238:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788639240.565224:0:17238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae375ef5400/0x25c454990262d451 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639240.565251:0:17238:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae375ef5400/0x25c454990262d451 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639240.565261:0:17238:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae375ef5400/0x25c454990262d451 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639240.565286:0:17238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773050624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788639240.565348:0:17238:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639240.565400:0:17238:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2431150c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788639240.565458:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773050624 00000100:00100000:1.0:1788639240.565465:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773050624 00000100:00100000:1.0:1788639240.565513:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788639240.565521:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+16:17238:x1875523773050624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788639240.565531:0:17235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639240.565544:0:17235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae3750fb600/0x25c454990262d458 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262d451 expref: -99 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639240.565565:0:17235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae3750fb600/0x25c454990262d458 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262d451 expref: 17 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639240.565575:0:17235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae3750fb600/0x25c454990262d458 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262d451 expref: 17 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639240.565585:0:17235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fb600, rc 0) 00000100:00100000:1.0:1788639240.565662:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+17:17238:x1875523773050624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639240.565669:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788639240.565763:0:17238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773050624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788639240.565776:0:17238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae375ef5400/0x25c454990262d451 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d458 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639240.565785:0:17238:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae375ef5400/0x25c454990262d451 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262d458 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639240.565834:0:17238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773050752:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788639240.565860:0:17238:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639240.565876:0:17238:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2431150c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788639240.565888:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773050752 00000100:00100000:0.0:1788639240.565892:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773050752 00000100:00100000:0.0:1788639240.565913:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788639240.565919:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f722450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+17:17238:x1875523773050752:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788639240.565931:0:17233:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788639240.565944:0:17233:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788639240.565947:0:17233:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788639240.566018:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f722450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+17:17238:x1875523773050752:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 99us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639240.566025:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788639240.566055:0:17238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773050752:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788639240.566346:0:17238:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788639240.566353:0:17238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae375ef5400/0x25c454990262d451 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d458 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639240.566362:0:17238:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae375ef5400/0x25c454990262d451 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d458 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639240.566369:0:17238:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788639240.566371:0:17238:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ae243aeb000 from 8 10000000:01000000:0.0:1788639240.566373:0:17238:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788639240.566388:0:17238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4800/0x25c454990262d45f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639240.566395:0:17238:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4800/0x25c454990262d45f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639240.566402:0:17238:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4800/0x25c454990262d45f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639240.566413:0:17238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773050880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788639240.566436:0:17238:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639240.566462:0:17238:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2431150c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788639240.566501:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773050880 00000100:00100000:1.0:1788639240.566506:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773050880 00000100:00100000:1.0:1788639240.566640:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788639240.566649:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f721c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+17:17238:x1875523773050880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788639240.566657:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639240.566667:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae3750fa600/0x25c454990262d466 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262d45f expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639240.566682:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae3750fa600/0x25c454990262d466 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262d45f expref: 18 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639240.566690:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae3750fa600/0x25c454990262d466 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262d45f expref: 18 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639240.566697:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fa600, rc 0) 00000100:00100000:1.0:1788639240.566727:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f721c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+18:17238:x1875523773050880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 79us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639240.566733:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788639240.566993:0:17238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773050880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788639240.567005:0:17238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4800/0x25c454990262d45f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d466 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639240.567013:0:17238:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4800/0x25c454990262d45f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262d466 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639240.567059:0:17238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244124a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773051008:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788639240.567177:0:17238:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639240.567248:0:17238:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae34653fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788639240.568180:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773051008 00000100:00100000:2.0:1788639240.568188:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773051008 00000100:00100000:2.0:1788639240.568243:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788639240.568252:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f720c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+18:17238:x1875523773051008:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788639240.568270:0:17236:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788639240.568287:0:17236:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788639240.568290:0:17236:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1788639240.568383:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f720c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+18:17238:x1875523773051008:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 133us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639240.568390:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788639240.568468:0:17238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244124a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773051008:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788639240.568513:0:17238:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788639240.568521:0:17238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4800/0x25c454990262d45f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d466 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639240.568530:0:17238:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4800/0x25c454990262d45f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d466 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788639240.569116:0:17999:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788639240.884865:0:17281:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243259900 going to sleep for 0 seconds 00010000:00010000:1.0:1788639241.524826:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788639241.599939:0:17999:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788639241.908749:0:17281:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243259900 going to sleep for 0 seconds 00010000:00010000:2.0:1788639242.549737:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639242.933836:0:17281:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243259900 going to sleep for 0 seconds 00000001:02000400:2.0:1788639243.472095:0:18242:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg618-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788639243.573767:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639243.965925:0:17281:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243259900 going to sleep for 0 seconds 00000020:00000004:3.0:1788639244.323158:0:18295:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788639244.323373:0:18295:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788639244.471456:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773051136:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788639244.471561:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639244.473079:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773051136 00000100:00100000:2.0:1788639244.473092:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773051136 00000100:00100000:2.0:1788639244.473141:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788639244.473151:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773051136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788639244.473188:0:17245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788639244.473486:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773051136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 337us (1925us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639244.473495:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788639244.473636:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773051136:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788639244.602254:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788639244.980788:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788639244.980795:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788639244.980798:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ae36ddee000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788639244.980811:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ae36ddee000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:3.0:1788639244.980837:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae24233d180 x1875523773051392/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788639244.980852:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788639244.980856:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788639244.980858:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788639244.980860:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788639244.980874:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788639244.980877:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788639244.980879:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788639244.980882:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788639244.980938:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788639244.980962:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4d225031-35be-4b74-b245-637fda218215:3643:1875523773051264:0@lo:400:kworker.0 00000100:00100000:0.0:1788639244.981027:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639244.981113:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773051392:0@lo:38:kworker.0 00000100:00100000:2.0:1788639244.981155:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639244.981198:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773051264 00000100:00100000:3.0:1788639244.981206:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773051264 00000100:00100000:3.0:1788639244.981261:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788639244.981271:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875523773051520:0@lo:400:kworker.0 00000100:00100000:3.0:1788639244.981273:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f722850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+18:3643:x1875523773051264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639244.981309:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639244.981338:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788639244.981345:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f722850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+18:3643:x1875523773051264:12345-0@lo:400:kworker.0 Request processed in 73us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639244.981346:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875523773051648:0@lo:400:kworker.0 00000100:00100000:3.0:1788639244.981359:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788639244.981382:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639244.981415:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4d225031-35be-4b74-b245-637fda218215:3643:1875523773051264:0@lo:400:kworker.0 00000100:00100000:2.0:1788639244.981421:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773051520 00000100:00100000:2.0:1788639244.981427:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773051520 00000100:00100000:2.0:1788639244.981460:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773051648 00000100:00100000:2.0:1788639244.981464:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773051648 00000100:00100000:0.0:1788639244.981493:0:17981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773051392 00000100:00100000:0.0:1788639244.981510:0:17981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773051392 00000100:00100000:0.0:1788639244.981539:0:17981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788639244.981543:0:17981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875523773051392:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788639244.981566:0:17981:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 503 last 0 00000020:00000080:0.0:1788639244.981604:0:17981:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x25c454990262d46d 00000004:00100000:0.0:1788639244.981636:0:17981:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788639244.981649:0:17981:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1788639244.981878:0:17281:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243259900 going to sleep for 0 seconds 00000100:00100000:1.0:1788639244.984710:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788639244.984732:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875523773051520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639244.984828:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875523773051520:12345-0@lo:400:kworker.0 Request processed in 102us (3518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639244.985047:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788639244.985060:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875523773051648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639244.985100:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875523773051648:12345-0@lo:400:kworker.0 Request processed in 45us (3719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639244.985107:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788639244.985656:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae24233ea00 x1875523773051648/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639244.985673:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875523773051648:0@lo:400:kworker.0 00010000:00080000:2.0:1788639244.985692:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae24233df80 x1875523773051520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639244.985700:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875523773051520:0@lo:400:kworker.0 00000100:00100000:1.0:1788639244.986217:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788639244.994044:0:17981:0:(import.c:65:import_set_state_nolock()) ffff9ae375ea3000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788639244.994134:0:17981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1875523773051392:12345-0@lo:38:kworker.0 Request processed in 12588us (12977us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639244.994145:0:17981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1788639244.994223:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788639244.994231:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788639244.994236:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788639244.994239:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae36ddee000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1788639244.994260:0:3640:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000d9505569): req@ffff9ae244126300 x1875523773044352/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639244.994286:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773051392:0@lo:38:kworker.0 00000100:00100000:0.0:1788639244.994453:0:17281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639244.994484:0:17281:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243259900 going to sleep for 11 seconds 00000100:00100000:1.0:1788639244.994522:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773044352 00000100:00100000:1.0:1788639244.994528:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773044352 00000100:00100000:1.0:1788639244.994570:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788639244.994578:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17281:x1875523773044352:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788639244.994666:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17281:x1875523773044352:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 89us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639244.994672:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788639244.994741:0:17281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244126300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17281:1875523773044352:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1788639244.994824:0:17281:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788639244.994865:0:17281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cd500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17281:1875523773051776:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788639244.994893:0:17281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639244.994922:0:17281:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae348ea5780 going to sleep for 11 seconds 00000100:00100000:1.0:1788639244.994967:0:17981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773051776 00000100:00100000:1.0:1788639244.994971:0:17981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773051776 00000100:00100000:1.0:1788639244.994999:0:17981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788639244.995005:0:17981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17281:x1875523773051776:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788639244.995090:0:17981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17281:x1875523773051776:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 84us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639244.995096:0:17981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788639244.995210:0:17281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cd500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17281:1875523773051776:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788639244.995287:0:17281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cd500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17281:1875523773051904:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788639244.995309:0:17281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639244.995332:0:17281:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae348ea5780 going to sleep for 11 seconds 00000100:00100000:3.0:1788639244.995426:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788639244.995436:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773052032:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788639244.995461:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639244.995483:0:17981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773051904 00000100:00100000:3.0:1788639244.995487:0:17981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773051904 00000100:00100000:3.0:1788639244.995503:0:17981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773052032 00000100:00100000:3.0:1788639244.995505:0:17981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773052032 00000100:00100000:3.0:1788639244.995515:0:17981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788639244.995521:0:17981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:17281:x1875523773051904:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788639244.995562:0:17981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:17281:x1875523773051904:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 41us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639244.995568:0:17981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788639244.995578:0:17981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788639244.995583:0:17981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1875523773052032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788639244.995601:0:17981:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788639244.995649:0:17981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1875523773052032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 66us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639244.995654:0:17981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788639244.995679:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773052032:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788639244.995751:0:17281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cd500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17281:1875523773051904:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1788639244.995807:0:17281:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788639244.997830:0:17281:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788639244.997906:0:17281:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 17, retries 0 00000004:00080000:0.0:1788639244.997911:0:17281:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:0.0:1788639245.089395:0:18346:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788639245.089726:0:18346:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788639245.631322:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788639246.061483:0:18394:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc529ab100 20000000:00000080:1.0:1788639246.061506:0:18394:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ae36ce49c00 uarg=0000000000000000 20000000:01000000:1.0:1788639246.061655:0:18394:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788639246.061666:0:18394:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788639246.061673:0:18394:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788639246.064055:0:18395:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1788639246.064195:0:18394:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788639246.073814:0:18394:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788639246.073878:0:18394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ae3750fb400/0x25c454990262d474 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639246.073898:0:18394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae375ef5800/0x25c454990262d31d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262d316 expref: 17 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639246.073927:0:18394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae375ef5000/0x25c454990262d420 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262d419 expref: 17 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639246.073944:0:18394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ae3750fb400/0x25c454990262d474 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639246.074223:0:18394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae375ef5000/0x25c454990262d420 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262d419 expref: 17 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639246.074239:0:18394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae375ef5000/0x25c454990262d420 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262d419 expref: 17 pid: 17236 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639246.074255:0:18394:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244124a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18394:1875523773052160:0@lo:104: 00000100:00100000:1.0:1788639246.074374:0:18394:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788639246.074431:0:18394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae375ef5800/0x25c454990262d31d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262d316 expref: 17 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639246.074441:0:18394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae375ef5800/0x25c454990262d31d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262d316 expref: 17 pid: 17235 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639246.074449:0:18394:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244125f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18394:1875523773052288:0@lo:104: 00000100:00100000:1.0:1788639246.074470:0:18394:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639246.074495:0:18394:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3443266c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788639246.074543:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773052160 00000100:00100000:3.0:1788639246.074578:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773052160 00000100:00100000:3.0:1788639246.074677:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773052288 00000100:00100000:3.0:1788639246.074682:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773052288 00000100:00100000:2.0:1788639246.074696:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788639246.074713:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244126a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4d225031-35be-4b74-b245-637fda218215+4:18394:x1875523773052160:12345-0@lo:104: 00010000:00010000:2.0:1788639246.074729:0:17224:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8000/0x25c454990262d419 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262d420 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639246.074863:0:17224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788639246.074877:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244126a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4d225031-35be-4b74-b245-637fda218215+4:18394:x1875523773052160:12345-0@lo:104: Request processed in 166us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639246.074903:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788639246.074929:0:18394:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244124a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18394:1875523773052160:0@lo:104: 00000100:00100000:0.0:1788639246.074937:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788639246.074949:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244125500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4d225031-35be-4b74-b245-637fda218215+3:18394:x1875523773052288:12345-0@lo:104: 00010000:00010000:0.0:1788639246.074967:0:17224:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a800/0x25c454990262d316 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262d31d expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639246.075070:0:17224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788639246.075086:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244125500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4d225031-35be-4b74-b245-637fda218215+3:18394:x1875523773052288:12345-0@lo:104: Request processed in 131us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639246.075093:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788639246.075552:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788639246.075560:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8000/0x25c454990262d419 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262d420 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639246.075570:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f8000 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:2.0:1788639246.075574:0:17229:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8000/0x25c454990262d419 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262d420 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639246.075593:0:17229:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8000/0x25c454990262d419 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262d420 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788639246.075601:0:17229:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8000/0x25c454990262d419 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262d420 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788639246.075607:0:17229:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788639246.075693:0:17229:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8000/0x25c454990262d419 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262d420 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639246.075700:0:17229:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788639246.075716:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788639246.075730:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8000/0x25c454990262d419 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262d420 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639246.075740:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae2421f8000/0x25c454990262d419 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262d420 expref: -99 pid: 17972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639246.075754:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639246.075756:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639246.075758:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639246.075778:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788639246.075803:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4d225031-35be-4b74-b245-637fda218215:3643:1875523773052416:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788639246.075855:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639246.075914:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773052416 00000100:00100000:2.0:1788639246.075920:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773052416 00010000:00010000:2.0:1788639246.075945:0:17227:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae375ef5000/0x25c454990262d420 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262d419 expref: 18 pid: 17236 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639246.075971:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788639246.075979:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d225031-35be-4b74-b245-637fda218215+18:3643:x1875523773052416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788639246.076215:0:17227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788639246.076221:0:17227:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae375ef5000/0x25c454990262d420 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262d419 expref: 18 pid: 17236 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639246.076232:0:17227:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae375ef5000/0x25c454990262d420 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262d419 expref: 18 pid: 17236 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639246.076251:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae375ef5000/0x25c454990262d420 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262d419 expref: 18 pid: 17236 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639246.076333:0:17227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788639246.076372:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d225031-35be-4b74-b245-637fda218215+17:3643:x1875523773052416:12345-0@lo:103:ldlm_bl.0 Request processed in 394us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639246.076381:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788639246.076541:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4d225031-35be-4b74-b245-637fda218215:3643:1875523773052416:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788639246.076920:0:18394:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244125f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18394:1875523773052288:0@lo:104: 00010000:00010000:1.0:1788639246.076943:0:18394:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ae3750fb400/0x25c454990262d474 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639246.079106:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639246.079115:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639246.079119:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639246.079133:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a800/0x25c454990262d316 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262d31d expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639246.079147:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78a800 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:2.0:1788639246.079153:0:17230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a800/0x25c454990262d316 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262d31d expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639246.079175:0:17230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a800/0x25c454990262d316 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262d31d expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788639246.079183:0:17230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a800/0x25c454990262d316 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262d31d expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788639246.079188:0:17230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788639246.079239:0:17230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a800/0x25c454990262d316 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262d31d expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639246.079246:0:17230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788639246.079304:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1788639246.079323:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a800/0x25c454990262d316 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262d31d expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639246.079332:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae37f78a800/0x25c454990262d316 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262d31d expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639246.079350:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639246.079352:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639246.079354:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639246.080394:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4d225031-35be-4b74-b245-637fda218215:3642:1875523773052544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788639246.080463:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639246.080549:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773052544 00000100:00100000:0.0:1788639246.080566:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773052544 00010000:00010000:0.0:1788639246.080793:0:17226:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae375ef5800/0x25c454990262d31d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262d316 expref: 17 pid: 17235 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639246.080839:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788639246.080863:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244125f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d225031-35be-4b74-b245-637fda218215+17:3642:x1875523773052544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788639246.080882:0:17226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788639246.080889:0:17226:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae375ef5800/0x25c454990262d31d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262d316 expref: 17 pid: 17235 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639246.080904:0:17226:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae375ef5800/0x25c454990262d31d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262d316 expref: 17 pid: 17235 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639246.080925:0:17226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae375ef5800/0x25c454990262d31d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262d316 expref: 17 pid: 17235 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639246.080945:0:17226:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ae3750fb400/0x25c454990262d474 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639246.080955:0:17226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae3750fb400/0x25c454990262d474 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639246.080976:0:17226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae3750fb400/0x25c454990262d474 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639246.080984:0:17226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae3750fb400/0x25c454990262d474 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639246.080991:0:17226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ae3750fb400/0x25c454990262d474 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639246.080999:0:17226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ae3750fb400/0x25c454990262d474 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639246.081005:0:17226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fb400 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639246.081010:0:17226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ae3750fb400/0x25c454990262d474 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639246.081026:0:17226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ae3750fb400/0x25c454990262d474 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639246.081045:0:17226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ae3750fb400/0x25c454990262d474 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639246.081056:0:17226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788639246.081144:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244125f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d225031-35be-4b74-b245-637fda218215+16:3642:x1875523773052544:12345-0@lo:103:ldlm_bl.0 Request processed in 283us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639246.081152:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788639246.081357:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4d225031-35be-4b74-b245-637fda218215:3642:1875523773052544:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788639246.081423:0:18394:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ae3750fb400/0x25c454990262d474 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639246.081435:0:18394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ae3750fb400/0x25c454990262d474 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639246.081443:0:18394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae3750fb400/0x25c454990262d474 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639246.645186:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788639247.163207:0:17238:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788639247.163215:0:17238:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae34303d000 from 13 10000000:01000000:1.0:1788639247.163219:0:17238:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788639247.163263:0:17238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb000/0x25c454990262d47b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639247.163275:0:17238:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb000/0x25c454990262d47b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639247.163286:0:17238:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb000/0x25c454990262d47b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639247.163309:0:17238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244124a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773052672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788639247.163389:0:17238:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639247.163433:0:17238:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243066b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788639247.163544:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773052672 00000100:00100000:0.0:1788639247.163551:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773052672 00000100:00100000:0.0:1788639247.163608:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788639247.163658:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f720850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+16:17238:x1875523773052672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788639247.163672:0:17235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639247.163686:0:17235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae375ef4a00/0x25c454990262d482 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262d47b expref: -99 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639247.163708:0:17235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae375ef4a00/0x25c454990262d482 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262d47b expref: 17 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639247.163719:0:17235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae375ef4a00/0x25c454990262d482 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262d47b expref: 17 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639247.163728:0:17235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375ef4a00, rc 0) 00000100:00100000:0.0:1788639247.163778:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f720850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+17:17238:x1875523773052672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639247.163785:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788639247.163852:0:17238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244124a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773052672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788639247.163866:0:17238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb000/0x25c454990262d47b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d482 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639247.163875:0:17238:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb000/0x25c454990262d47b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262d482 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639247.163954:0:17238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244124a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773052800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788639247.163978:0:17238:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639247.164009:0:17238:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243066b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788639247.164383:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773052800 00000100:00100000:0.0:1788639247.164389:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773052800 00000100:00100000:0.0:1788639247.164426:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788639247.164433:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f723850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+17:17238:x1875523773052800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788639247.164555:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f723850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+17:17238:x1875523773052800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639247.164563:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788639247.164661:0:17238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244124a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773052800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788639247.164695:0:17238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773052928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788639247.164736:0:17238:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639247.164756:0:17238:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae343da20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788639247.165438:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773052928 00000100:00100000:0.0:1788639247.165445:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773052928 00000100:00100000:0.0:1788639247.165473:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788639247.165480:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f723c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+17:17238:x1875523773052928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788639247.165582:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f723c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+17:17238:x1875523773052928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639247.165588:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788639247.165692:0:17238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773052928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788639247.166541:0:18457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788639247.166865:0:17238:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788639247.166889:0:17238:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788639247.166899:0:17238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb000/0x25c454990262d47b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d482 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639247.166910:0:17238:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb000/0x25c454990262d47b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d482 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639247.166920:0:17238:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788639247.166922:0:17238:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae243aeb000 from 13 10000000:01000000:0.0:1788639247.166925:0:17238:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788639247.166958:0:17238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae375ef5800/0x25c454990262d489 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639247.166966:0:17238:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae375ef5800/0x25c454990262d489 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639247.166988:0:17238:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae375ef5800/0x25c454990262d489 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639247.167007:0:17238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773053056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788639247.167055:0:17238:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639247.167098:0:17238:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae348ea5900 going to sleep for 11 seconds 00000100:00100000:3.0:1788639247.167392:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773053056 00000100:00100000:3.0:1788639247.167400:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773053056 00000100:00100000:3.0:1788639247.167448:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788639247.167458:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f723050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+17:17238:x1875523773053056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788639247.167469:0:17236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639247.167482:0:17236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae2421f8800/0x25c454990262d490 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262d489 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639247.167503:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae2421f8800/0x25c454990262d490 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262d489 expref: 18 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639247.167514:0:17236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae2421f8800/0x25c454990262d490 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262d489 expref: 18 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639247.167523:0:17236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f8800, rc 0) 00000100:00100000:3.0:1788639247.167638:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f723050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+18:17238:x1875523773053056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639247.167645:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788639247.172092:0:17238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773053056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788639247.172122:0:17238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae375ef5800/0x25c454990262d489 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d490 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639247.172136:0:17238:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae375ef5800/0x25c454990262d489 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262d490 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639247.172215:0:17238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244127480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773053184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788639247.172269:0:17238:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639247.172359:0:17238:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243066240 going to sleep for 11 seconds 00000100:00100000:0.0:1788639247.177586:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773053184 00000100:00100000:0.0:1788639247.177601:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773053184 00000100:00100000:1.0:1788639247.177927:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788639247.177938:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f720450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+18:17238:x1875523773053184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788639247.178104:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f720450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+18:17238:x1875523773053184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 169us (5834us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639247.178112:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788639247.178229:0:17238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244127480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773053184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788639247.178278:0:17238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773053312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788639247.178328:0:17238:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639247.178367:0:17238:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae348ea5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788639247.178415:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773053312 00000100:00100000:3.0:1788639247.178427:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773053312 00000100:00100000:3.0:1788639247.178459:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788639247.178466:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f722050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+18:17238:x1875523773053312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788639247.178560:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f722050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+18:17238:x1875523773053312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639247.178567:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788639247.178735:0:17238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773053312:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788639247.179536:0:18458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788639247.179683:0:17238:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788639247.179704:0:17238:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788639247.179714:0:17238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae375ef5800/0x25c454990262d489 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d490 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639247.179724:0:17238:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae375ef5800/0x25c454990262d489 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d490 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639247.668813:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639248.696071:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639249.076789:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788639239/real 1788639239] req@ffff9ae24233f480 x1875523773047552/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788639249 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639249.076834:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ae24233f480 x1875523773047552/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788639249 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639249.076847:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788639239/real 1788639239] req@ffff9ae375f39c00 x1875523773047424/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788639249 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639249.076861:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ae375f39c00 x1875523773047424/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788639249 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788639249.076903:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae36d235800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788639249.076946:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788639249.076951:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773047552:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788639249.076957:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae36d232000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788639249.076964:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788639249.076968:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773047424:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788639249.077151:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:3.0:1788639249.077186:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788639249.077192:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788639249.077195:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788639249.077199:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788639249.077218:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788639249.077221:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788639249.077224:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ae36d232000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788639249.077230:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 498 00000100:00080000:3.0:1788639249.077237:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788639249.077244:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9ae36d232000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:0.0:1788639249.077326:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773053824:0@lo:400:kworker.0 00000100:00100000:3.0:1788639249.077334:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae24233e300 x1875523773053952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000040:00080000:2.0:1788639249.077348:0:17279:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:3.0:1788639249.077355:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788639249.077358:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788639249.077360:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ae36d235800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788639249.077364:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 498 00000100:00080000:3.0:1788639249.077367:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788639249.077373:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ae36d235800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:3.0:1788639249.077397:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae24233ed80 x1875523773054080/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788639249.077411:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639249.077435:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875523773053696:0@lo:400:kworker.0 00000100:00100000:2.0:1788639249.077435:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773053568:0@lo:400:kworker.0 00000100:00100000:1.0:1788639249.077510:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523773054208:0@lo:400:kworker.0 00000100:00100000:0.0:1788639249.077602:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4d225031-35be-4b74-b245-637fda218215:3641:1875523773053440:0@lo:400:kworker.0 00000100:00100000:0.0:1788639249.077688:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639249.077746:0:17981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773053824 00000100:00100000:0.0:1788639249.077766:0:17981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773053824 00000100:00100000:0.0:1788639249.077813:0:17981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788639249.077822:0:17981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773053824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639249.077878:0:17981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773053824:12345-0@lo:400:kworker.0 Request processed in 56us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639249.077885:0:17981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788639249.077907:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773053440 00000100:00100000:0.0:1788639249.077911:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773053440 00000100:00100000:0.0:1788639249.077941:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788639249.077946:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f721850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+18:3641:x1875523773053440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639249.077995:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639249.077998:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f721850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+18:3641:x1875523773053440:12345-0@lo:400:kworker.0 Request processed in 45us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639249.078026:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788639249.078155:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773053952:0@lo:8:kworker.0 00000400:00000100:0.0:1788639249.078180:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875523773053952 offset 0 length 520: 4 00000100:00100000:0.0:1788639249.078200:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773054080:0@lo:8:kworker.0 00000100:00100000:3.0:1788639249.078242:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773053696 00000100:00100000:2.0:1788639249.078282:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639249.078331:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773053568 00000100:00100000:2.0:1788639249.078337:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773053568 00000400:00000100:0.0:1788639249.078344:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875523773054080 offset 0 length 520: 4 00000100:00100000:1.0:1788639249.078379:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639249.078407:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788639249.078418:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1875523773053568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639249.078470:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773053696 00000100:00100000:2.0:1788639249.078479:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1875523773053568:12345-0@lo:400:kworker.0 Request processed in 66us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639249.078487:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788639249.078504:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773054208 00000100:00100000:3.0:1788639249.078508:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773054208 00000100:00100000:3.0:1788639249.078522:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788639249.078528:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875523773053696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639249.078583:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773053824:0@lo:400:kworker.0 00000100:00100000:0.0:1788639249.078599:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4d225031-35be-4b74-b245-637fda218215:3641:1875523773053440:0@lo:400:kworker.0 00000100:00100000:3.0:1788639249.078668:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875523773053696:12345-0@lo:400:kworker.0 Request processed in 135us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639249.078679:0:17240:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788639249.078682:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788639249.078691:0:17240:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00010000:00080000:2.0:1788639249.078723:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae24233c000 x1875523773053696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639249.078723:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773053568:0@lo:400:kworker.0 00000100:00100000:3.0:1788639249.078725:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788639249.078745:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875523773053696:0@lo:400:kworker.0 00000100:00100000:3.0:1788639249.078764:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523773054208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639249.078833:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523773054208:12345-0@lo:400:kworker.0 Request processed in 92us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639249.078841:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788639249.079021:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae24233c700 x1875523773054208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639249.079033:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523773054208:0@lo:400:kworker.0 00000100:00100000:2.0:1788639249.590492:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773054336:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788639249.590585:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639249.590682:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773054336 00000100:00100000:2.0:1788639249.590691:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773054336 00000100:00100000:2.0:1788639249.590757:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788639249.590767:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773054336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788639249.590808:0:17246:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788639249.590865:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773054336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639249.590872:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788639249.590927:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773054336:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788639249.716738:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639250.106931:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773054464:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788639250.107027:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639250.107104:0:17981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773054464 00000100:00100000:3.0:1788639250.107114:0:17981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773054464 00000100:00100000:3.0:1788639250.107173:0:17981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788639250.107184:0:17981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1875523773054464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788639250.107439:0:17981:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788639250.107547:0:17981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1875523773054464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 363us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639250.107573:0:17981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788639250.110962:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773054464:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788639250.748147:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788639251.129723:0:17973:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788639251.766188:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788639251.830229:0:17999:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:1.0:1788639251.837613:0:18743:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788639251.837703:0:18743:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788639251.837705:0:18743:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788639251.837954:0:18743:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ae375ea7800 00000020:01000004:0.0:1788639251.838073:0:18743:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788639251.838087:0:18743:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788639251.838111:0:18743:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9ae36cf0b380) 00000020:00000080:0.0:1788639251.838130:0:18743:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788639251.892366:0:18743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788639251.893566:0:18743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788639251.893922:0:18743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1788639251.894151:0:18743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1788639251.894388:0:18743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788639251.894598:0:18743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788639251.895267:0:18743:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:3.0:1788639251.903154:0:18743:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788639251.903805:0:18743:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788639251.903825:0:18743:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788639251.903844:0:18743:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x25c454990262d49e 00000020:01000004:3.0:1788639251.903855:0:18743:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788639251.904008:0:18743:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.118@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788639251.904013:0:18743:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.118@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788639251.904021:0:18743:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788639251.904027:0:18743:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788639251.904071:0:18743:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9ae377248000) 00000020:00000080:3.0:1788639251.904087:0:18743:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1788639251.907319:0:18743:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788639251.908101:0:18743:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788639251.908110:0:18743:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788639251.910164:0:18743:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788639251.910981:0:18743:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788639251.913130:0:18743:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788639251.913146:0:18743:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788639251.918138:0:18743:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788639251.918375:0:18743:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788639251.918384:0:18743:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788639251.925743:0:18743:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788639251.927667:0:18743:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788639251.952901:0:18743:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788639251.953128:0:18743:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788639251.953134:0:18743:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788639251.954511:0:18743:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788639251.954521:0:18743:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788639251.957773:0:18743:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788639251.957796:0:18743:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788639251.962434:0:18743:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788639251.962722:0:18743:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788639251.962729:0:18743:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788639251.965327:0:18743:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788639251.965349:0:18743:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788639252.035312:0:18743:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788639252.035602:0:18743:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788639252.035610:0:18743:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788639252.037213:0:18743:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788639252.037231:0:18743:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788639252.038286:0:18743:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788639252.038332:0:18743:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1788639252.038341:0:18743:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.118@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788639252.067573:0:18743:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.118@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788639252.067612:0:18743:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.118@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1788639252.068762:0:18743:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788639252.068764:0:18743:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788639252.068766:0:18743:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788639252.068767:0:18743:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788639252.068768:0:18743:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788639252.068769:0:18743:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788639252.068771:0:18743:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788639252.068772:0:18743:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788639252.068774:0:18743:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788639252.068778:0:18743:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1788639252.068780:0:18743:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788639252.068781:0:18743:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788639252.068782:0:18743:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788639252.068783:0:18743:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788639252.068784:0:18743:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788639252.068785:0:18743:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788639252.068786:0:18743:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788639252.068787:0:18743:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788639252.068788:0:18743:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788639252.068831:0:18743:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788639252.068850:0:18743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244124000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:18743:1875523773054592:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788639252.068920:0:18743:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639252.068967:0:18743:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae343da3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788639252.069164:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773054592 00000100:00100000:2.0:1788639252.069172:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773054592 00000100:00100000:2.0:1788639252.069248:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788639252.069257:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f721450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+18:18743:x1875523773054592:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788639252.069287:0:17235:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788639252.069291:0:17235:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788639252.069294:0:17235:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788639252.070353:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f721450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+18:18743:x1875523773054592:12345-0@lo:253:mount.lustre.0 Request processed in 1093us (1430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639252.070363:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788639252.070583:0:18743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244124000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:18743:1875523773054592:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788639252.070596:0:18743:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788639252.070599:0:18743:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788639252.070600:0:18743:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788639252.070601:0:18743:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788639252.070602:0:18743:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788639252.070603:0:18743:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788639252.070605:0:18743:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788639252.070606:0:18743:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788639252.070608:0:18743:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788639252.070609:0:18743:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788639252.070656:0:18743:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ae375ea7800 from lustre-OST0000 10000000:01000000:1.0:1788639252.070701:0:18743:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788639252.070704:0:18743:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788639252.070719:0:18743:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ae3691c99c0 local copy 00010000:00010000:1.0:1788639252.070742:0:18743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b400/0x25c454990262d259 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d260 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639252.070837:0:18743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244124000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:18743:1875523773054720:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788639252.070870:0:18743:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639252.070905:0:18743:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae343da36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788639252.071055:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773054720 00000100:00100000:0.0:1788639252.071069:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773054720 00000100:00100000:0.0:1788639252.071150:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788639252.071162:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243174050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+18:18743:x1875523773054720:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788639252.071697:0:18743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244124000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:18743:1875523773054720:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788639252.071723:0:18743:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.118@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788639252.071781:0:18743:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.118@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788639252.071791:0:18743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b400/0x25c454990262d259 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d260 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639252.071802:0:18743:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b400/0x25c454990262d259 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d260 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788639252.071851:0:18743:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ae375ea7800 10000000:01000000:2.0:1788639252.071857:0:18743:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788639252.071864:0:18743:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788639252.071866:0:18743:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788639252.071872:0:18743:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788639252.071875:0:18743:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788639252.071914:0:18743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b200/0x25c454990262d4ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639252.071924:0:18743:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b200/0x25c454990262d4ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639252.071934:0:18743:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b200/0x25c454990262d4ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639252.071955:0:18743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:18743:1875523773054848:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788639252.072299:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243174050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+18:18743:x1875523773054720:12345-0@lo:501:mount.lustre.0 Request processed in 1136us (1424us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788639252.072312:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788639252.072429:0:18743:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639252.072489:0:18743:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2410b5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788639252.072497:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773054848 00000100:00100000:1.0:1788639252.072509:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773054848 00000100:00100000:1.0:1788639252.072572:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788639252.072586:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243176850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+18:18743:x1875523773054848:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788639252.072602:0:17235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639252.072659:0:17235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae3750fba00/0x25c454990262d4b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262d4ac expref: -99 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639252.072687:0:17235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae3750fba00/0x25c454990262d4b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262d4ac expref: 19 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639252.072710:0:17235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae3750fba00/0x25c454990262d4b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262d4ac expref: 19 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639252.072718:0:17235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fba00, rc 0) 00000100:00100000:1.0:1788639252.072797:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243176850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+19:18743:x1875523773054848:12345-0@lo:101:mount.lustre.0 Request processed in 215us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639252.072803:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788639252.073237:0:18743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:18743:1875523773054848:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788639252.073261:0:18743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b200/0x25c454990262d4ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d4b3 expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639252.073302:0:18743:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b200/0x25c454990262d4ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262d4b3 expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788639252.076157:0:18743:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788639252.077010:0:18743:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788639252.079711:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788639252.079777:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788639252.079793:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788639252.079805:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788639252.079818:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788639252.079831:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788639252.079856:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788639252.079862:0:18743:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788639252.079954:0:18743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:18743:1875523773054976:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788639252.080022:0:18743:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639252.080077:0:18743:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2410b5600 going to sleep for 11 seconds 00000100:00100000:0.0:1788639252.080087:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773054976 00000100:00100000:0.0:1788639252.080104:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773054976 00000100:00100000:0.0:1788639252.080315:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788639252.080328:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243175c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+19:18743:x1875523773054976:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788639252.080760:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243175c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+19:18743:x1875523773054976:12345-0@lo:501:mount.lustre.0 Request processed in 434us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639252.080778:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788639252.080887:0:18743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:18743:1875523773054976:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788639252.080980:0:18743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:18743:1875523773055104:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788639252.081043:0:18743:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639252.081095:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773055104 00000100:00100000:2.0:1788639252.081099:0:18743:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2410b5600 going to sleep for 11 seconds 00000100:00100000:0.0:1788639252.081105:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773055104 00000100:00100000:0.0:1788639252.081265:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788639252.081274:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243176050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+19:18743:x1875523773055104:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788639252.086132:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243176050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+19:18743:x1875523773055104:12345-0@lo:503:mount.lustre.0 Request processed in 4844us (5076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639252.086152:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788639252.086214:0:18743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:18743:1875523773055104:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788639252.086764:0:18743:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788639252.086843:0:18743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:18743:1875523773055232:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788639252.086916:0:18743:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639252.086960:0:18743:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2410b5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788639252.088041:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773055232 00000100:00100000:3.0:1788639252.088059:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773055232 00000100:00100000:3.0:1788639252.088140:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788639252.088152:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243176c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+19:18743:x1875523773055232:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788639252.090499:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243176c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+19:18743:x1875523773055232:12345-0@lo:502:mount.lustre.0 Request processed in 2340us (3574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639252.090513:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788639252.090672:0:18743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:18743:1875523773055232:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788639252.090913:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788639252.090943:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788639252.090976:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788639252.090991:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788639252.091002:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788639252.091014:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788639252.091026:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788639252.091037:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788639252.091048:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1788639252.091059:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1788639252.091070:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1788639252.091082:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1788639252.091115:0:18743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:18743:1875523773055360:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788639252.091161:0:18743:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639252.091204:0:18743:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2410b5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788639252.091283:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773055360 00000100:00100000:0.0:1788639252.091290:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773055360 00000100:00100000:0.0:1788639252.091384:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788639252.091395:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243177850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+19:18743:x1875523773055360:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788639252.091511:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243177850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+19:18743:x1875523773055360:12345-0@lo:502:mount.lustre.0 Request processed in 118us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639252.091517:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788639252.091582:0:18743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:18743:1875523773055360:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788639252.091656:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1788639252.091665:0:18743:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1788639252.092854:0:18760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788639252.092863:0:18760:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1788639252.092869:0:18760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639252.092872:0:18760:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788639252.092877:0:18760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788639252.092891:0:18760:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9ae36a0eb380) 00000020:00000080:2.0:1788639252.092913:0:18760:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788639252.092918:0:18760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788639252.093016:0:18760:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ae375ea7800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788639252.093024:0:18760:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788639252.093031:0:18760:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x25c454990262d4c1 00010000:00010000:2.0:1788639252.103855:0:18760:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1788639252.106041:0:18760:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:2.0:1788639252.110076:0:18760:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1788639252.112272:0:18760:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788639252.112283:0:18760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788639252.112290:0:18760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639252.112292:0:18760:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788639252.112296:0:18760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788639252.112298:0:18760:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1788639252.112300:0:18760:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788639252.112302:0:18760:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788639252.112303:0:18760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788639252.112306:0:18760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639252.112308:0:18760:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788639252.112310:0:18760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788639252.112314:0:18760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639252.112315:0:18760:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788639252.112317:0:18760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788639252.112319:0:18760:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788639252.112322:0:18760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788639252.112324:0:18760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639252.112325:0:18760:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788639252.112328:0:18760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788639252.112330:0:18760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639252.112331:0:18760:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788639252.112334:0:18760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788639252.112361:0:18760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788639252.112365:0:18760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639252.112366:0:18760:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788639252.112370:0:18760:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1788639252.114314:0:18743:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1788639252.114358:0:18743:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788639252.114386:0:18743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b200/0x25c454990262d4ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d4b3 expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639252.114398:0:18743:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b200/0x25c454990262d4ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d4b3 expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639252.114407:0:18743:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae375ea7800 from 1 10000000:01000000:0.0:1788639252.114410:0:18743:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788639252.114445:0:18743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4400/0x25c454990262d4c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639252.114453:0:18743:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4400/0x25c454990262d4c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639252.114464:0:18743:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4400/0x25c454990262d4c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639252.114488:0:18743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:18743:1875523773055488:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788639252.114556:0:18743:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639252.114601:0:18743:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243259b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788639252.117151:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773055488 00000100:00100000:3.0:1788639252.117165:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773055488 00000100:00100000:3.0:1788639252.117398:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788639252.117412:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+19:18743:x1875523773055488:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788639252.117428:0:17235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639252.117445:0:17235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae2421f8400/0x25c454990262d4cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262d4c8 expref: -99 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639252.117470:0:17235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae2421f8400/0x25c454990262d4cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262d4c8 expref: 20 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639252.117481:0:17235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae2421f8400/0x25c454990262d4cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262d4c8 expref: 20 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639252.117489:0:17235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f8400, rc 0) 00000100:00100000:3.0:1788639252.117565:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+20:18743:x1875523773055488:12345-0@lo:101:mount.lustre.0 Request processed in 156us (3009us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639252.117572:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788639252.117723:0:18743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:18743:1875523773055488:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788639252.117751:0:18743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4400/0x25c454990262d4c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d4cf expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639252.117773:0:18743:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4400/0x25c454990262d4c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262d4cf expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788639252.118826:0:18743:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788639252.119065:0:18743:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788639252.119266:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788639252.119291:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788639252.119308:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788639252.119313:0:18743:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788639252.119377:0:18743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:18743:1875523773055616:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788639252.119433:0:18743:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639252.119473:0:18743:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243259900 going to sleep for 11 seconds 00000100:00100000:3.0:1788639252.119612:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773055616 00000100:00100000:3.0:1788639252.119632:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773055616 00000100:00100000:3.0:1788639252.119677:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788639252.119686:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243174850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+20:18743:x1875523773055616:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788639252.119791:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243174850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+20:18743:x1875523773055616:12345-0@lo:501:mount.lustre.0 Request processed in 105us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639252.119799:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788639252.119932:0:18743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:18743:1875523773055616:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788639252.119961:0:18743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:18743:1875523773055744:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788639252.119999:0:18743:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639252.120067:0:18743:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243259900 going to sleep for 11 seconds 00000100:00100000:1.0:1788639252.122344:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773055744 00000100:00100000:1.0:1788639252.122356:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773055744 00000100:00100000:1.0:1788639252.122447:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788639252.122458:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243177c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+20:18743:x1875523773055744:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788639252.122635:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243177c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+20:18743:x1875523773055744:12345-0@lo:503:mount.lustre.0 Request processed in 179us (2634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639252.122643:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788639252.122748:0:18743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:18743:1875523773055744:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788639252.123140:0:18743:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788639252.123214:0:18743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:18743:1875523773055872:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788639252.123278:0:18743:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639252.123517:0:18743:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24216e300 going to sleep for 11 seconds 00000100:00100000:0.0:1788639252.123577:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773055872 00000100:00100000:0.0:1788639252.123583:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773055872 00000100:00100000:0.0:1788639252.123608:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788639252.123639:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243174450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+20:18743:x1875523773055872:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788639252.123726:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243174450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+20:18743:x1875523773055872:12345-0@lo:502:mount.lustre.0 Request processed in 110us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639252.123745:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788639252.123861:0:18743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:18743:1875523773055872:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788639252.124044:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788639252.124069:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788639252.124082:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788639252.124093:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788639252.124107:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788639252.124117:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788639252.124126:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788639252.124137:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1788639252.124148:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788639252.124158:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1788639252.124170:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1788639252.124192:0:18743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:18743:1875523773056000:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788639252.124227:0:18743:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639252.124327:0:18743:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24216e300 going to sleep for 11 seconds 00000100:00100000:0.0:1788639252.124384:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773056000 00000100:00100000:0.0:1788639252.124388:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773056000 00000100:00100000:0.0:1788639252.124410:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788639252.124422:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243177050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+20:18743:x1875523773056000:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788639252.124496:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243177050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+20:18743:x1875523773056000:12345-0@lo:502:mount.lustre.0 Request processed in 74us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639252.124502:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788639252.124584:0:18743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:18743:1875523773056000:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788639252.124657:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1788639252.124666:0:18743:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788639252.125208:0:18764:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788639252.125217:0:18764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639252.125219:0:18764:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788639252.125224:0:18764:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ae375ea7800 00000020:00000080:2.0:1788639252.125227:0:18764:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788639252.125233:0:18764:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788639252.125356:0:18764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639252.125357:0:18764:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788639252.125361:0:18764:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788639252.125370:0:18764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639252.125372:0:18764:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788639252.125375:0:18764:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ae375ea7800 00000020:00000080:2.0:1788639252.125378:0:18764:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788639252.125543:0:18764:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788639252.125547:0:18764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639252.125549:0:18764:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788639252.125551:0:18764:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788639252.125553:0:18764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788639252.125554:0:18764:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788639252.125558:0:18764:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ae375ea7800 00000020:00000080:2.0:1788639252.125560:0:18764:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788639252.126412:0:18764:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788639252.126485:0:18764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788639252.126488:0:18764:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788639252.126493:0:18764:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788639252.126496:0:18764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788639252.126497:0:18764:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788639252.126501:0:18764:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ae375ea7800 00000020:00000080:3.0:1788639252.126509:0:18764:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788639252.126554:0:18764:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788639252.126557:0:18764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788639252.126559:0:18764:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788639252.126561:0:18764:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1788639252.136493:0:18743:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788639252.136542:0:18743:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788639252.136570:0:18743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4400/0x25c454990262d4c8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d4cf expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639252.136583:0:18743:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4400/0x25c454990262d4c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d4cf expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788639252.136681:0:18743:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788639252.136684:0:18743:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ae375ea7800 10000000:01000000:2.0:1788639252.136687:0:18743:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ae375ea7800 10000000:01000000:2.0:1788639252.136691:0:18743:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788639252.136696:0:18743:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ae375ea7800 from 1 10000000:01000000:2.0:1788639252.136699:0:18743:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788639252.136743:0:18743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b600/0x25c454990262d4d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639252.136752:0:18743:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b600/0x25c454990262d4d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639252.136776:0:18743:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b600/0x25c454990262d4d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639252.136803:0:18743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:18743:1875523773056128:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788639252.136864:0:18743:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639252.136899:0:18743:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24216e240 going to sleep for 11 seconds 00000100:00100000:0.0:1788639252.136979:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773056128 00000100:00100000:0.0:1788639252.136988:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773056128 00000100:00100000:0.0:1788639252.137033:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788639252.137042:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+20:18743:x1875523773056128:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788639252.137055:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639252.137068:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae375ef5000/0x25c454990262d4dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262d4d6 expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639252.137092:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae375ef5000/0x25c454990262d4dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262d4d6 expref: 21 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639252.137102:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae375ef5000/0x25c454990262d4dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262d4d6 expref: 21 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639252.137110:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375ef5000, rc 0) 00000100:00100000:0.0:1788639252.137149:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+21:18743:x1875523773056128:12345-0@lo:101:mount.lustre.0 Request processed in 107us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639252.137155:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788639252.139346:0:18743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:18743:1875523773056128:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788639252.139381:0:18743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b600/0x25c454990262d4d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d4dd expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639252.139395:0:18743:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b600/0x25c454990262d4d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262d4dd expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788639252.140531:0:18743:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1788639252.141471:0:18743:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788639252.141684:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788639252.141707:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788639252.141724:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788639252.141748:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788639252.141778:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788639252.141791:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788639252.141801:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788639252.141812:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788639252.141823:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788639252.141834:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788639252.141845:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788639252.141856:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788639252.141868:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788639252.141879:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788639252.141899:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788639252.141911:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788639252.141921:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788639252.141932:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788639252.141943:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788639252.141955:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788639252.141980:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788639252.141994:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788639252.142006:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788639252.142018:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788639252.142031:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1788639252.142044:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1788639252.142058:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1788639252.142068:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1788639252.142079:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1788639252.142089:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1788639252.142100:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1788639252.142111:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1788639252.142121:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1788639252.142131:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1788639252.142143:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1788639252.142153:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1788639252.142175:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1788639252.142198:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1788639252.142203:0:18743:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1788639252.144855:0:18743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:18743:1875523773056256:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788639252.144915:0:18743:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639252.145001:0:18743:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae38007d180 going to sleep for 11 seconds 00000100:00100000:0.0:1788639252.151379:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773056256 00000100:00100000:0.0:1788639252.151395:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773056256 00000100:00100000:0.0:1788639252.151512:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788639237/real 1788639237] req@ffff9ae2438cc700 x1875523773045504/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788639252 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639252.151536:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ae2438cc700 x1875523773045504/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788639252 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639252.151556:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788639237/real 1788639237] req@ffff9ae2438cfb80 x1875523773045632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788639252 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639252.151567:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ae2438cfb80 x1875523773045632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788639252 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788639252.151588:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae36ddef800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788639252.151597:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788639252.151600:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773045504:0@lo:8:kworker.0 00000100:00080000:0.0:1788639252.151605:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae375cad000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788639252.151609:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788639252.151611:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773045632:0@lo:8:kworker.0 00000100:00100000:0.0:1788639252.151696:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788639252.151704:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+21:18743:x1875523773056256:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788639252.151861:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+21:18743:x1875523773056256:12345-0@lo:501:mount.lustre.0 Request processed in 157us (6945us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639252.151868:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1788639252.154862:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788639252.154868:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788639252.154871:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ae36ddef800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788639252.154884:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 496 00000100:00080000:2.0:1788639252.154890:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788639252.154895:0:38:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ae36ddef800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788639252.154916:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae375f39500 x1875523773056512/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788639252.154931:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788639252.154934:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788639252.154936:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ae375cad000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788639252.154938:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 496 00000100:00080000:2.0:1788639252.154940:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788639252.154943:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ae375cad000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788639252.154952:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae375f39180 x1875523773056640/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788639252.154977:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788639252.154981:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788639252.154983:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788639252.154987:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788639252.155028:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773056384:0@lo:400:kworker.0 00000100:00100000:2.0:1788639252.155086:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639252.155115:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788639252.155120:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875523773056768:0@lo:400:kworker.0 00000100:00100000:2.0:1788639252.155141:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639252.155169:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773056512:0@lo:8:kworker.0 00000100:00100000:2.0:1788639252.155195:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639252.155226:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773056640:0@lo:8:kworker.0 00000100:00100000:2.0:1788639252.155256:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639252.155283:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773056896:0@lo:400:kworker.0 00000100:00100000:2.0:1788639252.155303:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639252.155320:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788639252.155325:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875523773057024:0@lo:400:kworker.0 00000100:00100000:2.0:1788639252.155343:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639252.155377:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773056384 00000100:00100000:2.0:1788639252.155384:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773056384 00000100:00100000:2.0:1788639252.155414:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773056896 00000100:00100000:2.0:1788639252.155417:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773056896 00000100:00100000:2.0:1788639252.155430:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788639252.155437:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773056384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639252.155482:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773056384:12345-0@lo:400:kworker.0 Request processed in 44us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639252.155488:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788639252.155504:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788639252.155509:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773056896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639252.155536:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773056896:12345-0@lo:400:kworker.0 Request processed in 27us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639252.155542:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788639252.155561:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773056768 00000100:00100000:2.0:1788639252.155565:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773056768 00000100:00100000:2.0:1788639252.155585:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773057024 00000100:00100000:2.0:1788639252.155587:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773057024 00000100:00100000:2.0:1788639252.155602:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788639252.155608:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875523773056768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639252.155697:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875523773056768:12345-0@lo:400:kworker.0 Request processed in 88us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639252.155703:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788639252.155716:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788639252.155722:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875523773057024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639252.155760:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875523773057024:12345-0@lo:400:kworker.0 Request processed in 39us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639252.155765:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788639252.155803:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae375f3ad80 x1875523773056768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639252.155816:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875523773056768:0@lo:400:kworker.0 00000100:00100000:2.0:1788639252.155826:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773056384:0@lo:400:kworker.0 00010000:00080000:2.0:1788639252.155850:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae375f38000 x1875523773057024/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639252.155858:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875523773057024:0@lo:400:kworker.0 00000100:00100000:2.0:1788639252.155866:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773056896:0@lo:400:kworker.0 00000100:00100000:2.0:1788639252.155909:0:18743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:18743:1875523773056256:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788639252.155945:0:18743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a90000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:18743:1875523773057152:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788639252.155983:0:18743:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639252.156002:0:18743:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae38007d180 going to sleep for 11 seconds 00000100:00100000:1.0:1788639252.156468:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773056512 00000100:00100000:1.0:1788639252.156474:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773056512 00000100:00100000:1.0:1788639252.156502:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773056640 00000100:00100000:1.0:1788639252.156505:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773056640 00000100:00100000:1.0:1788639252.156516:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788639252.156521:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1875523773056512:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788639252.156573:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1875523773056512:12345-0@lo:8:kworker.0 Request processed in 51us (1377us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788639252.156579:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788639252.156591:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788639252.156595:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1875523773056640:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788639252.156606:0:18749:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788639252.167706:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773057152 00000100:00100000:2.0:1788639252.167721:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773057152 00000100:00100000:2.0:1788639252.167794:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788639252.167817:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+21:18743:x1875523773057152:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788639252.167990:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+21:18743:x1875523773057152:12345-0@lo:503:mount.lustre.0 Request processed in 174us (12005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639252.167999:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788639252.168073:0:18743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a90000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:18743:1875523773057152:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788639252.169609:0:18743:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788639252.169719:0:18743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a90000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:18743:1875523773057280:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788639252.169802:0:18743:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639252.169837:0:18743:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae38007d180 going to sleep for 11 seconds 00000100:00100000:0.0:1788639252.169935:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773057280 00000100:00100000:0.0:1788639252.169942:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773057280 00000100:00100000:0.0:1788639252.169979:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788639252.169987:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+21:18743:x1875523773057280:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788639252.170089:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+21:18743:x1875523773057280:12345-0@lo:502:mount.lustre.0 Request processed in 103us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639252.170097:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788639252.170255:0:18743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a90000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:18743:1875523773057280:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788639252.170420:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788639252.170442:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788639252.170455:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788639252.170468:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788639252.170480:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788639252.170492:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788639252.170504:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788639252.170514:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788639252.170525:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788639252.170536:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788639252.170546:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788639252.170556:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788639252.170566:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788639252.170577:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788639252.170608:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000100:00100000:0.0:1788639252.170696:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788639252.170709:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae36ddef800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788639252.170714:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788639252.170717:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773056512:0@lo:8:kworker.0 00000100:00100000:1.0:1788639252.173998:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1875523773056640:12345-0@lo:8:kworker.0 Request processed in 17392us (18731us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788639252.174012:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788639252.174074:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae375cad000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788639252.174078:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788639252.174082:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773056640:0@lo:8:kworker.0 00000040:00080000:2.0:1788639252.174315:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788639252.174339:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788639252.174354:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788639252.174382:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788639252.174397:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788639252.174411:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788639252.174424:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788639252.174437:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788639252.174451:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788639252.174465:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1788639252.174480:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1788639252.174494:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1788639252.174508:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1788639252.174522:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1788639252.174535:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1788639252.174569:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1788639252.174585:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1788639252.174600:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1788639252.174611:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1788639252.174654:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1788639252.174669:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1788639252.174683:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1788639252.174697:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1788639252.174710:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1788639252.174723:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1788639252.174749:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1788639252.174763:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1788639252.174776:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1788639252.174790:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1788639252.174804:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1788639252.174818:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1788639252.174845:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1788639252.174862:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1788639252.174913:0:18743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a90000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:18743:1875523773057408:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788639252.174971:0:18743:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639252.175019:0:18743:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae38007d180 going to sleep for 11 seconds 00000100:00100000:1.0:1788639252.175504:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773057408 00000100:00100000:1.0:1788639252.175511:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773057408 00000100:00100000:1.0:1788639252.175634:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788639252.175643:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+21:18743:x1875523773057408:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788639252.175765:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+21:18743:x1875523773057408:12345-0@lo:502:mount.lustre.0 Request processed in 123us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639252.175772:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788639252.175830:0:18743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a90000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:18743:1875523773057408:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788639252.176020:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1788639252.176042:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1788639252.176065:0:18743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244126d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:18743:1875523773057536:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788639252.176101:0:18743:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639252.176116:0:18743:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2431a4240 going to sleep for 11 seconds 00000100:00100000:2.0:1788639252.176607:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773057536 00000100:00100000:2.0:1788639252.176637:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773057536 00000100:00100000:2.0:1788639252.176672:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788639252.176680:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+21:18743:x1875523773057536:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788639252.176780:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+21:18743:x1875523773057536:12345-0@lo:502:mount.lustre.0 Request processed in 100us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639252.176786:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788639252.176905:0:18743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244126d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:18743:1875523773057536:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788639252.176956:0:18743:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1788639252.176965:0:18743:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788639252.177702:0:18771:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788639252.177718:0:18771:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9ae3772499c0) 00000020:00000080:3.0:1788639252.177755:0:18771:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1788639252.177835:0:18771:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ae375ea7800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788639252.177840:0:18771:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ae375ea7800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788639252.177842:0:18771:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ae375ea7800 3 00010000:00080000:3.0:1788639252.177867:0:18771:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ae3691c4000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.118@tcp at head 00010000:00010000:1.0:1788639252.184084:0:18771:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1788639252.184372:0:18771:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788639252.184419:0:18771:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788639252.184437:0:18771:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x25c454990262d4eb 00000100:00080000:1.0:1788639252.184449:0:18771:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788639252.184455:0:18771:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ae3691c4000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:1.0:1788639252.184506:0:18771:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae244126d80 x1875523773057664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788639252.184548:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875523773057664:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788639252.184612:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788639252.184690:0:18771:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788639252.187698:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773057664 00000100:00100000:3.0:1788639252.187713:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773057664 00000100:00100000:3.0:1788639252.187773:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788639252.187781:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875523773057664:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788639252.187812:0:17241:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:3.0:1788639252.187882:0:17241:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x25c454990262d4f2 00000004:00100000:3.0:1788639252.187900:0:17241:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788639252.187948:0:17241:0:(import.c:65:import_set_state_nolock()) ffff9ae3691c7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788639252.188044:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875523773057664:12345-0@lo:38:llog_process_th.0 Request processed in 262us (3431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639252.188052:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788639252.188084:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788639252.188089:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788639252.188092:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788639252.188096:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:1.0:1788639252.189393:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae244126d80 x1875523773057664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788639262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639252.189407:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788639252.189415:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1788639252.189424:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788639252.189429:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788639252.189432:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae3691c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788639252.189439:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875523773057664:0@lo:38:llog_process_th.0 00000020:01000004:2.0:1788639252.191967:0:18771:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788639252.191985:0:18771:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9ae36a0e8000) 00000020:00000080:2.0:1788639252.192010:0:18771:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1788639252.192089:0:18771:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ae375ea7800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788639252.192094:0:18771:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ae375ea7800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788639252.192096:0:18771:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ae375ea7800 3 00010000:00080000:2.0:1788639252.192123:0:18771:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ae3506ed800@lustre-MDT0001-lwp-OST0000: add connection 192.168.206.118@tcp at head 00010000:00010000:2.0:1788639252.194113:0:18771:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1788639252.195469:0:18771:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1788639252.195523:0:18771:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788639252.195537:0:18771:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x25c454990262d500 00000100:00080000:2.0:1788639252.195547:0:18771:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788639252.195554:0:18771:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9ae3506ed800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788639252.195588:0:18771:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae243a90700 x1875523773057792/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788639252.195673:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875523773057792:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788639252.195749:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788639252.196634:0:18771:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788639252.198391:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788639252.198398:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788639252.198401:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788639252.198404:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788639252.198585:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773057792 00000100:00100000:0.0:1788639252.198595:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773057792 00000040:00080000:3.0:1788639252.198774:0:18771:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1788639252.199049:0:18743:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788639252.199078:0:18743:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788639252.199094:0:18743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b600/0x25c454990262d4d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d4dd expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639252.199114:0:18743:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b600/0x25c454990262d4d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d4dd expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788639252.199157:0:18743:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788639252.199160:0:18743:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788639252.199161:0:18743:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788639252.199162:0:18743:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788639252.199164:0:18743:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788639252.199165:0:18743:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788639252.199166:0:18743:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788639252.199168:0:18743:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788639252.199169:0:18743:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788639252.199173:0:18743:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788639252.199175:0:18743:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788639252.199177:0:18743:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788639252.199178:0:18743:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788639252.199179:0:18743:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788639252.199180:0:18743:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788639252.199181:0:18743:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788639252.199182:0:18743:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788639252.199183:0:18743:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788639252.199184:0:18743:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788639252.199206:0:18743:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788639252.199223:0:18743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244126d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:18743:1875523773057920:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788639252.199351:0:18743:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639252.200127:0:18743:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2431a4300 going to sleep for 11 seconds 00000100:00100000:0.0:1788639252.200557:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788639252.200566:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875523773057792:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788639252.200595:0:17240:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:0.0:1788639252.200649:0:17240:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x25c454990262d507 00000004:00100000:0.0:1788639252.200665:0:17240:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788639252.200696:0:17240:0:(import.c:65:import_set_state_nolock()) ffff9ae2433eb800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788639252.200770:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875523773057792:12345-0@lo:38:llog_process_th.0 Request processed in 203us (5019us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639252.200778:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788639252.200835:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ae243a90700 x1875523773057792/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788639262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639252.200846:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788639252.200854:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788639252.200860:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788639252.200864:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788639252.200867:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae3506ed800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788639252.200873:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875523773057792:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788639252.203346:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773057920 00000100:00100000:3.0:1788639252.203357:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773057920 00000100:00100000:3.0:1788639252.203410:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788639252.203420:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+21:18743:x1875523773057920:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788639252.203449:0:17235:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788639252.203462:0:17235:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788639252.208017:0:17235:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788639252.208047:0:17235:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788639252.208459:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+21:18743:x1875523773057920:12345-0@lo:253:mount.lustre.0 Request processed in 5036us (9104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639252.208472:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 20000000:01000000:2.0:1788639252.208542:0:17256:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788639252.208548:0:17256:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788639252.208568:0:17256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ae37f78bc00/0x25c454990262d50e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639252.208594:0:17256:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae3750fb600/0x25c454990262d458 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262d451 expref: 20 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639252.208603:0:17256:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae3750fa600/0x25c454990262d466 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262d45f expref: 20 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639252.208610:0:17256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ae37f78bc00/0x25c454990262d50e lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639252.208687:0:17256:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae3750fa600/0x25c454990262d466 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262d45f expref: 20 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639252.208702:0:17256:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae3750fa600/0x25c454990262d466 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262d45f expref: 20 pid: 17233 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639252.208715:0:17256:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a92d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17256:1875523773058048:0@lo:104: 00000100:00100000:2.0:1788639252.208762:0:17256:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788639252.208804:0:17256:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae3750fb600/0x25c454990262d458 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262d451 expref: 20 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639252.208813:0:17256:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae3750fb600/0x25c454990262d458 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262d451 expref: 20 pid: 17235 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639252.208827:0:17256:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a92300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17256:1875523773058176:0@lo:104: 00000100:00100000:2.0:1788639252.208855:0:17256:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639252.208872:0:17256:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae38007d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788639252.208897:0:17225:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788639252.208906:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773058048 00000100:00100000:2.0:1788639252.208911:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773058048 00000100:00100000:2.0:1788639252.208945:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773058176 00000100:00100000:2.0:1788639252.208948:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773058176 00000100:00100000:2.0:1788639252.208958:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788639252.208964:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4d225031-35be-4b74-b245-637fda218215+4:17256:x1875523773058048:12345-0@lo:104: 00010000:00010000:2.0:1788639252.208975:0:17225:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4800/0x25c454990262d45f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262d466 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639252.209025:0:17225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788639252.209030:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4d225031-35be-4b74-b245-637fda218215+4:17256:x1875523773058048:12345-0@lo:104: Request processed in 67us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639252.209036:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788639252.209048:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788639252.209053:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3483e4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4d225031-35be-4b74-b245-637fda218215+3:17256:x1875523773058176:12345-0@lo:104: 00010000:00010000:2.0:1788639252.209061:0:17225:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae375ef5400/0x25c454990262d451 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262d458 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639252.209089:0:17225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788639252.209093:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3483e4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4d225031-35be-4b74-b245-637fda218215+3:17256:x1875523773058176:12345-0@lo:104: Request processed in 40us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639252.209098:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788639252.209129:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788639252.209135:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4800/0x25c454990262d45f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262d466 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639252.209142:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef4800 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:2.0:1788639252.209146:0:17229:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4800/0x25c454990262d45f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262d466 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639252.209154:0:17229:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4800/0x25c454990262d45f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262d466 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788639252.209166:0:17229:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4800/0x25c454990262d45f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262d466 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788639252.209172:0:17229:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788639252.209196:0:17229:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4800/0x25c454990262d45f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262d466 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639252.209202:0:17229:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788639252.209217:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4800/0x25c454990262d45f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262d466 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639252.209223:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4800/0x25c454990262d45f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262d466 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639252.209303:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788639252.209307:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae375ef5400/0x25c454990262d451 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262d458 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639252.209313:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef5400 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:2.0:1788639252.209315:0:17229:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae375ef5400/0x25c454990262d451 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262d458 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639252.209322:0:17229:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae375ef5400/0x25c454990262d451 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262d458 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788639252.209328:0:17229:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae375ef5400/0x25c454990262d451 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262d458 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788639252.209333:0:17229:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788639252.209353:0:17229:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae375ef5400/0x25c454990262d451 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262d458 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639252.209358:0:17229:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788639252.209364:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae375ef5400/0x25c454990262d451 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262d458 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639252.209370:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae375ef5400/0x25c454990262d451 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262d458 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639252.209381:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639252.209383:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639252.209385:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639252.209391:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639252.209407:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4d225031-35be-4b74-b245-637fda218215:3641:1875523773058304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788639252.209432:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639252.209453:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788639252.209458:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4d225031-35be-4b74-b245-637fda218215:3641:1875523773058432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788639252.209477:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639252.209503:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773058304 00000100:00100000:2.0:1788639252.209506:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773058304 00010000:00010000:2.0:1788639252.209520:0:17227:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae3750fa600/0x25c454990262d466 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262d45f expref: 21 pid: 17233 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639252.209538:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773058432 00000100:00100000:2.0:1788639252.209540:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773058432 00010000:00010000:2.0:1788639252.209550:0:17227:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae3750fb600/0x25c454990262d458 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262d451 expref: 22 pid: 17235 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639252.209559:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788639252.209564:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d225031-35be-4b74-b245-637fda218215+22:3641:x1875523773058304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788639252.209579:0:17227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788639252.209584:0:17227:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae3750fa600/0x25c454990262d466 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262d45f expref: 22 pid: 17233 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639252.209593:0:17227:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae3750fa600/0x25c454990262d466 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262d45f expref: 22 pid: 17233 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639252.209608:0:17227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788639252.209658:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d225031-35be-4b74-b245-637fda218215+22:3641:x1875523773058304:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639252.209664:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788639252.209677:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788639252.209683:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae34af6a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d225031-35be-4b74-b245-637fda218215+21:3641:x1875523773058432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788639252.209690:0:17227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788639252.209694:0:17227:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae3750fb600/0x25c454990262d458 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262d451 expref: 21 pid: 17235 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639252.209702:0:17227:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae3750fb600/0x25c454990262d458 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262d451 expref: 21 pid: 17235 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639252.209714:0:17227:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ae37f78bc00/0x25c454990262d50e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639252.209722:0:17227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae37f78bc00/0x25c454990262d50e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788639252.209745:0:17227:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003517559s 00010000:00010000:2.0:1788639252.209749:0:17227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae37f78bc00/0x25c454990262d50e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639252.209765:0:17227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae37f78bc00/0x25c454990262d50e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639252.209772:0:17227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ae37f78bc00/0x25c454990262d50e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639252.209779:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ae37f78bc00/0x25c454990262d50e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639252.209784:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78bc00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:2.0:1788639252.209789:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ae37f78bc00/0x25c454990262d50e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639252.209796:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ae37f78bc00/0x25c454990262d50e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639252.209803:0:17256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae3750fa600/0x25c454990262d466 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262d45f expref: 21 pid: 17233 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639252.209807:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ae37f78bc00/0x25c454990262d50e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639252.209823:0:17256:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a92d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17256:1875523773058048:0@lo:104: 00010000:00010000:2.0:1788639252.209824:0:17227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788639252.209840:0:17256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae3750fb600/0x25c454990262d458 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262d451 expref: 20 pid: 17235 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639252.209850:0:17256:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a92300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17256:1875523773058176:0@lo:104: 00000100:00100000:2.0:1788639252.209857:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae34af6a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d225031-35be-4b74-b245-637fda218215+19:3641:x1875523773058432:12345-0@lo:103:ldlm_bl.0 Request processed in 173us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639252.209866:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788639252.209871:0:17256:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ae37f78bc00/0x25c454990262d50e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639252.209882:0:17256:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ae37f78bc00/0x25c454990262d50e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639252.209890:0:17256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ae37f78bc00/0x25c454990262d50e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639252.209896:0:17256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae37f78bc00/0x25c454990262d50e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639252.209946:0:18743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244126d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:18743:1875523773057920:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788639252.209956:0:18743:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788639252.209959:0:18743:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788639252.209960:0:18743:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788639252.209961:0:18743:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788639252.209962:0:18743:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788639252.209963:0:18743:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788639252.209969:0:18743:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788639252.209971:0:18743:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788639252.209973:0:18743:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788639252.209974:0:18743:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788639252.209984:0:18743:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788639252.210020:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4d225031-35be-4b74-b245-637fda218215:3641:1875523773058432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788639252.210027:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4d225031-35be-4b74-b245-637fda218215:3641:1875523773058304:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1788639252.212565:0:18743:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788639252.217597:0:18743:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788639252.217607:0:18743:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788639252.217769:0:18743:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788639252.217809:0:18743:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.118@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788639252.217831:0:18743:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788639252.217847:0:18743:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1788639252.218653:0:18743:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788639252.218883:0:18743:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788639252.789584:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788639252.913811:0:18824:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788639252.914041:0:18824:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1788639253.748666:0:17238:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788639253.748673:0:17238:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ae34303d000 from 9 10000000:01000000:2.0:1788639253.748677:0:17238:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788639253.748716:0:17238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78bc00/0x25c454990262d515 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639253.748740:0:17238:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae37f78bc00/0x25c454990262d515 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639253.748751:0:17238:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae37f78bc00/0x25c454990262d515 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639253.748773:0:17238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773058560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788639253.748842:0:17238:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639253.749076:0:17238:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344c1e480 going to sleep for 11 seconds 00000100:00100000:2.0:1788639253.749095:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773058560 00000100:00100000:2.0:1788639253.749101:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773058560 00000100:00100000:2.0:1788639253.749141:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788639253.749150:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+19:17238:x1875523773058560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788639253.749161:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639253.749173:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae37f78b000/0x25c454990262d51c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262d515 expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639253.749194:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae37f78b000/0x25c454990262d51c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262d515 expref: 20 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639253.749213:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae37f78b000/0x25c454990262d51c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262d515 expref: 20 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639253.749221:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78b000, rc 0) 00000100:00100000:2.0:1788639253.750944:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+20:17238:x1875523773058560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1792us (2098us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639253.750952:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788639253.751717:0:17238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773058560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788639253.751752:0:17238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae37f78bc00/0x25c454990262d515 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d51c expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639253.751764:0:17238:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae37f78bc00/0x25c454990262d515 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262d51c expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639253.751824:0:17238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773058688:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788639253.751869:0:17238:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639253.751902:0:17238:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae345521c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788639253.752407:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773058688 00000100:00100000:1.0:1788639253.752415:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773058688 00000100:00100000:1.0:1788639253.752468:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788639253.752478:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+20:17238:x1875523773058688:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788639253.752498:0:17235:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788639253.752514:0:17235:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788639253.752517:0:17235:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1788639253.752606:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+20:17238:x1875523773058688:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 130us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639253.752633:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788639253.756262:0:17238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773058688:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788639253.756342:0:17238:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788639253.756352:0:17238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78bc00/0x25c454990262d515 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d51c expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639253.756363:0:17238:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae37f78bc00/0x25c454990262d515 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d51c expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639253.756373:0:17238:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788639253.756376:0:17238:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ae243aeb000 from 9 10000000:01000000:0.0:1788639253.756378:0:17238:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788639253.756411:0:17238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4c00/0x25c454990262d523 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639253.756428:0:17238:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4c00/0x25c454990262d523 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639253.756437:0:17238:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4c00/0x25c454990262d523 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639253.756456:0:17238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773058816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788639253.756507:0:17238:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639253.756546:0:17238:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae343acb240 going to sleep for 11 seconds 00000100:00100000:0.0:1788639253.756577:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773058816 00000100:00100000:0.0:1788639253.756583:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773058816 00000100:00100000:0.0:1788639253.756649:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788639253.756658:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+20:17238:x1875523773058816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788639253.756671:0:17236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639253.756684:0:17236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae375ef5e00/0x25c454990262d52a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262d523 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639253.756705:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae375ef5e00/0x25c454990262d52a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262d523 expref: 21 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639253.756717:0:17236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae375ef5e00/0x25c454990262d52a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262d523 expref: 21 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639253.756742:0:17236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375ef5e00, rc 0) 00000100:00100000:0.0:1788639253.756780:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+21:17238:x1875523773058816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639253.756786:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788639253.756834:0:17238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773058816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788639253.756846:0:17238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4c00/0x25c454990262d523 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d52a expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639253.756855:0:17238:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4c00/0x25c454990262d523 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262d52a expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639253.756894:0:17238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773058944:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788639253.756937:0:17238:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639253.756948:0:17238:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae343acb240 going to sleep for 11 seconds 00000100:00100000:0.0:1788639253.757125:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773058944 00000100:00100000:0.0:1788639253.757130:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773058944 00000100:00100000:0.0:1788639253.757151:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788639253.757156:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+21:17238:x1875523773058944:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788639253.757167:0:17236:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788639253.757180:0:17236:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788639253.757183:0:17236:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1788639253.757248:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+21:17238:x1875523773058944:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 91us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639253.757253:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788639253.757281:0:17238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773058944:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788639253.757323:0:17238:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788639253.757328:0:17238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4c00/0x25c454990262d523 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d52a expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639253.757335:0:17238:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4c00/0x25c454990262d523 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d52a expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639253.813912:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639254.710264:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773059072:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788639254.710741:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639254.711130:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773059072 00000100:00100000:2.0:1788639254.711143:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773059072 00000100:00100000:2.0:1788639254.711223:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788639254.711240:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773059072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788639254.711289:0:17245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788639254.711371:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773059072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 134us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639254.711379:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788639254.712162:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773059072:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788639254.837187:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639255.221830:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788639255.221861:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773059200:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788639255.221951:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639255.222120:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773059200 00000100:00100000:2.0:1788639255.222132:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773059200 00000100:00100000:2.0:1788639255.222196:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788639255.222209:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523773059200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788639255.222325:0:17246:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788639255.222396:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523773059200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 190us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639255.222405:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788639255.222951:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773059200:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788639255.861911:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639256.886220:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788639257.268885:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788639257.268891:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788639257.268895:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ae36ddef800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788639257.268909:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ae36ddef800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:1.0:1788639257.268935:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae244125c00 x1875523773059584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788639257.268953:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788639257.268956:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788639257.268957:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ae375cad000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788639257.268962:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 510 00000100:00080000:1.0:1788639257.268968:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788639257.268971:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ae375cad000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:1.0:1788639257.268994:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae244125f80 x1875523773059712/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788639257.269024:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788639257.269027:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788639257.269030:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788639257.269033:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788639257.269149:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773059456:0@lo:400:kworker.0 00000100:00100000:3.0:1788639257.269179:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4d225031-35be-4b74-b245-637fda218215:3641:1875523773059328:0@lo:400:kworker.0 00000100:00100000:3.0:1788639257.269230:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639257.269230:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639257.269265:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875523773060096:0@lo:400:kworker.0 00000100:00100000:3.0:1788639257.269294:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639257.269330:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773060096 00000100:00100000:3.0:1788639257.269338:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773060096 00000100:00100000:3.0:1788639257.269381:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788639257.269389:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875523773060096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639257.269435:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875523773060096:12345-0@lo:400:kworker.0 Request processed in 47us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639257.269442:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788639257.269478:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae244124000 x1875523773060096/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639257.269491:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875523773060096:0@lo:400:kworker.0 00000100:00100000:0.0:1788639257.270085:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244125c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773059584:0@lo:8:kworker.0 00000100:00100000:0.0:1788639257.270123:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639257.270158:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773059712:0@lo:8:kworker.0 00000100:00100000:0.0:1788639257.270241:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639257.270277:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244126a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523773059840:0@lo:400:kworker.0 00000100:00100000:0.0:1788639257.270302:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639257.270320:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875523773060352:0@lo:400:kworker.0 00000100:00100000:3.0:1788639257.270323:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773059584 00000100:00100000:3.0:1788639257.270328:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773059584 00000100:00100000:0.0:1788639257.270339:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639257.270349:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773059712 00000100:00100000:3.0:1788639257.270352:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773059712 00000100:00100000:3.0:1788639257.270362:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788639257.270363:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788639257.270368:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3640:x1875523773059584:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788639257.270369:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773059968:0@lo:400:kworker.0 00000100:00100000:0.0:1788639257.270389:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788639257.270396:0:18750:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 516 last 0 00000100:00100000:0.0:1788639257.270416:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773059328 00000100:00100000:0.0:1788639257.270420:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773059328 00000020:00000080:3.0:1788639257.270434:0:18750:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x25c454990262d531 00000100:00100000:0.0:1788639257.270445:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788639257.270450:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+21:3641:x1875523773059328:12345-0@lo:400:kworker.0 00002000:00100000:3.0:1788639257.270454:0:18750:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9ae3691c7000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788639257.270458:0:18750:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788639257.270461:0:18750:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1788639257.270486:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+21:3641:x1875523773059328:12345-0@lo:400:kworker.0 Request processed in 35us (1255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639257.270491:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788639257.270520:0:17981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773059456 00000100:00100000:0.0:1788639257.270523:0:17981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773059456 00000100:00100000:0.0:1788639257.270540:0:17981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773059968 00000100:00100000:0.0:1788639257.270548:0:17981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773059968 00000100:00100000:0.0:1788639257.270564:0:17981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788639257.270570:0:17981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773059456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639257.270601:0:17981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773059456:12345-0@lo:400:kworker.0 Request processed in 31us (1371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639257.270607:0:17981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788639257.270634:0:17981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788639257.270641:0:17981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773059968:12345-0@lo:400:kworker.0 00002000:00080000:3.0:1788639257.270656:0:18750:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:0.0:1788639257.270671:0:17981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773059968:12345-0@lo:400:kworker.0 Request processed in 31us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639257.270676:0:17981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1788639257.270686:0:18750:0:(import.c:65:import_set_state_nolock()) ffff9ae3691c0800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788639257.270695:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773059840 00000100:00100000:0.0:1788639257.270698:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773059840 00000100:00100000:0.0:1788639257.270730:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773060352 00000100:00100000:0.0:1788639257.270734:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773060352 00000100:00100000:3.0:1788639257.270736:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1875523773059584:12345-0@lo:8:kworker.0 Request processed in 367us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639257.270742:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788639257.270755:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788639257.270755:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788639257.270760:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523773059840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639257.270770:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3640:x1875523773059712:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788639257.270782:0:18750:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788639257.270788:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523773059840:12345-0@lo:400:kworker.0 Request processed in 28us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639257.270793:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788639257.270803:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788639257.270808:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875523773060352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639257.270833:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875523773060352:12345-0@lo:400:kworker.0 Request processed in 25us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639257.270839:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788639257.270870:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773059968:0@lo:400:kworker.0 00010000:00080000:0.0:1788639257.270891:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae244126a00 x1875523773059840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639257.270899:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244126a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523773059840:0@lo:400:kworker.0 00010000:00080000:0.0:1788639257.270907:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae244124a80 x1875523773060352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639257.270914:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875523773060352:0@lo:400:kworker.0 00000100:00100000:2.0:1788639257.271024:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773059456:0@lo:400:kworker.0 00000100:00100000:2.0:1788639257.271032:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244127480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875523773060224:0@lo:400:kworker.0 00000100:00100000:2.0:1788639257.271060:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788639257.271120:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788639257.272310:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773060224 00000100:00100000:1.0:1788639257.272319:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773060224 00000100:00100000:1.0:1788639257.272363:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788639257.272372:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875523773060224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639257.272438:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875523773060224:12345-0@lo:400:kworker.0 Request processed in 69us (1377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639257.272446:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788639257.272463:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788639257.272488:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae244127480 x1875523773060224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639257.272500:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244127480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875523773060224:0@lo:400:kworker.0 00000100:00100000:2.0:1788639257.274737:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4d225031-35be-4b74-b245-637fda218215:3641:1875523773059328:0@lo:400:kworker.0 00010000:00080000:2.0:1788639257.276739:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae244125c00 x1875523773059584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788639277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788639257.276761:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788639257.276770:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788639257.276776:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788639257.276779:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae36ddef800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788639257.276803:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788639257.276809:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244125c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773059584:0@lo:8:kworker.0 00000004:00080000:1.0:1788639257.276885:0:17264:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788639257.276972:0:17264:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 516071354967ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788639257.276978:0:17264:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1788639257.278771:0:17265:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:2.0:1788639257.278801:0:17265:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a93b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17265:1875523773060608:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788639257.278862:0:17265:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639257.278890:0:17265:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae343acb240 going to sleep for 11 seconds 00000100:00100000:0.0:1788639257.278940:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773060480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788639257.278970:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639257.279023:0:18747:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788639257.279030:0:18747:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788639257.279134:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773060480 00000100:00100000:2.0:1788639257.279142:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773060480 00000100:00100000:2.0:1788639257.279844:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788639257.279855:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875523773060480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788639257.279896:0:18751:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788639257.279954:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875523773060480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639257.279970:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788639257.280059:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788639257.280092:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae243a90e00 x1875523773060480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639273 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639257.280112:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773060480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788639257.280476:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773060608 00000100:00100000:0.0:1788639257.280483:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773060608 00000004:00080000:2.0:1788639257.280560:0:17221:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1788639257.280678:0:19077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788639257.280686:0:19077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17265:x1875523773060608:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788639257.284087:0:19077:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1788639257.284099:0:19077:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1788639257.284104:0:19077:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00000100:00100000:3.0:1788639257.302238:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3640:x1875523773059712:12345-0@lo:8:kworker.0 Request processed in 31471us (31989us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788639257.302252:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788639257.302380:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae375cad000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788639257.302386:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788639257.302392:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773059712:0@lo:8:kworker.0 00002000:00010000:2.0:1788639257.312789:0:19077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788639257.312801:0:19077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f8bd22d/0x25c454990262d538 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.312818:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=516s v=(0 0) 00010000:00010000:2.0:1788639257.312823:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788639257.312829:0:19077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f8bd22d/0x25c454990262d538 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.312848:0:19077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f8bd22d/0x25c454990262d538 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.312860:0:19077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f8bd22d/0x25c454990262d538 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.312883:0:19077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f8bd22d/0x25c454990262d538 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.312905:0:19077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788639257.313188:0:18396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639257.313195:0:18396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f8bd22d/0x25c454990262d538 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.313204:0:18396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78b800 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639257.313216:0:18396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f8bd22d/0x25c454990262d538 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.313227:0:18396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f8bd22d/0x25c454990262d538 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.313246:0:18396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f8bd22d/0x25c454990262d538 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.313266:0:18396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f8bd22d/0x25c454990262d538 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.313285:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639257.313288:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639257.313289:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788639257.320358:0:19077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788639257.320372:0:19077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bc433ab/0x25c454990262d53f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.320390:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1788639257.320394:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639257.320401:0:19077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004bc433ab/0x25c454990262d53f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.320418:0:19077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004bc433ab/0x25c454990262d53f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.320428:0:19077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bc433ab/0x25c454990262d53f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.320446:0:19077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004bc433ab/0x25c454990262d53f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.320469:0:19077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788639257.320878:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639257.320887:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004bc433ab/0x25c454990262d53f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.320895:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f8c00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639257.320899:0:17230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004bc433ab/0x25c454990262d53f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.320907:0:17230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004bc433ab/0x25c454990262d53f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.320924:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004bc433ab/0x25c454990262d53f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.320930:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004bc433ab/0x25c454990262d53f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.320947:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639257.320949:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639257.320950:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788639257.323042:0:19077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788639257.323055:0:19077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fc2fbef/0x25c454990262d546 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.323069:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1788639257.323073:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639257.323079:0:19077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fc2fbef/0x25c454990262d546 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.323092:0:19077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fc2fbef/0x25c454990262d546 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.323102:0:19077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fc2fbef/0x25c454990262d546 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.323109:0:19077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003fc2fbef/0x25c454990262d546 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.323135:0:19077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788639257.323263:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788639257.323270:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003fc2fbef/0x25c454990262d546 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.323278:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f8a00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:2.0:1788639257.323282:0:17229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003fc2fbef/0x25c454990262d546 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.323291:0:17229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003fc2fbef/0x25c454990262d546 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.323307:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003fc2fbef/0x25c454990262d546 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.323315:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fc2fbef/0x25c454990262d546 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.323335:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639257.323337:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639257.323339:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788639257.323880:0:19077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788639257.323887:0:19077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3c8c6a2/0x25c454990262d54d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.323903:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1788639257.323906:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639257.323911:0:19077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3c8c6a2/0x25c454990262d54d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.323922:0:19077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3c8c6a2/0x25c454990262d54d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.323931:0:19077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3c8c6a2/0x25c454990262d54d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.323938:0:19077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3c8c6a2/0x25c454990262d54d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.323989:0:19077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788639257.325277:0:19077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788639257.325289:0:19077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8a6ba4d/0x25c454990262d554 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.325301:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1788639257.325305:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639257.325309:0:19077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8a6ba4d/0x25c454990262d554 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.325321:0:19077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8a6ba4d/0x25c454990262d554 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.325344:0:19077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8a6ba4d/0x25c454990262d554 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.325351:0:19077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8a6ba4d/0x25c454990262d554 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.328814:0:18396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788639257.328833:0:18396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3c8c6a2/0x25c454990262d54d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.328846:0:18396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f9600 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:2.0:1788639257.328851:0:18396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3c8c6a2/0x25c454990262d54d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.328862:0:18396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3c8c6a2/0x25c454990262d54d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.328882:0:18396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3c8c6a2/0x25c454990262d54d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.328890:0:18396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3c8c6a2/0x25c454990262d54d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.328910:0:18396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788639257.328913:0:18396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8a6ba4d/0x25c454990262d554 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.328919:0:18396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f9800 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:2.0:1788639257.328922:0:18396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8a6ba4d/0x25c454990262d554 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.328928:0:18396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8a6ba4d/0x25c454990262d554 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.328952:0:18396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8a6ba4d/0x25c454990262d554 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.328961:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639257.328962:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639257.328965:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639257.329269:0:19077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788639257.329277:0:19077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8a6ba4d/0x25c454990262d554 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788639257.330374:0:19077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788639257.330383:0:19077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021ec1855/0x25c454990262d55b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.330397:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1788639257.330401:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639257.330408:0:19077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021ec1855/0x25c454990262d55b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.330421:0:19077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021ec1855/0x25c454990262d55b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.330431:0:19077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021ec1855/0x25c454990262d55b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.330450:0:19077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021ec1855/0x25c454990262d55b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.334222:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639257.334237:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021ec1855/0x25c454990262d55b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.334250:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f8200 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639257.334254:0:17230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021ec1855/0x25c454990262d55b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.334265:0:17230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021ec1855/0x25c454990262d55b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.334286:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021ec1855/0x25c454990262d55b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.334295:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639257.334297:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639257.334299:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639257.335969:0:19077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788639257.335982:0:19077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021ec1855/0x25c454990262d55b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788639257.336905:0:19077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788639257.336915:0:19077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fee87d85/0x25c454990262d562 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.336929:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=516s v=(0 0) 00010000:00010000:0.0:1788639257.336934:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788639257.336939:0:19077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fee87d85/0x25c454990262d562 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.336954:0:19077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fee87d85/0x25c454990262d562 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.336976:0:19077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fee87d85/0x25c454990262d562 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.336984:0:19077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fee87d85/0x25c454990262d562 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.338759:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788639257.338773:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fee87d85/0x25c454990262d562 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.338787:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef5c00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:2.0:1788639257.338792:0:17229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fee87d85/0x25c454990262d562 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.338803:0:17229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fee87d85/0x25c454990262d562 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.338824:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fee87d85/0x25c454990262d562 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.338836:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639257.338838:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639257.338840:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639257.342203:0:19077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788639257.342218:0:19077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fee87d85/0x25c454990262d562 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.342294:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788639257.346072:0:19077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788639257.346085:0:19077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6600111/0x25c454990262d569 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.346115:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=516s v=(0 0) 00010000:00010000:2.0:1788639257.346120:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788639257.346126:0:19077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6600111/0x25c454990262d569 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.346140:0:19077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6600111/0x25c454990262d569 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.346162:0:19077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6600111/0x25c454990262d569 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.346171:0:19077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6600111/0x25c454990262d569 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.346196:0:19077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788639257.346259:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639257.346267:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6600111/0x25c454990262d569 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.346278:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78aa00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639257.346282:0:17230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6600111/0x25c454990262d569 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.346294:0:17230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6600111/0x25c454990262d569 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.346310:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6600111/0x25c454990262d569 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.346318:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6600111/0x25c454990262d569 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.346341:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639257.346343:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639257.346345:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788639257.346907:0:19077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788639257.346916:0:19077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027e6f44d/0x25c454990262d570 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.346926:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=516s v=(0 0) 00010000:00010000:2.0:1788639257.346930:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788639257.346935:0:19077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027e6f44d/0x25c454990262d570 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.346946:0:19077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027e6f44d/0x25c454990262d570 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.346967:0:19077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027e6f44d/0x25c454990262d570 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.346975:0:19077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027e6f44d/0x25c454990262d570 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.346999:0:19077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788639257.347324:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639257.347330:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027e6f44d/0x25c454990262d570 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.347339:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78ac00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639257.347343:0:17229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027e6f44d/0x25c454990262d570 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.347350:0:17229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027e6f44d/0x25c454990262d570 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.347365:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027e6f44d/0x25c454990262d570 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.347373:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027e6f44d/0x25c454990262d570 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.347389:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639257.347391:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639257.347393:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788639257.347801:0:19077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788639257.347809:0:19077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037681740/0x25c454990262d577 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.347819:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=516s v=(0 0) 00010000:00010000:2.0:1788639257.347822:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788639257.347827:0:19077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037681740/0x25c454990262d577 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.347838:0:19077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037681740/0x25c454990262d577 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.347845:0:19077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037681740/0x25c454990262d577 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.347853:0:19077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037681740/0x25c454990262d577 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.347887:0:19077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788639257.348128:0:18396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788639257.348135:0:18396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037681740/0x25c454990262d577 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.348144:0:18396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78a600 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:3.0:1788639257.348148:0:18396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037681740/0x25c454990262d577 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.348162:0:18396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037681740/0x25c454990262d577 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.348183:0:18396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037681740/0x25c454990262d577 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.348191:0:18396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037681740/0x25c454990262d577 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.348217:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639257.348218:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639257.348220:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788639257.358780:0:19077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788639257.358795:0:19077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021ec1855/0x25c454990262d57e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.358813:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1788639257.358818:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639257.358825:0:19077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021ec1855/0x25c454990262d57e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.358840:0:19077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021ec1855/0x25c454990262d57e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.358851:0:19077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021ec1855/0x25c454990262d57e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.358859:0:19077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021ec1855/0x25c454990262d57e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.358878:0:19077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788639257.359432:0:19077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788639257.359440:0:19077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8a6ba4d/0x25c454990262d585 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.359460:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1788639257.359464:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639257.359469:0:19077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8a6ba4d/0x25c454990262d585 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.359479:0:19077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8a6ba4d/0x25c454990262d585 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.359487:0:19077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8a6ba4d/0x25c454990262d585 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.359493:0:19077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8a6ba4d/0x25c454990262d585 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.359519:0:19077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788639257.359587:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788639257.359595:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021ec1855/0x25c454990262d57e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639257.359637:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f8200 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:1.0:1788639257.359644:0:17229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021ec1855/0x25c454990262d57e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639257.359655:0:17229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021ec1855/0x25c454990262d57e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639257.359675:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021ec1855/0x25c454990262d57e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639257.359684:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021ec1855/0x25c454990262d57e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639257.359702:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788639257.359717:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8a6ba4d/0x25c454990262d585 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639257.359724:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f9800 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:1.0:1788639257.359728:0:17229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8a6ba4d/0x25c454990262d585 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639257.359736:0:17229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8a6ba4d/0x25c454990262d585 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639257.359747:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8a6ba4d/0x25c454990262d585 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639257.359761:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8a6ba4d/0x25c454990262d585 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639257.359775:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639257.359778:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639257.359779:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639257.359830:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788639257.359912:0:19077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788639257.359919:0:19077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088d60a44/0x25c454990262d58c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.359928:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1788639257.359931:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639257.359935:0:19077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088d60a44/0x25c454990262d58c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.359944:0:19077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088d60a44/0x25c454990262d58c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.359963:0:19077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088d60a44/0x25c454990262d58c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.359971:0:19077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088d60a44/0x25c454990262d58c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.359999:0:19077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788639257.360511:0:18396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788639257.360518:0:18396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088d60a44/0x25c454990262d58c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639257.360526:0:18396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f9200 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:1.0:1788639257.360529:0:18396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088d60a44/0x25c454990262d58c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639257.360538:0:18396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088d60a44/0x25c454990262d58c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639257.360551:0:18396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088d60a44/0x25c454990262d58c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639257.360559:0:18396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088d60a44/0x25c454990262d58c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639257.360574:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639257.360576:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639257.360577:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788639257.360700:0:19077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788639257.360721:0:19077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3c8c6a2/0x25c454990262d593 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.360729:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1788639257.360733:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639257.360737:0:19077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3c8c6a2/0x25c454990262d593 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.360747:0:19077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3c8c6a2/0x25c454990262d593 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.360754:0:19077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3c8c6a2/0x25c454990262d593 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.360762:0:19077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3c8c6a2/0x25c454990262d593 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.360789:0:19077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788639257.361227:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788639257.361233:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3c8c6a2/0x25c454990262d593 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639257.361241:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f9600 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:1.0:1788639257.361245:0:17229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3c8c6a2/0x25c454990262d593 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639257.361253:0:17229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3c8c6a2/0x25c454990262d593 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639257.361265:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3c8c6a2/0x25c454990262d593 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639257.361273:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3c8c6a2/0x25c454990262d593 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639257.361287:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639257.361289:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639257.361290:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788639257.361516:0:19077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788639257.361522:0:19077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bc433ab/0x25c454990262d59a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.361531:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1788639257.361534:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639257.361539:0:19077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004bc433ab/0x25c454990262d59a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.361548:0:19077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004bc433ab/0x25c454990262d59a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.361556:0:19077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bc433ab/0x25c454990262d59a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.361563:0:19077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004bc433ab/0x25c454990262d59a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.361581:0:19077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788639257.361897:0:19077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788639257.361903:0:19077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fc2fbef/0x25c454990262d5a1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.361911:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1788639257.361920:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639257.361924:0:19077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fc2fbef/0x25c454990262d5a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.361934:0:19077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fc2fbef/0x25c454990262d5a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.361943:0:19077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fc2fbef/0x25c454990262d5a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.361949:0:19077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003fc2fbef/0x25c454990262d5a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.361964:0:19077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788639257.362219:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788639257.362226:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004bc433ab/0x25c454990262d59a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.362240:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f8c00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639257.362243:0:17230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004bc433ab/0x25c454990262d59a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.362252:0:17230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004bc433ab/0x25c454990262d59a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.362265:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004bc433ab/0x25c454990262d59a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.362272:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004bc433ab/0x25c454990262d59a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.362287:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639257.362290:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003fc2fbef/0x25c454990262d5a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.362296:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f8a00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639257.362299:0:17230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003fc2fbef/0x25c454990262d5a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.362305:0:17230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003fc2fbef/0x25c454990262d5a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.362313:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003fc2fbef/0x25c454990262d5a1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.362325:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fc2fbef/0x25c454990262d5a1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.362337:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639257.362339:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639257.362341:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639257.362487:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788639257.362561:0:19077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788639257.362568:0:19077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020dc9e51/0x25c454990262d5a8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.362576:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1788639257.362579:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639257.362583:0:19077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020dc9e51/0x25c454990262d5a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.362592:0:19077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020dc9e51/0x25c454990262d5a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.362600:0:19077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020dc9e51/0x25c454990262d5a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.362640:0:19077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020dc9e51/0x25c454990262d5a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.362656:0:19077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788639257.363588:0:19077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788639257.363597:0:19077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb6d8594/0x25c454990262d5af lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.363608:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1788639257.363611:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639257.363631:0:19077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb6d8594/0x25c454990262d5af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.363643:0:19077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb6d8594/0x25c454990262d5af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.363652:0:19077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb6d8594/0x25c454990262d5af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.363659:0:19077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb6d8594/0x25c454990262d5af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.363679:0:19077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788639257.363872:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788639257.363880:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020dc9e51/0x25c454990262d5a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.363889:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f8000 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:2.0:1788639257.363893:0:17230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020dc9e51/0x25c454990262d5a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.363903:0:17230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020dc9e51/0x25c454990262d5a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.363917:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020dc9e51/0x25c454990262d5a8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.363925:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020dc9e51/0x25c454990262d5a8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.363942:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788639257.363945:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb6d8594/0x25c454990262d5af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.363951:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f8600 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:2.0:1788639257.363954:0:17230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb6d8594/0x25c454990262d5af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.363973:0:17230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb6d8594/0x25c454990262d5af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.363983:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb6d8594/0x25c454990262d5af lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.363990:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb6d8594/0x25c454990262d5af lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.364002:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639257.364003:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639257.364005:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788639257.364098:0:19077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788639257.364104:0:19077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf1ab88a/0x25c454990262d5b6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.364117:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1788639257.364120:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639257.364124:0:19077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf1ab88a/0x25c454990262d5b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.364134:0:19077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf1ab88a/0x25c454990262d5b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.364142:0:19077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf1ab88a/0x25c454990262d5b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.364149:0:19077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf1ab88a/0x25c454990262d5b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.364171:0:19077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788639257.364206:0:18396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788639257.364212:0:18396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf1ab88a/0x25c454990262d5b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.364219:0:18396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f9000 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:2.0:1788639257.364223:0:18396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf1ab88a/0x25c454990262d5b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.364231:0:18396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf1ab88a/0x25c454990262d5b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.364241:0:18396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf1ab88a/0x25c454990262d5b6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.364258:0:18396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf1ab88a/0x25c454990262d5b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.364272:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639257.364273:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639257.364275:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788639257.364822:0:19077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788639257.364828:0:19077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1a2a0c3/0x25c454990262d5bd lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.364837:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1788639257.364841:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639257.364845:0:19077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1a2a0c3/0x25c454990262d5bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.364855:0:19077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1a2a0c3/0x25c454990262d5bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.364875:0:19077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1a2a0c3/0x25c454990262d5bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.364882:0:19077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1a2a0c3/0x25c454990262d5bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639257.364903:0:19077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788639257.365147:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788639257.365161:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1a2a0c3/0x25c454990262d5bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.365170:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9e200 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:2.0:1788639257.365174:0:17230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1a2a0c3/0x25c454990262d5bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.365182:0:17230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1a2a0c3/0x25c454990262d5bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.365194:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1a2a0c3/0x25c454990262d5bd lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.365202:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1a2a0c3/0x25c454990262d5bd lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.365217:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639257.365218:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639257.365220:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788639257.366086:0:19077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788639257.366095:0:19077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec1d1b7b/0x25c454990262d5c4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.366106:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=516s v=(0 0) 00010000:00010000:2.0:1788639257.366109:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788639257.366113:0:19077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec1d1b7b/0x25c454990262d5c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.366123:0:19077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec1d1b7b/0x25c454990262d5c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.366131:0:19077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec1d1b7b/0x25c454990262d5c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.366138:0:19077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec1d1b7b/0x25c454990262d5c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.366172:0:19077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788639257.366320:0:18396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639257.366327:0:18396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec1d1b7b/0x25c454990262d5c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.366336:0:18396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78be00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639257.366340:0:18396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec1d1b7b/0x25c454990262d5c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.366349:0:18396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec1d1b7b/0x25c454990262d5c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.366363:0:18396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec1d1b7b/0x25c454990262d5c4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.366371:0:18396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec1d1b7b/0x25c454990262d5c4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.366387:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639257.366389:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639257.366391:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788639257.366739:0:19077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788639257.366746:0:19077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014b7fce1/0x25c454990262d5cb lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.366755:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=516s v=(0 0) 00010000:00010000:2.0:1788639257.366758:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788639257.366762:0:19077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014b7fce1/0x25c454990262d5cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.366783:0:19077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014b7fce1/0x25c454990262d5cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.366792:0:19077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014b7fce1/0x25c454990262d5cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.366800:0:19077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014b7fce1/0x25c454990262d5cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.366816:0:19077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788639257.366825:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788639257.366830:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014b7fce1/0x25c454990262d5cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.366837:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78a800 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:2.0:1788639257.366841:0:17230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014b7fce1/0x25c454990262d5cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.366848:0:17230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014b7fce1/0x25c454990262d5cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.366860:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014b7fce1/0x25c454990262d5cb lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.366867:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014b7fce1/0x25c454990262d5cb lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.366889:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639257.366892:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639257.366894:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788639257.367935:0:19077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788639257.367945:0:19077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c41d79f5/0x25c454990262d5d2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.367955:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=516s v=(0 0) 00010000:00010000:2.0:1788639257.367959:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788639257.367964:0:19077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c41d79f5/0x25c454990262d5d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.367974:0:19077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c41d79f5/0x25c454990262d5d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.367983:0:19077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c41d79f5/0x25c454990262d5d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.367990:0:19077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c41d79f5/0x25c454990262d5d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.368003:0:19077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788639257.368304:0:18396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639257.368312:0:18396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c41d79f5/0x25c454990262d5d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788639257.368319:0:19077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788639257.368323:0:18396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78ae00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:2.0:1788639257.368327:0:19077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027e6f44d/0x25c454990262d5d9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.368342:0:18396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c41d79f5/0x25c454990262d5d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.368352:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=516s v=(0 0) 00010000:00010000:2.0:1788639257.368358:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788639257.368358:0:18396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c41d79f5/0x25c454990262d5d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.368366:0:19077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027e6f44d/0x25c454990262d5d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.368377:0:18396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c41d79f5/0x25c454990262d5d2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.368379:0:19077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027e6f44d/0x25c454990262d5d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.368397:0:18396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c41d79f5/0x25c454990262d5d2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.368401:0:19077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027e6f44d/0x25c454990262d5d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.368418:0:19077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027e6f44d/0x25c454990262d5d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.368424:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639257.368428:0:18396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639257.368432:0:18396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027e6f44d/0x25c454990262d5d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.368435:0:19077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788639257.368444:0:18396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78ac00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:2.0:1788639257.368447:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639257.368448:0:18396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027e6f44d/0x25c454990262d5d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.368458:0:18396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027e6f44d/0x25c454990262d5d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.368479:0:18396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027e6f44d/0x25c454990262d5d9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.368487:0:18396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027e6f44d/0x25c454990262d5d9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.368502:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639257.368504:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639257.368506:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788639257.368921:0:19077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788639257.368928:0:19077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6600111/0x25c454990262d5e0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.368936:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=516s v=(0 0) 00010000:00010000:2.0:1788639257.368939:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788639257.368943:0:19077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6600111/0x25c454990262d5e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.368952:0:19077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6600111/0x25c454990262d5e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.368967:0:19077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6600111/0x25c454990262d5e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.368974:0:19077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6600111/0x25c454990262d5e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.368995:0:19077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788639257.369048:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639257.369055:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6600111/0x25c454990262d5e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.369064:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78aa00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639257.369068:0:17230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6600111/0x25c454990262d5e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.369076:0:17230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6600111/0x25c454990262d5e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.369088:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6600111/0x25c454990262d5e0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.369095:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6600111/0x25c454990262d5e0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.369122:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639257.369124:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639257.369126:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788639257.369284:0:19077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788639257.369289:0:19077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037681740/0x25c454990262d5e7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.369298:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=516s v=(0 0) 00010000:00010000:2.0:1788639257.369301:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788639257.369304:0:19077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037681740/0x25c454990262d5e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.369313:0:19077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037681740/0x25c454990262d5e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.369320:0:19077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037681740/0x25c454990262d5e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.369327:0:19077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037681740/0x25c454990262d5e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.369360:0:19077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788639257.369530:0:18396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639257.369544:0:18396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037681740/0x25c454990262d5e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.369553:0:18396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78a600 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639257.369557:0:18396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037681740/0x25c454990262d5e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.369565:0:18396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037681740/0x25c454990262d5e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.369576:0:18396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037681740/0x25c454990262d5e7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.369584:0:18396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037681740/0x25c454990262d5e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.369598:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639257.369600:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639257.369602:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788639257.369990:0:19077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788639257.369997:0:19077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f8bd22d/0x25c454990262d5ee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.370006:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=516s v=(0 0) 00010000:00010000:2.0:1788639257.370009:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788639257.370014:0:19077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f8bd22d/0x25c454990262d5ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.370025:0:19077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f8bd22d/0x25c454990262d5ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.370033:0:19077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f8bd22d/0x25c454990262d5ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.370040:0:19077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f8bd22d/0x25c454990262d5ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639257.370051:0:19077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1788639257.370086:0:19077:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:2.0:1788639257.370169:0:19077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17265:x1875523773060608:12345-0@lo:5:osp-pre-0-0.0 Request processed in 89481us (91303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639257.370178:0:19077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788639257.370235:0:17265:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a93b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17265:1875523773060608:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788639257.370259:0:17265:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:2.0:1788639257.370300:0:17265:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a93b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17265:1875523773060736:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788639257.370332:0:17265:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639257.370353:0:17265:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae343acb240 going to sleep for 11 seconds 00000100:00100000:2.0:1788639257.370370:0:19077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773060736 00000100:00100000:2.0:1788639257.370375:0:19077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773060736 00000100:00100000:2.0:1788639257.370410:0:19077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788639257.370419:0:19077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17265:x1875523773060736:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788639257.370452:0:19077:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:0.0:1788639257.371219:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639257.371227:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f8bd22d/0x25c454990262d5ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.371249:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78b800 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639257.371254:0:17230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f8bd22d/0x25c454990262d5ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.371264:0:17230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f8bd22d/0x25c454990262d5ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.371280:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f8bd22d/0x25c454990262d5ee lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.371288:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f8bd22d/0x25c454990262d5ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639257.371305:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639257.371306:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639257.371308:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639257.371476:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788639257.383403:0:18744:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1788639257.383444:0:18744:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788639257.383744:0:19077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17265:x1875523773060736:12345-0@lo:5:osp-pre-0-0.0 Request processed in 13323us (13407us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788639257.383764:0:19077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788639257.383913:0:17265:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788639257.383921:0:17265:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a93b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17265:1875523773060736:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788639257.383937:0:17265:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000001:02000400:2.0:1788639257.563818:0:19114:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg618-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788639257.909772:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788639258.520342:0:19166:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788639258.520515:0:19166:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788639258.935156:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788639259.304730:0:19216:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788639259.305394:0:19216:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:0.0:1788639259.317339:0:17279:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788639259.829933:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773060864:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788639259.830036:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639259.830266:0:17981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773060864 00000100:00100000:2.0:1788639259.830277:0:17981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773060864 00000100:00100000:2.0:1788639259.830365:0:17981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788639259.830376:0:17981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773060864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788639259.830420:0:17981:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788639259.830524:0:17981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773060864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 148us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639259.830532:0:17981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788639259.832424:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773060864:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788639259.957227:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639260.340899:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788639260.340932:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773060992:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788639260.341031:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639260.341176:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773060992 00000100:00100000:3.0:1788639260.341188:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773060992 00000100:00100000:3.0:1788639260.341251:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788639260.341261:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773060992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788639260.341304:0:17245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788639260.341355:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773060992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639260.341363:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788639260.341460:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773060992:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788639260.983266:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788639261.050669:0:17999:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788639262.015371:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639262.388822:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4d225031-35be-4b74-b245-637fda218215:3643:1875523773061120:0@lo:400:kworker.0 00000100:00080000:1.0:1788639262.388822:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788639262.388831:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788639262.388837:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ae375cad000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788639262.388843:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 516 00000100:00080000:1.0:1788639262.388848:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788639262.388857:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ae375cad000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:1.0:1788639262.388885:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae244125c00 x1875523773061504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788639262.388922:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788639262.388922:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788639262.388929:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788639262.388932:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788639262.388935:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788639262.388992:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244127480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773061248:0@lo:400:kworker.0 00000100:00100000:3.0:1788639262.388999:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773061760:0@lo:400:kworker.0 00000100:00100000:1.0:1788639262.389043:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639262.389054:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773061120 00000100:00100000:3.0:1788639262.389072:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773061120 00000100:00100000:1.0:1788639262.389076:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875523773061888:0@lo:400:kworker.0 00000100:00100000:1.0:1788639262.389110:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639262.389135:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788639262.389148:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244126300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773061376:0@lo:400:kworker.0 00000100:00100000:3.0:1788639262.389164:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+21:3643:x1875523773061120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639262.389186:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639262.389209:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244126a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875523773062016:0@lo:400:kworker.0 00000100:00100000:3.0:1788639262.389228:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+21:3643:x1875523773061120:12345-0@lo:400:kworker.0 Request processed in 67us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639262.389237:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788639262.389249:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639262.389278:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788639262.389285:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773061376 00000100:00100000:1.0:1788639262.389286:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875523773061632:0@lo:400:kworker.0 00000100:00100000:3.0:1788639262.389291:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773061376 00000100:00100000:1.0:1788639262.389316:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639262.389339:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788639262.389346:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243316680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773061376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639262.389379:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243316680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773061376:12345-0@lo:400:kworker.0 Request processed in 34us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639262.389385:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788639262.389401:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788639262.389417:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639262.389467:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4d225031-35be-4b74-b245-637fda218215:3643:1875523773061120:0@lo:400:kworker.0 00000100:00100000:3.0:1788639262.389500:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773061248 00000100:00100000:3.0:1788639262.389503:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773061248 00000100:00100000:3.0:1788639262.389528:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773061760 00000100:00100000:3.0:1788639262.389531:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773061760 00000100:00100000:3.0:1788639262.389544:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788639262.389550:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523773061248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639262.389748:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875523773062144:0@lo:400:kworker.0 00000100:00100000:1.0:1788639262.389777:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639262.389805:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244126300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773061376:0@lo:400:kworker.0 00000100:00100000:1.0:1788639262.389838:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244125c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773061504:0@lo:8:kworker.0 00000100:00100000:1.0:1788639262.389863:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639262.389898:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788639262.389908:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773061760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639262.389911:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523773061248:12345-0@lo:400:kworker.0 Request processed in 37us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639262.389922:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788639262.389955:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773061760:12345-0@lo:400:kworker.0 Request processed in 48us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639262.389963:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788639262.389976:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244127480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773061248:0@lo:400:kworker.0 00000100:00100000:3.0:1788639262.390008:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773061760:0@lo:400:kworker.0 00000100:00100000:1.0:1788639262.390323:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773061888 00000100:00100000:1.0:1788639262.390330:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773061888 00000100:00100000:1.0:1788639262.390353:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773062016 00000100:00100000:1.0:1788639262.390355:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773062016 00000100:00100000:1.0:1788639262.390373:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773061632 00000100:00100000:1.0:1788639262.390375:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773061632 00000100:00100000:1.0:1788639262.390386:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773062144 00000100:00100000:1.0:1788639262.390388:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773062144 00000100:00100000:1.0:1788639262.390402:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788639262.390409:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243317100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875523773061888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639262.390449:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243317100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875523773061888:12345-0@lo:400:kworker.0 Request processed in 40us (1338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639262.390455:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788639262.390468:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788639262.390473:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243316a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875523773062016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639262.390506:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243316a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875523773062016:12345-0@lo:400:kworker.0 Request processed in 32us (1258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639262.390522:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788639262.390538:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788639262.390544:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875523773061632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639262.390577:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875523773061632:12345-0@lo:400:kworker.0 Request processed in 33us (1260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639262.390585:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1788639262.390595:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788639262.390596:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1788639262.390601:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788639262.390606:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243316300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875523773062144:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788639262.390649:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae244124a80 x1875523773061888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639262.390661:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243316300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875523773062144:12345-0@lo:400:kworker.0 Request processed in 55us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639262.390667:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875523773061888:0@lo:400:kworker.0 00000100:00100000:1.0:1788639262.390674:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788639262.390695:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788639262.390705:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773062272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788639262.390720:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773061504 00000100:00100000:1.0:1788639262.390725:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773061504 00000100:00100000:1.0:1788639262.390744:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788639262.390750:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243317b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1875523773061504:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788639262.390770:0:18749:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788639262.390812:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639262.390854:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773062272 00000100:00100000:3.0:1788639262.390858:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773062272 00000100:00100000:3.0:1788639262.390888:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788639262.390894:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523773062272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788639262.390920:0:18751:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788639262.390958:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523773062272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639262.390965:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788639262.391002:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773062272:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1788639262.392605:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae244126d80 x1875523773061632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639262.392641:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875523773061632:0@lo:400:kworker.0 00010000:00080000:0.0:1788639262.392658:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae244125500 x1875523773062144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639262.392667:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875523773062144:0@lo:400:kworker.0 00010000:00080000:0.0:1788639262.392701:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae244126a00 x1875523773062016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639262.392710:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244126a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875523773062016:0@lo:400:kworker.0 00000100:00100000:0.0:1788639262.410302:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243317b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1875523773061504:12345-0@lo:8:kworker.0 Request processed in 19539us (20426us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788639262.410320:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788639262.410339:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae375cad000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788639262.410345:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788639262.410350:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244125c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773061504:0@lo:8:kworker.0 00010000:00010000:2.0:1788639263.029833:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639264.054298:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639264.438985:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788639249/real 1788639249] req@ffff9ae24233e300 x1875523773053952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788639264 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639264.439026:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ae24233e300 x1875523773053952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788639264 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639264.439036:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788639249/real 1788639249] req@ffff9ae24233ed80 x1875523773054080/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788639264 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639264.439057:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ae24233ed80 x1875523773054080/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788639264 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788639264.439079:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae36d232000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788639264.439108:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788639264.439113:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773053952:0@lo:8:kworker.0 00000100:00080000:1.0:1788639264.439119:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae36d235800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788639264.439125:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788639264.439128:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773054080:0@lo:8:kworker.0 00000100:00080000:3.0:1788639264.439303:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788639264.439308:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788639264.439311:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ae375cad000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788639264.439316:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 521 00000100:00080000:3.0:1788639264.439321:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788639264.439329:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ae375cad000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:3.0:1788639264.439350:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae24233e300 x1875523773062784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788639264.439393:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788639264.439396:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788639264.439398:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ae36d232000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788639264.439401:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 507 00000100:00080000:3.0:1788639264.439405:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788639264.439409:0:38:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9ae36d232000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:3.0:1788639264.439420:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae244125500 x1875523773063168/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788639264.439428:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788639264.439431:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788639264.439432:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ae36d235800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788639264.439435:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 507 00000100:00080000:3.0:1788639264.439438:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788639264.439442:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ae36d235800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:3.0:1788639264.439452:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae244126d80 x1875523773063296/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788639264.439495:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773062528:0@lo:400:kworker.0 00000100:00100000:3.0:1788639264.439690:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639264.439786:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4d225031-35be-4b74-b245-637fda218215:3644:1875523773062400:0@lo:400:kworker.0 00000100:00100000:1.0:1788639264.439827:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639264.439873:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244126a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773063040:0@lo:400:kworker.0 00000100:00100000:1.0:1788639264.439906:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773062400 00000100:00100000:1.0:1788639264.439915:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773062400 00000100:00100000:1.0:1788639264.439968:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788639264.439977:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+21:3644:x1875523773062400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639264.440035:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+21:3644:x1875523773062400:12345-0@lo:400:kworker.0 Request processed in 58us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639264.440043:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788639264.440435:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875523773063424:0@lo:400:kworker.0 00000100:00100000:3.0:1788639264.440467:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639264.440492:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788639264.440498:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773062656:0@lo:400:kworker.0 00000100:00100000:1.0:1788639264.440637:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773062528 00000100:00100000:1.0:1788639264.440642:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773062528 00000100:00100000:1.0:1788639264.440691:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788639264.440976:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639264.441016:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875523773063552:0@lo:400:kworker.0 00000100:00100000:3.0:1788639264.441049:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639264.441094:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773063424 00000100:00100000:3.0:1788639264.441098:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773063424 00000100:00100000:3.0:1788639264.441131:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773063552 00000100:00100000:3.0:1788639264.441134:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773063552 00000100:00100000:3.0:1788639264.441165:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788639264.441173:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875523773063424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639264.441220:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875523773063424:12345-0@lo:400:kworker.0 Request processed in 48us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639264.441227:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788639264.441251:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788639264.441257:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875523773063552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639264.441284:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875523773063552:12345-0@lo:400:kworker.0 Request processed in 28us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639264.441290:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788639264.441338:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773062528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639264.441376:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773062528:12345-0@lo:400:kworker.0 Request processed in 42us (1687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639264.441462:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244125c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523773062912:0@lo:400:kworker.0 00000100:00100000:2.0:1788639264.441497:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639264.441534:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244127480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875523773063680:0@lo:400:kworker.0 00000100:00100000:2.0:1788639264.441562:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639264.443822:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788639264.443851:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773062656 00000100:00100000:3.0:1788639264.443864:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773062656 00000100:00100000:3.0:1788639264.443933:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788639264.443945:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243952300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773062656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639264.444091:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773062912 00000100:00100000:1.0:1788639264.444096:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773062912 00000100:00100000:3.0:1788639264.444122:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243952300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773062656:12345-0@lo:400:kworker.0 Request processed in 179us (3145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639264.444122:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773063680 00000100:00100000:1.0:1788639264.444126:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773063680 00000100:00100000:3.0:1788639264.444135:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788639264.444152:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788639264.444160:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523773062912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639264.444201:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788639264.444214:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523773062912:12345-0@lo:400:kworker.0 Request processed in 53us (2714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639264.444215:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875523773063680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639264.444229:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788639264.444258:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639264.444266:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875523773063680:12345-0@lo:400:kworker.0 Request processed in 55us (2701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639264.444287:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1788639264.444312:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788639264.444318:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788639264.444321:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788639264.444333:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4d225031-35be-4b74-b245-637fda218215:3644:1875523773062400:0@lo:400:kworker.0 00000100:00100000:3.0:1788639264.444365:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773062656:0@lo:400:kworker.0 00000100:00100000:1.0:1788639264.444368:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773063040 00000100:00100000:1.0:1788639264.444373:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773063040 00010000:00080000:3.0:1788639264.444386:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae244126680 x1875523773063552/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639264.444399:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875523773063552:0@lo:400:kworker.0 00000100:00100000:1.0:1788639264.444405:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788639264.444415:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243315c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773063040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639264.444418:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773062528:0@lo:400:kworker.0 00010000:00080000:3.0:1788639264.444437:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae244124a80 x1875523773063424/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639264.444447:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875523773063424:0@lo:400:kworker.0 00000100:00100000:1.0:1788639264.444465:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243315c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773063040:12345-0@lo:400:kworker.0 Request processed in 51us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639264.444473:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788639264.444499:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773062784:0@lo:8:kworker.0 00010000:00080000:2.0:1788639264.444609:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae244125c00 x1875523773062912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639264.444643:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244125c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523773062912:0@lo:400:kworker.0 00010000:00080000:2.0:1788639264.444658:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae244127480 x1875523773063680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639264.444678:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244127480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875523773063680:0@lo:400:kworker.0 00000100:00100000:1.0:1788639264.445861:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639264.445907:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773063168:0@lo:8:kworker.0 00000100:00100000:1.0:1788639264.445941:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639264.445984:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773063296:0@lo:8:kworker.0 00000100:00100000:1.0:1788639264.446007:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639264.446081:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773062784 00000100:00100000:1.0:1788639264.446088:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773062784 00000100:00100000:1.0:1788639264.446183:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773063168 00000100:00100000:1.0:1788639264.446186:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773063168 00000100:00100000:3.0:1788639264.446201:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773063296 00000100:00100000:1.0:1788639264.446206:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788639264.446209:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773063296 00000100:00100000:1.0:1788639264.446215:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243315f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1875523773062784:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788639264.446235:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00010000:00020000:1.0:1788639264.446242:0:18747:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788639264.446244:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243314000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1875523773063168:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788639264.446270:0:18749:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 523 last 0 00000100:00100000:1.0:1788639264.446295:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243315f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1875523773062784:12345-0@lo:8:kworker.0 Request processed in 79us (439us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788639264.446303:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000020:00000080:3.0:1788639264.446311:0:18749:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x25c454990262d5f5 00000100:00100000:1.0:1788639264.446320:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788639264.446325:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243317800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1875523773063296:12345-0@lo:8:kworker.0 00002000:00100000:3.0:1788639264.446330:0:18749:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9ae3691c4800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 0 ocd_group 1 00010000:00020000:1.0:1788639264.446336:0:18747:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00002000:00080000:3.0:1788639264.446338:0:18749:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1788639264.446343:0:18749:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1788639264.446363:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243317800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1875523773063296:12345-0@lo:8:kworker.0 Request processed in 35us (354us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788639264.446369:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788639264.446413:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244126a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773063040:0@lo:400:kworker.0 00002000:00080000:3.0:1788639264.446445:0:18749:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1788639264.446468:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae375cad000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788639264.446475:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788639264.446478:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773062784:0@lo:8:kworker.0 00000100:00080000:3.0:1788639264.446488:0:18749:0:(import.c:65:import_set_state_nolock()) ffff9ae3691c0000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1788639264.446488:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae36d235800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788639264.446493:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788639264.446496:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773063296:0@lo:8:kworker.0 00000100:00100000:3.0:1788639264.446962:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243314000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1875523773063168:12345-0@lo:8:kworker.0 Request processed in 718us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639264.446977:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788639264.447650:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788639264.447677:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1788639264.447703:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788639264.447710:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788639264.447713:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae36d232000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788639264.447743:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788639264.447750:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773063168:0@lo:8:kworker.0 00000004:00080000:3.0:1788639264.447869:0:17983:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788639264.447894:0:17983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243953100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17983:1875523773063936:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1788639264.447947:0:17983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639264.447974:0:17983:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d2b5540 going to sleep for 11 seconds 00000100:00100000:3.0:1788639264.447989:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788639264.447998:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243951c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773063808:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788639264.448024:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639264.448055:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773063808 00000100:00100000:3.0:1788639264.448060:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773063808 00000100:00100000:3.0:1788639264.448112:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788639264.448121:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243951880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875523773063808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788639264.448147:0:18751:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788639264.448187:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243951880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875523773063808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639264.448193:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788639264.448217:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788639264.448243:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243951c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773063808:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788639264.448263:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773063936 00000100:00100000:3.0:1788639264.448267:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773063936 00000100:00100000:3.0:1788639264.448290:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788639264.448297:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243950380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17983:x1875523773063936:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1788639264.449061:0:17982:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788639264.449176:0:17982:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 523243558861ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788639264.449183:0:17982:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00002000:00080000:3.0:1788639264.449997:0:18747:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1788639264.450007:0:18747:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1788639264.450106:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243950380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17983:x1875523773063936:12345-0@lo:7:osp-pre-0-1.0 Request processed in 1803us (2152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639264.450128:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788639264.450198:0:17983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243953100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17983:1875523773063936:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1788639264.450216:0:17983:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:3.0:1788639264.450264:0:17983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243953100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17983:1875523773064064:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788639264.450302:0:17983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639264.450328:0:17983:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d2b5540 going to sleep for 11 seconds 00000100:00100000:3.0:1788639264.450349:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773064064 00000100:00100000:3.0:1788639264.450358:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773064064 00000100:00100000:3.0:1788639264.450408:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788639264.450418:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243951c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17983:x1875523773064064:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1788639264.450448:0:18750:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1788639264.450481:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243951c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17983:x1875523773064064:12345-0@lo:5:osp-pre-0-1.0 Request processed in 65us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639264.450489:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788639264.450517:0:17983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243953100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17983:1875523773064064:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788639264.450527:0:17983:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1788639264.450566:0:17983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243953100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17983:1875523773064192:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788639264.450592:0:17983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639264.450610:0:17983:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d2b5540 going to sleep for 11 seconds 00000100:00100000:3.0:1788639264.450655:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773064192 00000100:00100000:3.0:1788639264.450659:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773064192 00000100:00100000:3.0:1788639264.450695:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788639264.450702:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243950a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17983:x1875523773064192:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1788639264.450737:0:18749:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000004:00080000:1.0:1788639264.459932:0:17973:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000001:00080000:0.0:1788639264.493298:0:18744:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:0.0:1788639264.493321:0:18744:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1788639264.495338:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243950a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17983:x1875523773064192:12345-0@lo:5:osp-pre-0-1.0 Request processed in 44622us (44731us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788639264.495355:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788639264.495656:0:17983:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1788639264.495677:0:17983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243953100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17983:1875523773064192:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788639264.495764:0:17983:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:2.0:1788639264.495835:0:17983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a93800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17983:1875523773064320:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788639264.495888:0:17983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639264.495920:0:17983:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344267d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788639264.496066:0:17252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773064320 00000100:00100000:1.0:1788639264.496075:0:17252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773064320 00000100:00100000:1.0:1788639264.496491:0:17252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788639264.496502:0:17252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17983:x1875523773064320:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1788639264.497854:0:17252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17983:x1875523773064320:12345-0@lo:900:osp-pre-0-1.0 Request processed in 1343us (1955us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639264.497867:0:17252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788639264.498210:0:17983:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae243a93800 x1875523773064320/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788639280 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639264.498238:0:17983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a93800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17983:1875523773064320:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788639264.956750:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773064448:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788639264.956843:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639264.964852:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773064448 00000100:00100000:0.0:1788639264.964871:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773064448 00000100:00100000:0.0:1788639264.964950:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788639264.964961:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773064448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788639264.965028:0:17245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788639264.965144:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773064448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 184us (8300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639264.965151:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788639264.965383:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773064448:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788639265.078995:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639265.468696:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788639265.468726:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243314380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773064576:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788639265.468815:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639265.468873:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773064576 00000100:00100000:1.0:1788639265.468883:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773064576 00000100:00100000:1.0:1788639265.468941:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788639265.468952:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243314a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773064576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788639265.468996:0:17246:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788639265.469048:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243314a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773064576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639265.469057:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788639265.469110:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243314380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773064576:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788639266.101132:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788639266.313263:0:19561:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788639266.313268:0:19561:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788639266.313269:0:19561:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788639266.313525:0:19561:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ae2433ef000 00000020:01000004:0.0:1788639266.313545:0:19561:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788639266.313564:0:19561:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788639266.313580:0:19561:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9ae36cf0cd40) 00000020:00000080:0.0:1788639266.313601:0:19561:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788639266.387138:0:19561:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788639266.392449:0:19561:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788639266.393398:0:19561:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788639266.393640:0:19561:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788639266.397744:0:19561:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788639266.398420:0:19561:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788639266.399203:0:19561:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:2.0:1788639266.406014:0:19561:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788639266.406275:0:19561:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788639266.406290:0:19561:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788639266.406305:0:19561:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x25c454990262d603 00000020:01000004:2.0:1788639266.406313:0:19561:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788639266.406335:0:19561:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.118@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788639266.406338:0:19561:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.118@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788639266.406344:0:19561:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788639266.406374:0:19561:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1788639266.406378:0:19561:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.118@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788639266.418684:0:19561:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.118@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788639266.418727:0:19561:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.118@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788639266.418732:0:19561:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788639266.418733:0:19561:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788639266.418735:0:19561:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788639266.418736:0:19561:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788639266.418737:0:19561:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788639266.418738:0:19561:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788639266.418739:0:19561:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788639266.418740:0:19561:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788639266.418742:0:19561:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788639266.418745:0:19561:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788639266.418747:0:19561:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788639266.418749:0:19561:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788639266.418750:0:19561:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788639266.418750:0:19561:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788639266.418751:0:19561:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788639266.418752:0:19561:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788639266.418753:0:19561:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788639266.418754:0:19561:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788639266.418755:0:19561:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788639266.418779:0:19561:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788639266.418798:0:19561:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:19561:1875523773064704:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788639266.418862:0:19561:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639266.418955:0:19561:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae34653f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788639266.422815:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773064704 00000100:00100000:3.0:1788639266.422828:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773064704 00000100:00100000:2.0:1788639266.422961:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788639266.422991:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+21:19561:x1875523773064704:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788639266.423038:0:17236:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788639266.423041:0:17236:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1788639266.423045:0:17236:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788639266.423393:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+21:19561:x1875523773064704:12345-0@lo:253:mount.lustre.0 Request processed in 404us (4529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639266.423402:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788639266.423495:0:19561:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:19561:1875523773064704:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788639266.423508:0:19561:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788639266.423512:0:19561:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788639266.423513:0:19561:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788639266.423515:0:19561:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788639266.423516:0:19561:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788639266.423517:0:19561:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788639266.423518:0:19561:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788639266.423520:0:19561:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788639266.423521:0:19561:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788639266.423523:0:19561:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788639266.423542:0:19561:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ae2433ef000 from lustre-OST0001 10000000:01000000:3.0:1788639266.423579:0:19561:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788639266.423582:0:19561:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788639266.423590:0:19561:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ae3691c99c0 local copy 00010000:00010000:3.0:1788639266.423599:0:19561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b400/0x25c454990262d259 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d260 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639266.423734:0:19561:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243953b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:19561:1875523773064832:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788639266.423767:0:19561:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639266.423797:0:19561:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344398300 going to sleep for 11 seconds 00000100:00100000:2.0:1788639266.423861:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773064832 00000100:00100000:2.0:1788639266.423866:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773064832 00000100:00100000:2.0:1788639266.423889:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788639266.423895:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+21:19561:x1875523773064832:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788639266.423963:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+21:19561:x1875523773064832:12345-0@lo:501:mount.lustre.0 Request processed in 67us (195us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788639266.423969:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788639266.424133:0:19561:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243953b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:19561:1875523773064832:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788639266.424153:0:19561:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.118@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788639266.424187:0:19561:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.118@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788639266.424193:0:19561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b400/0x25c454990262d259 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d260 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639266.424202:0:19561:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b400/0x25c454990262d259 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d260 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639266.424225:0:19561:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ae2433ef000 10000000:01000000:3.0:1788639266.424229:0:19561:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788639266.424233:0:19561:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788639266.424237:0:19561:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788639266.424241:0:19561:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788639266.424244:0:19561:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788639266.424264:0:19561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e600/0x25c454990262d60a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639266.424272:0:19561:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e600/0x25c454990262d60a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639266.424281:0:19561:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e600/0x25c454990262d60a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639266.424293:0:19561:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243953b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:19561:1875523773064960:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788639266.424318:0:19561:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639266.424344:0:19561:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344398300 going to sleep for 11 seconds 00000100:00100000:2.0:1788639266.424502:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773064960 00000100:00100000:2.0:1788639266.424506:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773064960 00000100:00100000:2.0:1788639266.424538:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788639266.424545:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+21:19561:x1875523773064960:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788639266.424565:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639266.424577:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae37f78be00/0x25c454990262d611 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262d60a expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639266.424598:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae37f78be00/0x25c454990262d611 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262d60a expref: 22 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639266.424607:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae37f78be00/0x25c454990262d611 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262d60a expref: 22 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639266.424674:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78be00, rc 0) 00000100:00100000:2.0:1788639266.424710:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+22:19561:x1875523773064960:12345-0@lo:101:mount.lustre.0 Request processed in 166us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639266.424716:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788639266.425181:0:19561:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243953b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:19561:1875523773064960:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788639266.425196:0:19561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e600/0x25c454990262d60a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d611 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639266.425212:0:19561:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e600/0x25c454990262d60a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262d611 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788639266.427543:0:19561:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788639266.428224:0:19561:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788639266.430809:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788639266.430860:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788639266.430876:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788639266.430889:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788639266.430902:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788639266.430914:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788639266.430936:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788639266.430941:0:19561:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788639266.431055:0:19561:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:19561:1875523773065088:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788639266.431118:0:19561:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639266.431259:0:19561:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24217d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788639266.432495:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773065088 00000100:00100000:2.0:1788639266.432506:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773065088 00000100:00100000:2.0:1788639266.432564:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788639266.432574:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+22:19561:x1875523773065088:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788639266.432800:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+22:19561:x1875523773065088:12345-0@lo:501:mount.lustre.0 Request processed in 226us (1681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639266.432809:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788639266.432989:0:19561:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:19561:1875523773065088:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788639266.433035:0:19561:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:19561:1875523773065216:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788639266.434257:0:19561:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639266.434298:0:19561:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24217d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788639266.434425:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773065216 00000100:00100000:1.0:1788639266.434433:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773065216 00000100:00100000:1.0:1788639266.435018:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788639266.435030:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+22:19561:x1875523773065216:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788639266.436818:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+22:19561:x1875523773065216:12345-0@lo:503:mount.lustre.0 Request processed in 1785us (3734us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639266.436830:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788639266.436939:0:19561:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:19561:1875523773065216:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788639266.437392:0:19561:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788639266.437484:0:19561:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:19561:1875523773065344:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788639266.437532:0:19561:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639266.438115:0:19561:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24217d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788639266.438230:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773065344 00000100:00100000:2.0:1788639266.438236:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773065344 00000100:00100000:2.0:1788639266.438274:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788639266.438283:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+22:19561:x1875523773065344:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788639266.438892:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+22:19561:x1875523773065344:12345-0@lo:502:mount.lustre.0 Request processed in 609us (1358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639266.438901:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788639266.439074:0:19561:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:19561:1875523773065344:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788639266.439354:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788639266.440221:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788639266.440246:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788639266.440262:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788639266.440276:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788639266.440289:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788639266.440304:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788639266.440317:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788639266.440330:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1788639266.441023:0:19561:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243314380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:19561:1875523773065472:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788639266.441098:0:19561:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639266.441190:0:19561:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae35058a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788639266.443476:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773065472 00000100:00100000:3.0:1788639266.443490:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773065472 00000100:00100000:0.0:1788639266.444190:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788639266.444201:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+22:19561:x1875523773065472:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788639266.444537:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+22:19561:x1875523773065472:12345-0@lo:502:mount.lustre.0 Request processed in 336us (3438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639266.444545:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788639266.445421:0:19561:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243314380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:19561:1875523773065472:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788639266.445515:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1788639266.445528:0:19561:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1788639266.446363:0:19565:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788639266.446370:0:19565:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1788639266.446376:0:19565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788639266.446378:0:19565:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788639266.446384:0:19565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788639266.446398:0:19565:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9ae37724b380) 00000020:00000080:3.0:1788639266.446423:0:19565:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788639266.446429:0:19565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788639266.446517:0:19565:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ae2433ef000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788639266.446528:0:19565:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788639266.446538:0:19565:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x25c454990262d61f 00010000:00010000:3.0:1788639266.461017:0:19565:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1788639266.463612:0:19565:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:3.0:1788639266.467076:0:19565:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1788639266.471206:0:19565:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788639266.471219:0:19565:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788639266.471225:0:19565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788639266.471228:0:19565:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788639266.471231:0:19565:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788639266.471235:0:19565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788639266.471237:0:19565:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788639266.471240:0:19565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788639266.471242:0:19565:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788639266.471244:0:19565:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788639266.471247:0:19565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788639266.471248:0:19565:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788639266.471257:0:19565:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788639266.471261:0:19565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788639266.471262:0:19565:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788639266.471266:0:19565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788639266.471290:0:19565:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788639266.471294:0:19565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788639266.471295:0:19565:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788639266.471298:0:19565:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1788639266.471755:0:19561:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788639266.471786:0:19561:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788639266.471801:0:19561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e600/0x25c454990262d60a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d611 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639266.471835:0:19561:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e600/0x25c454990262d60a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d611 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788639266.471843:0:19561:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae2433ef000 from 1 10000000:01000000:2.0:1788639266.471846:0:19561:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788639266.471882:0:19561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78ac00/0x25c454990262d626 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639266.471891:0:19561:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae37f78ac00/0x25c454990262d626 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639266.471902:0:19561:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae37f78ac00/0x25c454990262d626 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639266.471929:0:19561:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a93480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:19561:1875523773065600:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788639266.472007:0:19561:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639266.472184:0:19561:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3802086c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788639266.473134:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773065600 00000100:00100000:3.0:1788639266.473143:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773065600 00000100:00100000:2.0:1788639266.473304:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788639266.473313:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+22:19561:x1875523773065600:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788639266.473327:0:17236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639266.473341:0:17236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae37f78aa00/0x25c454990262d62d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262d626 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639266.473516:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae37f78aa00/0x25c454990262d62d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262d626 expref: 23 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639266.473528:0:17236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae37f78aa00/0x25c454990262d62d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262d626 expref: 23 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639266.473551:0:17236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78aa00, rc 0) 00000100:00100000:2.0:1788639266.473612:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+23:19561:x1875523773065600:12345-0@lo:101:mount.lustre.0 Request processed in 300us (1604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639266.473646:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788639266.473746:0:19561:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a93480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:19561:1875523773065600:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788639266.473761:0:19561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae37f78ac00/0x25c454990262d626 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d62d expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639266.473769:0:19561:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae37f78ac00/0x25c454990262d626 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262d62d expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788639266.474935:0:19561:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788639266.475242:0:19561:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788639266.475584:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788639266.475612:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788639266.475873:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788639266.475878:0:19561:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788639266.475956:0:19561:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243314e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:19561:1875523773065728:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788639266.476013:0:19561:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639266.476047:0:19561:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243115cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788639266.476841:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773065728 00000100:00100000:0.0:1788639266.476849:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773065728 00000100:00100000:0.0:1788639266.476897:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788639266.476905:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+23:19561:x1875523773065728:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788639266.477025:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+23:19561:x1875523773065728:12345-0@lo:501:mount.lustre.0 Request processed in 120us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639266.477032:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788639266.477879:0:19561:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243314e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:19561:1875523773065728:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788639266.477924:0:19561:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243314e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:19561:1875523773065856:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788639266.477972:0:19561:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639266.478003:0:19561:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243115cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788639266.478227:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773065856 00000100:00100000:3.0:1788639266.478233:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773065856 00000100:00100000:3.0:1788639266.478276:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788639266.478284:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+23:19561:x1875523773065856:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788639266.478387:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+23:19561:x1875523773065856:12345-0@lo:503:mount.lustre.0 Request processed in 103us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639266.478402:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788639266.478664:0:19561:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243314e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:19561:1875523773065856:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788639266.479115:0:19561:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788639266.479320:0:19561:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243314e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:19561:1875523773065984:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788639266.479579:0:19561:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639266.479710:0:19561:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243115cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788639266.486258:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773065984 00000100:00100000:3.0:1788639266.486271:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773065984 00000100:00100000:2.0:1788639266.486813:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788639266.486825:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+23:19561:x1875523773065984:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788639266.486991:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+23:19561:x1875523773065984:12345-0@lo:502:mount.lustre.0 Request processed in 168us (7411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639266.486999:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788639266.487298:0:19561:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243314e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:19561:1875523773065984:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788639266.487535:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788639266.487566:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788639266.487579:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788639266.487592:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788639266.487604:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788639266.487646:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788639266.487678:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788639266.487694:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1788639266.487708:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788639266.487721:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1788639266.487734:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1788639266.487767:0:19561:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243314e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:19561:1875523773066112:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788639266.487817:0:19561:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639266.488579:0:19561:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae243115cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788639266.489250:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773066112 00000100:00100000:0.0:1788639266.489259:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773066112 00000100:00100000:0.0:1788639266.489299:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788639266.489307:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+23:19561:x1875523773066112:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788639266.489537:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+23:19561:x1875523773066112:12345-0@lo:502:mount.lustre.0 Request processed in 230us (1719us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639266.489544:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788639266.489769:0:19561:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243314e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:19561:1875523773066112:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788639266.489835:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1788639266.489847:0:19561:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788639266.491001:0:19570:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788639266.491012:0:19570:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788639266.491015:0:19570:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788639266.491022:0:19570:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ae2433ef000 00000020:00000080:1.0:1788639266.491024:0:19570:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788639266.491031:0:19570:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788639266.491040:0:19570:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788639266.491042:0:19570:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788639266.491045:0:19570:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788639266.491048:0:19570:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788639266.491049:0:19570:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788639266.491052:0:19570:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ae2433ef000 00000020:00000080:1.0:1788639266.491054:0:19570:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788639266.491120:0:19570:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788639266.491124:0:19570:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788639266.491125:0:19570:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788639266.491128:0:19570:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788639266.491130:0:19570:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788639266.491132:0:19570:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788639266.491135:0:19570:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ae2433ef000 00000020:00000080:1.0:1788639266.491138:0:19570:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788639266.491156:0:19570:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788639266.491233:0:19570:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788639266.491234:0:19570:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788639266.491238:0:19570:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788639266.491241:0:19570:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788639266.491242:0:19570:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788639266.491246:0:19570:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ae2433ef000 00000020:00000080:1.0:1788639266.491248:0:19570:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788639266.491275:0:19570:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788639266.491277:0:19570:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788639266.491278:0:19570:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788639266.491281:0:19570:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1788639266.492939:0:19561:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788639266.492982:0:19561:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788639266.493004:0:19561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78ac00/0x25c454990262d626 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d62d expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639266.493015:0:19561:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae37f78ac00/0x25c454990262d626 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d62d expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639266.493074:0:19561:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788639266.493077:0:19561:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ae2433ef000 10000000:01000000:0.0:1788639266.493080:0:19561:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ae2433ef000 10000000:01000000:0.0:1788639266.493084:0:19561:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788639266.493089:0:19561:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ae2433ef000 from 1 10000000:01000000:0.0:1788639266.493092:0:19561:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788639266.493264:0:19561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4800/0x25c454990262d634 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639266.493273:0:19561:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4800/0x25c454990262d634 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639266.493284:0:19561:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4800/0x25c454990262d634 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639266.493308:0:19561:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:19561:1875523773066240:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788639266.493367:0:19561:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639266.493409:0:19561:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24217d900 going to sleep for 11 seconds 00000100:00100000:0.0:1788639266.493431:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773066240 00000100:00100000:0.0:1788639266.493438:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773066240 00000100:00100000:0.0:1788639266.493479:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788639266.493487:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243192050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+23:19561:x1875523773066240:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788639266.493500:0:17235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639266.493518:0:17235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae375ef5c00/0x25c454990262d63b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262d634 expref: -99 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639266.493539:0:17235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae375ef5c00/0x25c454990262d63b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262d634 expref: 24 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639266.493549:0:17235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae375ef5c00/0x25c454990262d63b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262d634 expref: 24 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639266.493557:0:17235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375ef5c00, rc 0) 00000100:00100000:0.0:1788639266.493602:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243192050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+24:19561:x1875523773066240:12345-0@lo:101:mount.lustre.0 Request processed in 115us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639266.493608:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788639266.493689:0:19561:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:19561:1875523773066240:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788639266.493706:0:19561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4800/0x25c454990262d634 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d63b expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639266.493716:0:19561:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4800/0x25c454990262d634 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262d63b expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788639266.498565:0:19561:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:1.0:1788639266.498876:0:19561:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788639266.499046:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788639266.499072:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788639266.499084:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788639266.499097:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788639266.499121:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788639266.499134:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788639266.499146:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788639266.499158:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788639266.499189:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788639266.499204:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788639266.499218:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788639266.499233:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788639266.499246:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788639266.499260:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788639266.499272:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788639266.499284:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788639266.499295:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788639266.499307:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788639266.499319:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788639266.499332:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788639266.499346:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788639266.499361:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788639266.499374:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788639266.499407:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788639266.499423:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1788639266.499435:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1788639266.499446:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1788639266.499458:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1788639266.499470:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1788639266.499483:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1788639266.499496:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1788639266.499510:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1788639266.499523:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1788639266.499537:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1788639266.499551:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1788639266.499564:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1788639266.499577:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1788639266.499602:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1788639266.499639:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:1.0:1788639266.499682:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:1.0:1788639266.499697:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:1.0:1788639266.499709:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:1.0:1788639266.499720:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:1.0:1788639266.499734:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:1.0:1788639266.499746:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:1.0:1788639266.499760:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:1.0:1788639266.499780:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:1.0:1788639266.499786:0:19561:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:1.0:1788639266.499864:0:19561:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243314e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:19561:1875523773066368:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788639266.499925:0:19561:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639266.500077:0:19561:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2431159c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788639266.505957:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773066368 00000100:00100000:0.0:1788639266.505973:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773066368 00000100:00100000:0.0:1788639266.506029:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788639266.506040:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+24:19561:x1875523773066368:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788639266.506214:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+24:19561:x1875523773066368:12345-0@lo:501:mount.lustre.0 Request processed in 175us (6288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639266.506221:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788639266.506358:0:19561:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243314e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:19561:1875523773066368:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788639266.506404:0:19561:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243314e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:19561:1875523773066496:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788639266.506453:0:19561:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639266.506494:0:19561:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2431159c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788639266.506511:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773066496 00000100:00100000:1.0:1788639266.506515:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773066496 00000100:00100000:1.0:1788639266.506539:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788639266.506545:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+24:19561:x1875523773066496:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788639266.508782:0:19561:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243314e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:19561:1875523773066496:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788639266.509235:0:19561:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788639266.509327:0:19561:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:19561:1875523773066624:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788639266.509491:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+24:19561:x1875523773066496:12345-0@lo:503:mount.lustre.0 Request processed in 2943us (3035us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639266.509504:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788639266.509605:0:19561:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639266.509676:0:19561:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24217d900 going to sleep for 11 seconds 00000100:00100000:1.0:1788639266.509944:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773066624 00000100:00100000:1.0:1788639266.509950:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773066624 00000100:00100000:1.0:1788639266.509994:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788639266.510012:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+24:19561:x1875523773066624:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788639266.510120:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+24:19561:x1875523773066624:12345-0@lo:502:mount.lustre.0 Request processed in 110us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639266.510127:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788639266.510279:0:19561:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:19561:1875523773066624:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788639266.510481:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788639266.510508:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788639266.510521:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788639266.510532:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788639266.510544:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788639266.510556:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788639266.510568:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788639266.510580:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788639266.510608:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788639266.510645:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788639266.510675:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788639266.510689:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788639266.510703:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788639266.510715:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788639266.510726:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788639266.510752:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788639266.510767:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788639266.510780:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788639266.510792:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788639266.510804:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788639266.510816:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788639266.510827:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788639266.510840:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788639266.510853:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788639266.510864:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1788639266.510889:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1788639266.510902:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1788639266.510914:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1788639266.510926:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1788639266.510938:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1788639266.510951:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1788639266.510977:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1788639266.510993:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1788639266.511005:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1788639266.511021:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1788639266.511032:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1788639266.511043:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1788639266.511055:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1788639266.511068:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1788639266.511080:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1788639266.511093:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1788639266.511106:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1788639266.511118:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1788639266.511131:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1788639266.511144:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1788639266.511156:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1788639266.511324:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1788639266.511351:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1788639266.511391:0:19561:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:19561:1875523773066752:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788639266.511457:0:19561:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639266.511515:0:19561:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24217d900 going to sleep for 11 seconds 00000100:00100000:1.0:1788639266.520338:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773066752 00000100:00100000:1.0:1788639266.520352:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773066752 00000100:00100000:1.0:1788639266.520434:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788639266.520445:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+24:19561:x1875523773066752:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788639266.520611:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+24:19561:x1875523773066752:12345-0@lo:502:mount.lustre.0 Request processed in 167us (9152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639266.520638:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788639266.521171:0:19561:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:19561:1875523773066752:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788639266.521375:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1788639266.521403:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1788639266.521435:0:19561:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:19561:1875523773066880:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788639266.521487:0:19561:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639266.521524:0:19561:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24217d900 going to sleep for 11 seconds 00000100:00100000:1.0:1788639266.522290:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773066880 00000100:00100000:1.0:1788639266.522297:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773066880 00000100:00100000:1.0:1788639266.522340:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788639266.522349:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+24:19561:x1875523773066880:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788639266.522452:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+24:19561:x1875523773066880:12345-0@lo:502:mount.lustre.0 Request processed in 103us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639266.522459:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788639266.522544:0:19561:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:19561:1875523773066880:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788639266.522596:0:19561:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1788639266.522605:0:19561:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788639266.528880:0:19575:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788639266.528898:0:19575:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9ae36cf08000) 00000020:00000080:0.0:1788639266.528925:0:19575:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1788639266.529019:0:19575:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ae2433ef000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788639266.529023:0:19575:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ae2433ef000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788639266.529026:0:19575:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ae2433ef000 3 00010000:00080000:0.0:1788639266.529066:0:19575:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ae242d36800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.118@tcp at head 00010000:00010000:0.0:1788639266.532833:0:19575:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1788639266.535444:0:19575:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788639266.535507:0:19575:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788639266.535522:0:19575:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x25c454990262d649 00000100:00080000:3.0:1788639266.535533:0:19575:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788639266.535539:0:19575:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ae242d36800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:3.0:1788639266.535573:0:19575:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae243953b80 x1875523773067008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788639266.535603:0:19575:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788639266.535682:0:13809:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788639266.535687:0:13809:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788639266.535689:0:13809:0:(import.c:65:import_set_state_nolock()) ffff9ae375cad000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788639266.535693:0:13809:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 523 00000100:00080000:3.0:1788639266.535697:0:13809:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788639266.535701:0:13809:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ae375cad000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:3.0:1788639266.535713:0:13809:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae243950700 x1875523773067392/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788639266.535749:0:13809:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788639266.535753:0:13809:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788639266.535755:0:13809:0:(import.c:65:import_set_state_nolock()) ffff9ae36d235800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788639266.535758:0:13809:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 523 00000100:00080000:3.0:1788639266.535762:0:13809:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788639266.535765:0:13809:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ae36d235800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:3.0:1788639266.535786:0:13809:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae243951500 x1875523773067904/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788639266.535832:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243951180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773067136:0@lo:400:kworker.0 00000100:00100000:3.0:1788639266.535893:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639266.535923:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243950e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773067776:0@lo:400:kworker.0 00000100:00100000:3.0:1788639266.535961:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639266.535984:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788639266.535990:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243953480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773067264:0@lo:400:kworker.0 00000100:00100000:3.0:1788639266.536011:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639266.536028:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243952a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875523773068032:0@lo:400:kworker.0 00000100:00100000:3.0:1788639266.536053:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639266.536082:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243951f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523773067648:0@lo:400:kworker.0 00000100:00100000:3.0:1788639266.536105:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639266.536122:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243950000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875523773068288:0@lo:400:kworker.0 00000100:00100000:3.0:1788639266.536146:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639266.537884:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788639266.537901:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243952d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875523773067520:0@lo:400:kworker.0 00000100:00100000:3.0:1788639266.537947:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639266.537972:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243953800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875523773068160:0@lo:400:kworker.0 00000100:00100000:3.0:1788639266.537991:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639266.538028:0:17981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773067136 00000100:00100000:3.0:1788639266.538035:0:17981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773067136 00000100:00100000:3.0:1788639266.538075:0:17981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773067648 00000100:00100000:3.0:1788639266.538079:0:17981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773067648 00000100:00100000:3.0:1788639266.540294:0:17981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788639266.540312:0:17981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243953100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523773067136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639266.540421:0:17981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243953100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523773067136:12345-0@lo:400:kworker.0 Request processed in 115us (4527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639266.540429:0:17981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788639266.540450:0:17981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788639266.540458:0:17981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523773067648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639266.540494:0:17981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523773067648:12345-0@lo:400:kworker.0 Request processed in 37us (4388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639266.540500:0:17981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788639266.540527:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773067776 00000100:00100000:3.0:1788639266.540533:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773067776 00000100:00100000:3.0:1788639266.540577:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773067264 00000100:00100000:3.0:1788639266.540581:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773067264 00000100:00100000:3.0:1788639266.540606:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788639266.540612:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244125500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773067776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639266.540669:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244125500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773067776:12345-0@lo:400:kworker.0 Request processed in 57us (4707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639266.540676:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788639266.540688:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788639266.540694:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523773067264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639266.540720:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523773067264:12345-0@lo:400:kworker.0 Request processed in 27us (4708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639266.540725:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788639266.540747:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773068032 00000100:00100000:3.0:1788639266.540751:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773068032 00000100:00100000:3.0:1788639266.540767:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773068288 00000100:00100000:3.0:1788639266.540770:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773068288 00000100:00100000:3.0:1788639266.540783:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773067520 00000100:00100000:3.0:1788639266.540792:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773067520 00000100:00100000:3.0:1788639266.540806:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773068160 00000100:00100000:3.0:1788639266.540809:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773068160 00000100:00100000:3.0:1788639266.540822:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788639266.540827:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875523773068032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639266.540859:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875523773068032:12345-0@lo:400:kworker.0 Request processed in 31us (4805us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639266.540864:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788639266.540876:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788639266.540882:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875523773068288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639266.540909:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875523773068288:12345-0@lo:400:kworker.0 Request processed in 27us (4761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639266.540915:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788639266.540926:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788639266.540931:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875523773067520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639266.540957:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875523773067520:12345-0@lo:400:kworker.0 Request processed in 26us (3009us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639266.540962:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788639266.540973:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788639266.540979:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875523773068160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639266.541004:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875523773068160:12345-0@lo:400:kworker.0 Request processed in 26us (3011us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639266.541009:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1788639266.541047:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788639266.541051:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788639266.541053:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788639266.541084:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243953480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773067264:0@lo:400:kworker.0 00010000:00080000:3.0:1788639266.541108:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae243952a00 x1875523773068032/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639266.541119:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243952a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875523773068032:0@lo:400:kworker.0 00000100:00100000:3.0:1788639266.541137:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243951180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773067136:0@lo:400:kworker.0 00000100:00100000:3.0:1788639266.541148:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243950e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773067776:0@lo:400:kworker.0 00000100:00100000:1.0:1788639266.542430:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243953b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875523773067008:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788639266.542489:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639266.542527:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243950700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773067392:0@lo:8:kworker.0 00000100:00100000:1.0:1788639266.542553:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639266.542572:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243951500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773067904:0@lo:8:kworker.0 00000100:00100000:1.0:1788639266.542592:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639266.542665:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773067008 00000100:00100000:1.0:1788639266.542682:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773067008 00000100:00100000:1.0:1788639266.542714:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788639266.542720:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243316d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875523773067008:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788639266.542744:0:17240:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 525 last 0 00000020:00000080:1.0:1788639266.542779:0:17240:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x25c454990262d650 00000004:00100000:1.0:1788639266.542792:0:17240:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788639266.542822:0:17240:0:(import.c:65:import_set_state_nolock()) ffff9ae369177800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788639266.542865:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243316d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875523773067008:12345-0@lo:38:llog_process_th.0 Request processed in 144us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639266.542872:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788639266.542925:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae243953b80 x1875523773067008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788639276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639266.542935:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788639266.542941:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1788639266.542948:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788639266.542953:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788639266.542955:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae242d36800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788639266.542960:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243953b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875523773067008:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788639266.542985:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773067392 00000100:00100000:1.0:1788639266.542989:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773067392 00000100:00100000:1.0:1788639266.543000:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773067904 00000100:00100000:1.0:1788639266.543002:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773067904 00000100:00100000:1.0:1788639266.543011:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788639266.543015:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243315180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1875523773067392:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788639266.543056:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243315180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1875523773067392:12345-0@lo:8:kworker.0 Request processed in 39us (501us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788639266.543061:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788639266.543082:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788639266.543086:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243314700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1875523773067904:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788639266.543117:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243314700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1875523773067904:12345-0@lo:8:kworker.0 Request processed in 29us (524us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788639266.543123:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788639266.545255:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788639266.545268:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae375cad000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788639266.545274:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788639266.545278:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243950700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773067392:0@lo:8:kworker.0 00000100:00100000:1.0:1788639266.545301:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788639266.545304:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae36d235800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788639266.545307:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788639266.545310:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243951500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773067904:0@lo:8:kworker.0 00010000:00080000:3.0:1788639266.546378:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae243952d80 x1875523773067520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639266.546393:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243952d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875523773067520:0@lo:400:kworker.0 00010000:00080000:3.0:1788639266.546408:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae243953800 x1875523773068160/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639266.546416:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243953800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875523773068160:0@lo:400:kworker.0 00000100:00100000:3.0:1788639266.546426:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243951f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523773067648:0@lo:400:kworker.0 00010000:00080000:3.0:1788639266.546436:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae243950000 x1875523773068288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639266.546444:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243950000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875523773068288:0@lo:400:kworker.0 00000020:01000004:3.0:1788639266.547489:0:19575:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788639266.547505:0:19575:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9ae37724cd40) 00000020:00000080:3.0:1788639266.547529:0:19575:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1788639266.547597:0:19575:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ae2433ef000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788639266.547600:0:19575:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ae2433ef000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788639266.547603:0:19575:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ae2433ef000 3 00010000:00080000:3.0:1788639266.547649:0:19575:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ae242268000@lustre-MDT0001-lwp-OST0001: add connection 192.168.206.118@tcp at head 00010000:00010000:3.0:1788639266.556635:0:19575:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:3.0:1788639266.556849:0:19575:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1788639266.556894:0:19575:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788639266.556906:0:19575:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x25c454990262d65e 00000100:00080000:3.0:1788639266.556916:0:19575:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788639266.556921:0:19575:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9ae242268000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:3.0:1788639266.556956:0:19575:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae243150380 x1875523773068416/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788639266.556978:0:19575:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788639266.558504:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875523773068416:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788639266.558575:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639266.558869:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773068416 00000100:00100000:3.0:1788639266.558878:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773068416 00000100:00100000:3.0:1788639266.558917:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788639266.558925:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875523773068416:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788639266.558952:0:18565:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 525 last 0 00000020:00000080:3.0:1788639266.558984:0:18565:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x25c454990262d665 00000004:00100000:3.0:1788639266.558999:0:18565:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788639266.559029:0:18565:0:(import.c:65:import_set_state_nolock()) ffff9ae24226a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788639266.559082:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875523773068416:12345-0@lo:38:llog_process_th.0 Request processed in 156us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639266.559095:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788639266.560947:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ae243150380 x1875523773068416/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788639276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639266.560960:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788639266.560970:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1788639266.560978:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788639266.560982:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788639266.560985:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae242268000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788639266.560991:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875523773068416:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788639266.561108:0:19575:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1788639266.562352:0:19561:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788639266.562385:0:19561:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788639266.562406:0:19561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4800/0x25c454990262d634 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d63b expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639266.562418:0:19561:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4800/0x25c454990262d634 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d63b expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788639266.562466:0:19561:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788639266.562469:0:19561:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788639266.562470:0:19561:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788639266.562471:0:19561:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788639266.562472:0:19561:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788639266.562473:0:19561:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788639266.562475:0:19561:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788639266.562476:0:19561:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788639266.562478:0:19561:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788639266.562481:0:19561:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1788639266.562488:0:19561:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788639266.562489:0:19561:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788639266.562490:0:19561:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788639266.562491:0:19561:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788639266.562491:0:19561:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788639266.562492:0:19561:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788639266.562493:0:19561:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788639266.562494:0:19561:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788639266.562495:0:19561:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788639266.562517:0:19561:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788639266.562533:0:19561:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:19561:1875523773068544:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788639266.562594:0:19561:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639266.562790:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773068544 00000100:00100000:2.0:1788639266.562797:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773068544 00000100:00100000:2.0:1788639266.562845:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788639266.562855:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+24:19561:x1875523773068544:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788639266.562879:0:17233:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788639266.562892:0:17233:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788639266.563047:0:19561:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae24217da80 going to sleep for 11 seconds 20000000:01000000:1.0:1788639266.567293:0:17233:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788639266.567313:0:17233:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788639266.567593:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+24:19561:x1875523773068544:12345-0@lo:253:mount.lustre.0 Request processed in 4734us (4994us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639266.567605:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 20000000:01000000:2.0:1788639266.567714:0:17256:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788639266.567719:0:17256:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788639266.567739:0:17256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ae37f78b800/0x25c454990262d66c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639266.567753:0:17256:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae37f78b000/0x25c454990262d51c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262d515 expref: 23 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639266.567761:0:17256:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae375ef5e00/0x25c454990262d52a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262d523 expref: 23 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639266.567779:0:17256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ae37f78b800/0x25c454990262d66c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639266.567813:0:17256:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae375ef5e00/0x25c454990262d52a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262d523 expref: 23 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639266.567826:0:17256:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae375ef5e00/0x25c454990262d52a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262d523 expref: 23 pid: 17236 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639266.567840:0:17256:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a92a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17256:1875523773068672:0@lo:104: 00000100:00100000:2.0:1788639266.567874:0:17256:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788639266.567914:0:17256:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae37f78b000/0x25c454990262d51c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262d515 expref: 23 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639266.567922:0:17256:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae37f78b000/0x25c454990262d51c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262d515 expref: 23 pid: 17233 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639266.567930:0:17256:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a92d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17256:1875523773068800:0@lo:104: 00000100:00100000:2.0:1788639266.567953:0:17256:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639266.567970:0:17256:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae343acbe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788639266.568351:0:19561:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d225031-35be-4b74-b245-637fda218215:19561:1875523773068544:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788639266.568364:0:19561:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788639266.568367:0:19561:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788639266.568369:0:19561:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788639266.568370:0:19561:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788639266.568371:0:19561:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788639266.568372:0:19561:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788639266.568374:0:19561:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788639266.568375:0:19561:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788639266.568377:0:19561:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788639266.568378:0:19561:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788639266.568391:0:19561:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788639266.571307:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773068672 00000100:00100000:2.0:1788639266.571322:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773068672 00000100:00100000:2.0:1788639266.571363:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773068800 00000100:00100000:2.0:1788639266.571367:0:17225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773068800 00000100:00100000:2.0:1788639266.571383:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788639266.571393:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4d225031-35be-4b74-b245-637fda218215+4:17256:x1875523773068672:12345-0@lo:104: 00010000:00010000:2.0:1788639266.571410:0:17225:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4c00/0x25c454990262d523 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262d52a expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639266.571506:0:17225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788639266.571513:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4d225031-35be-4b74-b245-637fda218215+4:17256:x1875523773068672:12345-0@lo:104: Request processed in 123us (3639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639266.571520:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788639266.571537:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788639266.571544:0:17225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4d225031-35be-4b74-b245-637fda218215+3:17256:x1875523773068800:12345-0@lo:104: 00010000:00010000:2.0:1788639266.571552:0:17225:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae37f78bc00/0x25c454990262d515 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262d51c expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639266.571586:0:17225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788639266.571592:0:17225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4d225031-35be-4b74-b245-637fda218215+3:17256:x1875523773068800:12345-0@lo:104: Request processed in 49us (3638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639266.571597:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1788639266.571630:0:18396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788639266.571636:0:18396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4c00/0x25c454990262d523 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262d52a expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639266.571642:0:18396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef4c00 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:2.0:1788639266.571646:0:18396:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4c00/0x25c454990262d523 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262d52a expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639266.571668:0:18396:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4c00/0x25c454990262d523 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262d52a expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788639266.571677:0:18396:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4c00/0x25c454990262d523 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262d52a expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788639266.571683:0:18396:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788639266.571731:0:18396:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4c00/0x25c454990262d523 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262d52a expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639266.571737:0:18396:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788639266.571753:0:18396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4c00/0x25c454990262d523 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262d52a expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639266.571759:0:18396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4c00/0x25c454990262d523 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262d52a expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639266.571772:0:18396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788639266.571775:0:18396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae37f78bc00/0x25c454990262d515 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262d51c expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639266.571781:0:18396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78bc00 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:2.0:1788639266.571784:0:18396:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae37f78bc00/0x25c454990262d515 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262d51c expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639266.571791:0:18396:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae37f78bc00/0x25c454990262d515 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262d51c expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788639266.571797:0:18396:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae37f78bc00/0x25c454990262d515 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262d51c expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788639266.571801:0:18396:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788639266.571813:0:18396:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae37f78bc00/0x25c454990262d515 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262d51c expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639266.571819:0:18396:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788639266.571825:0:18396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae37f78bc00/0x25c454990262d515 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262d51c expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639266.571841:0:18396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae37f78bc00/0x25c454990262d515 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262d51c expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639266.571858:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639266.571860:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788639266.571861:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639266.571891:0:17256:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a92a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17256:1875523773068672:0@lo:104: 00000100:00100000:2.0:1788639266.571900:0:17256:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a92d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17256:1875523773068800:0@lo:104: 00010000:00010000:2.0:1788639266.571919:0:17256:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ae37f78b800/0x25c454990262d66c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639266.572966:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4d225031-35be-4b74-b245-637fda218215:3643:1875523773068928:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788639266.573017:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639266.573063:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788639266.573069:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4d225031-35be-4b74-b245-637fda218215:3643:1875523773069056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788639266.573089:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639266.573121:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773068928 00000100:00100000:3.0:1788639266.573127:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773068928 00010000:00010000:3.0:1788639266.573237:0:17226:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae375ef5e00/0x25c454990262d52a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262d523 expref: 24 pid: 17236 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639266.573272:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773069056 00000100:00100000:3.0:1788639266.573276:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773069056 00010000:00010000:3.0:1788639266.573289:0:17226:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae37f78b000/0x25c454990262d51c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262d515 expref: 25 pid: 17233 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639266.573302:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788639266.573309:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243152d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d225031-35be-4b74-b245-637fda218215+25:3643:x1875523773068928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788639266.573320:0:17226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639266.573325:0:17226:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae375ef5e00/0x25c454990262d52a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262d523 expref: 25 pid: 17236 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639266.573335:0:17226:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae375ef5e00/0x25c454990262d52a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262d523 expref: 25 pid: 17236 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639266.573351:0:17226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae375ef5e00/0x25c454990262d52a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262d523 expref: 25 pid: 17236 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639266.573365:0:17226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639266.573396:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243152d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d225031-35be-4b74-b245-637fda218215+24:3643:x1875523773068928:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639266.573402:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788639266.573418:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788639266.573424:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243150a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d225031-35be-4b74-b245-637fda218215+23:3643:x1875523773069056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788639266.573431:0:17226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639266.573435:0:17226:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae37f78b000/0x25c454990262d51c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262d515 expref: 23 pid: 17233 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639266.573443:0:17226:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae37f78b000/0x25c454990262d51c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262d515 expref: 23 pid: 17233 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639266.573460:0:17226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae37f78b000/0x25c454990262d51c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262d515 expref: 23 pid: 17233 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639266.573475:0:17226:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ae37f78b800/0x25c454990262d66c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639266.573484:0:17226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae37f78b800/0x25c454990262d66c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788639266.573498:0:17226:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005779275s 00010000:00010000:3.0:1788639266.573503:0:17226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae37f78b800/0x25c454990262d66c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639266.573509:0:17226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae37f78b800/0x25c454990262d66c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639266.573515:0:17226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ae37f78b800/0x25c454990262d66c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639266.573522:0:17226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ae37f78b800/0x25c454990262d66c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639266.573527:0:17226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78b800 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:3.0:1788639266.573532:0:17226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ae37f78b800/0x25c454990262d66c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639266.573540:0:17226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ae37f78b800/0x25c454990262d66c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639266.573554:0:17226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ae37f78b800/0x25c454990262d66c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639266.573571:0:17226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639266.573595:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243150a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d225031-35be-4b74-b245-637fda218215+22:3643:x1875523773069056:12345-0@lo:103:ldlm_bl.0 Request processed in 172us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639266.573601:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788639266.573673:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4d225031-35be-4b74-b245-637fda218215:3643:1875523773069056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788639266.573683:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4d225031-35be-4b74-b245-637fda218215:3643:1875523773068928:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788639266.573708:0:17256:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ae37f78b800/0x25c454990262d66c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639266.573721:0:17256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ae37f78b800/0x25c454990262d66c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639266.573727:0:17256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae37f78b800/0x25c454990262d66c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639266.581702:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1788639266.591814:0:19561:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788639266.594854:0:19561:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788639266.594863:0:19561:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788639266.594899:0:19561:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788639266.594942:0:19561:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.118@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788639266.594962:0:19561:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1788639266.594979:0:19561:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1788639266.596040:0:19561:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788639266.596544:0:19561:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788639267.139681:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639267.512279:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773069184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788639267.512384:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639267.512522:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773069184 00000100:00100000:0.0:1788639267.512547:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773069184 00000100:00100000:0.0:1788639267.512660:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788639267.512672:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243150e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773069184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788639267.512709:0:18751:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788639267.512765:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243150e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773069184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639267.512773:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788639267.513319:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773069184:0@lo:13:osp-pre-0-0.0 00000020:00000004:0.0:1788639267.698977:0:19629:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788639267.699449:0:19629:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1788639267.700751:0:17238:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788639267.700759:0:17238:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ae34303d000 from 10 10000000:01000000:2.0:1788639267.700765:0:17238:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788639267.700824:0:17238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78bc00/0x25c454990262d673 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639267.700839:0:17238:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae37f78bc00/0x25c454990262d673 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639267.700853:0:17238:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae37f78bc00/0x25c454990262d673 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639267.700886:0:17238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773069312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788639267.700982:0:17238:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639267.701039:0:17238:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae343acb540 going to sleep for 11 seconds 00000100:00100000:3.0:1788639267.701111:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773069312 00000100:00100000:3.0:1788639267.701122:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773069312 00000100:00100000:3.0:1788639267.701204:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788639267.701222:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+22:17238:x1875523773069312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788639267.701238:0:17236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639267.701255:0:17236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae242f9f800/0x25c454990262d67a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262d673 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639267.701306:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae242f9f800/0x25c454990262d67a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262d673 expref: 23 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639267.701319:0:17236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae242f9f800/0x25c454990262d67a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262d673 expref: 23 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639267.701330:0:17236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f9f800, rc 0) 00000100:00100000:3.0:1788639267.701376:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+23:17238:x1875523773069312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639267.701384:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788639267.701683:0:17238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773069312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788639267.701720:0:17238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae37f78bc00/0x25c454990262d673 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d67a expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639267.701731:0:17238:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae37f78bc00/0x25c454990262d673 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262d67a expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639267.701791:0:17238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773069440:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788639267.701829:0:17238:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639267.701861:0:17238:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae343acb540 going to sleep for 11 seconds 00000100:00100000:3.0:1788639267.702540:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773069440 00000100:00100000:3.0:1788639267.702548:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773069440 00000100:00100000:3.0:1788639267.702676:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788639267.702685:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+23:17238:x1875523773069440:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788639267.702707:0:17233:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788639267.702731:0:17233:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788639267.702734:0:17233:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1788639267.702828:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+23:17238:x1875523773069440:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 144us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639267.702835:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788639267.706705:0:17238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773069440:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788639267.706820:0:17238:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788639267.706834:0:17238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78bc00/0x25c454990262d673 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d67a expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639267.706847:0:17238:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae37f78bc00/0x25c454990262d673 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d67a expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788639267.706859:0:17238:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788639267.706862:0:17238:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ae243aeb000 from 10 10000000:01000000:2.0:1788639267.706865:0:17238:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788639267.706910:0:17238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b000/0x25c454990262d681 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639267.706918:0:17238:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b000/0x25c454990262d681 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639267.706930:0:17238:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b000/0x25c454990262d681 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639267.706964:0:17238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773069568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788639267.707042:0:17238:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639267.707094:0:17238:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae343acb540 going to sleep for 11 seconds 00000100:00100000:0.0:1788639267.707252:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773069568 00000100:00100000:0.0:1788639267.707260:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773069568 00000100:00100000:0.0:1788639267.707314:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788639267.707326:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+23:17238:x1875523773069568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788639267.707342:0:17235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639267.707359:0:17235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae375ef4000/0x25c454990262d688 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262d681 expref: -99 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639267.707388:0:17235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae375ef4000/0x25c454990262d688 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262d681 expref: 24 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639267.707401:0:17235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae375ef4000/0x25c454990262d688 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262d681 expref: 24 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639267.707410:0:17235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375ef4000, rc 0) 00000100:00100000:0.0:1788639267.707457:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+24:17238:x1875523773069568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639267.707464:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788639267.708816:0:17238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773069568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788639267.708849:0:17238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b000/0x25c454990262d681 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d688 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639267.708863:0:17238:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b000/0x25c454990262d681 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262d688 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639267.708944:0:17238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773069696:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788639267.709012:0:17238:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639267.709065:0:17238:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae343acb540 going to sleep for 11 seconds 00000100:00100000:1.0:1788639267.709923:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773069696 00000100:00100000:1.0:1788639267.709933:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773069696 00000100:00100000:1.0:1788639267.709986:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788639267.709996:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+24:17238:x1875523773069696:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788639267.710022:0:17236:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788639267.710041:0:17236:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788639267.710044:0:17236:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1788639267.710183:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+24:17238:x1875523773069696:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 187us (1169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639267.710191:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788639267.710289:0:17238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773069696:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788639267.710376:0:17238:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788639267.710386:0:17238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b000/0x25c454990262d681 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d688 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639267.710396:0:17238:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae37f78b000/0x25c454990262d681 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d688 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639268.149049:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639269.175415:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788639269.557331:0:17279:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788639269.558914:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523773069824:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788639269.559018:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639269.559097:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773069824 00000100:00100000:0.0:1788639269.559106:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773069824 00000100:00100000:0.0:1788639269.559170:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788639269.559182:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523773069824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788639269.559216:0:18751:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788639269.559263:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523773069824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639269.559269:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788639269.559291:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788639269.559336:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523773069824:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788639270.068879:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788639270.068922:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773069952:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788639270.069017:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639270.069105:0:17981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773069952 00000100:00100000:2.0:1788639270.069115:0:17981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773069952 00000100:00100000:2.0:1788639270.069179:0:17981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788639270.069191:0:17981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243315500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773069952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788639270.069236:0:17981:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788639270.069306:0:17981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243315500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773069952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 116us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639270.069314:0:17981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788639270.069376:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773069952:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788639270.202114:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639270.580903:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243151f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773070080:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788639270.580969:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639270.581074:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773070080 00000100:00100000:3.0:1788639270.581082:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773070080 00000100:00100000:3.0:1788639270.581131:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788639270.581140:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243314e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523773070080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788639270.581182:0:17245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788639270.581228:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243314e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523773070080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639270.581235:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788639270.581380:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243151f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773070080:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788639271.228354:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788639271.288932:0:17999:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:3.0:1788639271.609174:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788639271.609181:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788639271.609184:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ae375cad000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788639271.609195:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ae375cad000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:3.0:1788639271.609218:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae243151880 x1875523773070592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788639271.609261:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788639271.609265:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788639271.609266:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ae36d235800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788639271.609271:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ae36d235800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:3.0:1788639271.609281:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ae243151180 x1875523773071104/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788639271.609333:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243152680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773070336:0@lo:400:kworker.0 00000100:00100000:3.0:1788639271.609398:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639271.609440:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243153100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523773070976:0@lo:400:kworker.0 00000100:00100000:3.0:1788639271.609473:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639271.609492:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243150700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875523773071616:0@lo:400:kworker.0 00000100:00100000:3.0:1788639271.609518:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639271.609640:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4d225031-35be-4b74-b245-637fda218215:3641:1875523773070208:0@lo:400:kworker.0 00000100:00100000:0.0:1788639271.609673:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639271.609696:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243153b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773070848:0@lo:400:kworker.0 00000100:00100000:0.0:1788639271.609715:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639271.609730:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243153480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875523773071488:0@lo:400:kworker.0 00000100:00100000:0.0:1788639271.609745:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639271.609775:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773070208 00000100:00100000:0.0:1788639271.609782:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773070208 00000100:00100000:0.0:1788639271.609821:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788639271.609829:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+24:3641:x1875523773070208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639271.609871:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+24:3641:x1875523773070208:12345-0@lo:400:kworker.0 Request processed in 44us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639271.609877:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788639271.609914:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773071616 00000100:00100000:0.0:1788639271.609917:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773071616 00000100:00100000:0.0:1788639271.609947:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773071488 00000100:00100000:0.0:1788639271.609950:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773071488 00000100:00100000:0.0:1788639271.609969:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788639271.609974:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875523773071616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639271.610001:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875523773071616:12345-0@lo:400:kworker.0 Request processed in 27us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639271.610006:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788639271.610016:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788639271.610021:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875523773071488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639271.610043:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875523773071488:12345-0@lo:400:kworker.0 Request processed in 22us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639271.610047:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1788639271.610063:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788639271.610066:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788639271.610087:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4d225031-35be-4b74-b245-637fda218215:3641:1875523773070208:0@lo:400:kworker.0 00010000:00080000:0.0:1788639271.610098:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae243153480 x1875523773071488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639271.610108:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243153480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875523773071488:0@lo:400:kworker.0 00010000:00080000:3.0:1788639271.610199:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae243150700 x1875523773071616/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639271.610208:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243150700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875523773071616:0@lo:400:kworker.0 00000100:00100000:3.0:1788639271.610226:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243151c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773070464:0@lo:400:kworker.0 00000100:00100000:3.0:1788639271.610251:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639271.610269:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243152a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875523773071232:0@lo:400:kworker.0 00000100:00100000:3.0:1788639271.610288:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639271.610302:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243153800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875523773071744:0@lo:400:kworker.0 00000100:00100000:3.0:1788639271.610321:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639271.610336:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788639271.610341:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243150000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523773070720:0@lo:400:kworker.0 00000100:00100000:3.0:1788639271.610358:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639271.610367:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243152300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875523773071360:0@lo:400:kworker.0 00000100:00100000:3.0:1788639271.610384:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639271.610403:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243151880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773070592:0@lo:8:kworker.0 00000100:00100000:3.0:1788639271.610421:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639271.610435:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243151180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773071104:0@lo:8:kworker.0 00000100:00100000:3.0:1788639271.610454:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639271.610485:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773070336 00000100:00100000:3.0:1788639271.610488:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773070336 00000100:00100000:3.0:1788639271.610511:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773070848 00000100:00100000:3.0:1788639271.610519:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773070848 00000100:00100000:3.0:1788639271.610534:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788639271.610711:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243151f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773070336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639271.610791:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243151f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773070336:12345-0@lo:400:kworker.0 Request processed in 251us (1392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639271.610797:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788639271.610811:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788639271.610818:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773070848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639271.610851:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773070848:12345-0@lo:400:kworker.0 Request processed in 35us (1135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639271.610857:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788639271.610872:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773070976 00000100:00100000:3.0:1788639271.610875:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773070976 00000100:00100000:3.0:1788639271.610898:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773070464 00000100:00100000:3.0:1788639271.610901:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773070464 00000100:00100000:3.0:1788639271.610910:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773070592 00000100:00100000:3.0:1788639271.610912:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773070592 00000100:00100000:3.0:1788639271.610920:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773071104 00000100:00100000:3.0:1788639271.610922:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773071104 00000100:00100000:3.0:1788639271.610930:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788639271.610935:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523773070976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639271.610963:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523773070976:12345-0@lo:400:kworker.0 Request processed in 28us (1489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639271.610969:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788639271.610979:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788639271.610985:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523773070464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639271.611011:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523773070464:12345-0@lo:400:kworker.0 Request processed in 27us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639271.611024:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788639271.611035:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788639271.611039:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1875523773070592:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788639271.611061:0:18747:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 530 last 0 00000020:00000080:3.0:1788639271.611085:0:18747:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x25c454990262d68f 00002000:00100000:3.0:1788639271.611097:0:18747:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9ae24226b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788639271.611101:0:18747:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788639271.611104:0:18747:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788639271.611266:0:18747:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788639271.611288:0:18747:0:(import.c:65:import_set_state_nolock()) ffff9ae24226a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788639271.611324:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1875523773070592:12345-0@lo:8:kworker.0 Request processed in 283us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639271.611330:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788639271.611342:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788639271.611346:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1875523773071104:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788639271.611360:0:18747:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 530 last 0 00000020:00000080:3.0:1788639271.611373:0:18747:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x25c454990262d696 00002000:00100000:3.0:1788639271.611379:0:18747:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9ae242268800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1788639271.611382:0:18747:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1788639271.611384:0:18747:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788639271.611405:0:18747:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1788639271.611416:0:18747:0:(import.c:65:import_set_state_nolock()) ffff9ae24226e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788639271.611443:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1875523773071104:12345-0@lo:8:kworker.0 Request processed in 95us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639271.611449:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788639271.611477:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773071232 00000100:00100000:3.0:1788639271.611480:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773071232 00000100:00100000:3.0:1788639271.611497:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773071744 00000100:00100000:3.0:1788639271.611500:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773071744 00000100:00100000:3.0:1788639271.611509:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773070720 00000100:00100000:3.0:1788639271.611511:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773070720 00000100:00100000:3.0:1788639271.611519:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773071360 00000100:00100000:3.0:1788639271.611522:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773071360 00000100:00100000:3.0:1788639271.611535:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788639271.614713:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875523773071232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639271.614800:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875523773071232:12345-0@lo:400:kworker.0 Request processed in 110us (4511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639271.614809:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788639271.614842:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788639271.614849:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875523773071744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639271.614878:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875523773071744:12345-0@lo:400:kworker.0 Request processed in 31us (4556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639271.614884:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788639271.614896:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788639271.614902:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523773070720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639271.614927:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523773070720:12345-0@lo:400:kworker.0 Request processed in 25us (4568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639271.614932:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788639271.614944:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788639271.614950:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875523773071360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639271.614975:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875523773071360:12345-0@lo:400:kworker.0 Request processed in 26us (4590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639271.614995:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1788639271.615072:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae243150000 x1875523773070720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639271.615086:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243150000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523773070720:0@lo:400:kworker.0 00010000:00080000:3.0:1788639271.615098:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae243152300 x1875523773071360/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639271.615107:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243152300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875523773071360:0@lo:400:kworker.0 00000100:00100000:3.0:1788639271.615119:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243151c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773070464:0@lo:400:kworker.0 00010000:00080000:3.0:1788639271.615127:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae243152a00 x1875523773071232/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639271.615134:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243152a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875523773071232:0@lo:400:kworker.0 00010000:00080000:3.0:1788639271.615144:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae243153800 x1875523773071744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639271.615152:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243153800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875523773071744:0@lo:400:kworker.0 00010000:00080000:3.0:1788639271.615196:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae243151880 x1875523773070592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788639296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788639271.615210:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788639271.615218:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788639271.615223:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788639271.615227:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae375cad000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788639271.615254:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788639271.615262:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243151880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875523773070592:0@lo:8:kworker.0 00010000:00080000:3.0:1788639271.615284:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae243151180 x1875523773071104/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788639296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788639271.615293:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788639271.615298:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788639271.615301:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788639271.615303:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9ae36d235800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788639271.615315:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788639271.615319:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243151180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875523773071104:0@lo:8:kworker.0 00000004:00080000:3.0:1788639271.615340:0:17266:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788639271.615415:0:17266:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 530409798089ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788639271.615421:0:17266:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1788639271.615469:0:17985:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788639271.615488:0:17985:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242ed5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17985:1875523773072000:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1788639271.615520:0:17985:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639271.615551:0:17985:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d2b5900 going to sleep for 11 seconds 00000100:00100000:0.0:1788639271.620290:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243152680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773070336:0@lo:400:kworker.0 00000004:00080000:0.0:1788639271.620347:0:17267:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:0.0:1788639271.620369:0:17267:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b14380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17267:1875523773072256:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788639271.620426:0:17267:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639271.620472:0:17267:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae360f4fcc0 going to sleep for 11 seconds 00000004:00080000:0.0:1788639271.620505:0:17984:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788639271.620600:0:17984:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 530414983327ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788639271.620607:0:17984:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788639271.620796:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243153100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523773070976:0@lo:400:kworker.0 00000100:00100000:0.0:1788639271.620820:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788639271.620826:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773072128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788639271.620853:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639271.620880:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773072128 00000100:00100000:0.0:1788639271.620885:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773072128 00000100:00100000:0.0:1788639271.620929:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788639271.620938:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1875523773072128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788639271.620962:0:18751:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788639271.621000:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1875523773072128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639271.621007:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788639271.621039:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae243b15880 x1875523773072128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639287 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639271.621055:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773072128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788639271.621345:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773071872:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788639271.621375:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639271.621403:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773071872 00000100:00100000:3.0:1788639271.621407:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773071872 00000100:00100000:3.0:1788639271.621431:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788639271.621437:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875523773071872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788639271.621448:0:18751:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788639271.621480:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875523773071872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639271.621486:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788639271.621509:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788639271.621519:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788639271.621521:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788639271.621524:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788639271.621553:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae242ed6680 x1875523773071872/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788639287 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788639271.621566:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773071872:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788639271.621602:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243153b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773070848:0@lo:400:kworker.0 00000100:00100000:3.0:1788639271.621644:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773072000 00000100:00100000:3.0:1788639271.621648:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773072000 00000100:00100000:3.0:1788639271.621671:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773072256 00000100:00100000:3.0:1788639271.621674:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773072256 00000100:00100000:3.0:1788639271.621686:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788639271.621691:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17985:x1875523773072000:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1788639271.621824:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788639271.621831:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17267:x1875523773072256:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788639271.624350:0:17221:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1788639271.627018:0:17973:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:3.0:1788639271.627217:0:18747:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1788639271.627223:0:18747:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1788639271.627309:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17985:x1875523773072000:12345-0@lo:7:osp-pre-1-1.0 Request processed in 5613us (11784us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639271.627320:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1788639271.627406:0:17985:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae242ed5880 x1875523773072000/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788639287 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639271.627421:0:17985:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242ed5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17985:1875523773072000:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1788639271.627433:0:17985:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788639271.627470:0:17985:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b15880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17985:1875523773072384:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788639271.627506:0:17985:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639271.627695:0:17985:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2430666c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788639271.636795:0:19077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773072384 00000100:00100000:3.0:1788639271.636807:0:19077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773072384 00000100:00100000:3.0:1788639271.636871:0:19077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788639271.636881:0:19077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17985:x1875523773072384:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788639271.636914:0:19077:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1788639271.636984:0:19077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17985:x1875523773072384:12345-0@lo:5:osp-pre-1-1.0 Request processed in 104us (9476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639271.636997:0:19077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1788639271.637087:0:17985:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae243b15880 x1875523773072384/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788639287 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639271.637103:0:17985:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b15880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17985:1875523773072384:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788639271.637117:0:17985:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788639271.637172:0:17985:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b15880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17985:1875523773072512:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788639271.637207:0:17985:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639271.637234:0:17985:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae2430666c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788639271.637249:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773072512 00000100:00100000:0.0:1788639271.637253:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773072512 00000100:00100000:0.0:1788639271.637276:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788639271.637282:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17985:x1875523773072512:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788639271.637305:0:18749:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00080000:0.0:1788639271.642021:0:18750:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1788639271.642034:0:18750:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1788639271.642041:0:18750:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00002000:00010000:1.0:1788639271.656741:0:18750:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788639271.656756:0:18750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6a1eb6a/0x25c454990262d69d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639271.656772:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=530s v=(0 0) 00010000:00010000:1.0:1788639271.656777:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639271.656783:0:18750:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6a1eb6a/0x25c454990262d69d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639271.656801:0:18750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6a1eb6a/0x25c454990262d69d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639271.656812:0:18750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6a1eb6a/0x25c454990262d69d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639271.656820:0:18750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6a1eb6a/0x25c454990262d69d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639271.656844:0:18750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788639271.657154:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788639271.657161:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6a1eb6a/0x25c454990262d69d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.657170:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fa600 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:3.0:1788639271.657174:0:17230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6a1eb6a/0x25c454990262d69d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.657184:0:17230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6a1eb6a/0x25c454990262d69d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.657202:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6a1eb6a/0x25c454990262d69d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.657210:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6a1eb6a/0x25c454990262d69d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.657229:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639271.657231:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639271.657233:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788639271.659791:0:18750:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788639271.659804:0:18750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bbae92c/0x25c454990262d6a4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.659820:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=530s v=(0 0) 00010000:00010000:0.0:1788639271.659824:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788639271.659830:0:18750:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bbae92c/0x25c454990262d6a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.659847:0:18750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005bbae92c/0x25c454990262d6a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.659869:0:18750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bbae92c/0x25c454990262d6a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.659877:0:18750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005bbae92c/0x25c454990262d6a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.659894:0:18750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788639271.659904:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639271.659909:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005bbae92c/0x25c454990262d6a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.659916:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef5e00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639271.659921:0:17229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005bbae92c/0x25c454990262d6a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.659930:0:17229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005bbae92c/0x25c454990262d6a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.659946:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005bbae92c/0x25c454990262d6a4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.659953:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005bbae92c/0x25c454990262d6a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.659970:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639271.659976:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639271.659978:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788639271.663916:0:18750:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788639271.663927:0:18750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ec3eeb2/0x25c454990262d6ab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.663943:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=530s v=(0 0) 00010000:00010000:0.0:1788639271.663948:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788639271.663955:0:18750:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ec3eeb2/0x25c454990262d6ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.663968:0:18750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ec3eeb2/0x25c454990262d6ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.663979:0:18750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ec3eeb2/0x25c454990262d6ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.663986:0:18750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ec3eeb2/0x25c454990262d6ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.664004:0:18750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788639271.664015:0:18396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639271.664020:0:18396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ec3eeb2/0x25c454990262d6ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.664027:0:18396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef4c00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639271.664031:0:18396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ec3eeb2/0x25c454990262d6ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.664052:0:18396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ec3eeb2/0x25c454990262d6ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.664067:0:18396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ec3eeb2/0x25c454990262d6ab lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.664075:0:18396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ec3eeb2/0x25c454990262d6ab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.664091:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639271.664093:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639271.664094:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788639271.666361:0:18750:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788639271.666372:0:18750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ca76f38/0x25c454990262d6b2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639271.666387:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=530s v=(0 0) 00010000:00010000:1.0:1788639271.666391:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639271.666397:0:18750:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ca76f38/0x25c454990262d6b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639271.666411:0:18750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ca76f38/0x25c454990262d6b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639271.666428:0:18750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ca76f38/0x25c454990262d6b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639271.666437:0:18750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ca76f38/0x25c454990262d6b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639271.666493:0:18750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788639271.668905:0:18750:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788639271.668918:0:18750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aafee9b0/0x25c454990262d6b9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639271.668933:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=530s v=(0 0) 00010000:00010000:1.0:1788639271.668937:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639271.668943:0:18750:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aafee9b0/0x25c454990262d6b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639271.668957:0:18750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aafee9b0/0x25c454990262d6b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639271.668967:0:18750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aafee9b0/0x25c454990262d6b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639271.668975:0:18750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aafee9b0/0x25c454990262d6b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.675315:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788639271.675328:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ca76f38/0x25c454990262d6b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.675341:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fb600 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:3.0:1788639271.675346:0:17230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ca76f38/0x25c454990262d6b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.675363:0:17230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ca76f38/0x25c454990262d6b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.675388:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ca76f38/0x25c454990262d6b2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.675396:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ca76f38/0x25c454990262d6b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.675415:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788639271.675419:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aafee9b0/0x25c454990262d6b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.675425:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fb400 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:3.0:1788639271.675429:0:17230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aafee9b0/0x25c454990262d6b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.675436:0:17230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aafee9b0/0x25c454990262d6b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.675444:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aafee9b0/0x25c454990262d6b9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.675451:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639271.675452:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639271.675458:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639271.676378:0:18750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788639271.676389:0:18750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aafee9b0/0x25c454990262d6b9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788639271.677984:0:18750:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788639271.677997:0:18750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd30a1ba/0x25c454990262d6c0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639271.678014:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=530s v=(0 0) 00010000:00010000:1.0:1788639271.678019:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639271.678025:0:18750:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd30a1ba/0x25c454990262d6c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639271.678039:0:18750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd30a1ba/0x25c454990262d6c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639271.678050:0:18750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd30a1ba/0x25c454990262d6c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639271.678059:0:18750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd30a1ba/0x25c454990262d6c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.683104:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788639271.683117:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd30a1ba/0x25c454990262d6c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.683142:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fb200 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:3.0:1788639271.683147:0:17229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd30a1ba/0x25c454990262d6c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.683160:0:17229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd30a1ba/0x25c454990262d6c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.683180:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd30a1ba/0x25c454990262d6c0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.683190:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639271.683192:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639271.683194:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639271.684257:0:18750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788639271.684267:0:18750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd30a1ba/0x25c454990262d6c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.684695:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788639271.685429:0:19562:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1788639271.685447:0:19562:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788639271.685451:0:19562:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:0.0:1788639271.688332:0:18750:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788639271.688345:0:18750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ec3eeb2/0x25c454990262d6c7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.688362:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=530s v=(0 0) 00010000:00010000:0.0:1788639271.688367:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788639271.688374:0:18750:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ec3eeb2/0x25c454990262d6c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.688389:0:18750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ec3eeb2/0x25c454990262d6c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.688400:0:18750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ec3eeb2/0x25c454990262d6c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.688420:0:18750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ec3eeb2/0x25c454990262d6c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.688436:0:18750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788639271.688655:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788639271.688663:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ec3eeb2/0x25c454990262d6c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.688671:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef4c00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:3.0:1788639271.688675:0:17230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ec3eeb2/0x25c454990262d6c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.688683:0:17230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ec3eeb2/0x25c454990262d6c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.688710:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ec3eeb2/0x25c454990262d6c7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.688719:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ec3eeb2/0x25c454990262d6c7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.688735:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639271.688737:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639271.688739:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639271.688842:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17985:x1875523773072512:12345-0@lo:5:osp-pre-1-1.0 Request processed in 51555us (51631us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788639271.688853:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788639271.688935:0:17985:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788639271.688942:0:17985:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b15880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17985:1875523773072512:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788639271.688956:0:17985:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788639271.689002:0:17985:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae242ed6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17985:1875523773072640:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1788639271.689045:0:17985:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639271.689074:0:17985:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36d2b5480 going to sleep for 11 seconds 00000100:00100000:1.0:1788639271.690026:0:17252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773072640 00000100:00100000:1.0:1788639271.690035:0:17252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773072640 00000100:00100000:1.0:1788639271.690088:0:17252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788639271.690097:0:17252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17985:x1875523773072640:12345-0@lo:900:osp-pre-1-1.0 00002000:00010000:0.0:1788639271.690304:0:18750:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788639271.690312:0:18750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bbae92c/0x25c454990262d6ce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.690325:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=530s v=(0 0) 00010000:00010000:0.0:1788639271.690329:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788639271.690335:0:18750:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bbae92c/0x25c454990262d6ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.690348:0:18750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005bbae92c/0x25c454990262d6ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.690358:0:18750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bbae92c/0x25c454990262d6ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.690366:0:18750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005bbae92c/0x25c454990262d6ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.690388:0:18750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788639271.690869:0:17252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17985:x1875523773072640:12345-0@lo:900:osp-pre-1-1.0 Request processed in 772us (1823us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639271.690878:0:17252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788639271.690925:0:17985:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae242ed6680 x1875523773072640/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788639287 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788639271.690938:0:17985:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae242ed6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17985:1875523773072640:0@lo:900:osp-pre-1-1.0 00002000:00010000:0.0:1788639271.694317:0:18750:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788639271.694330:0:18750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b7d3ccd/0x25c454990262d6d5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.694354:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=530s v=(0 0) 00010000:00010000:0.0:1788639271.694359:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788639271.694365:0:18750:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b7d3ccd/0x25c454990262d6d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.694380:0:18750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b7d3ccd/0x25c454990262d6d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.694390:0:18750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b7d3ccd/0x25c454990262d6d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.694399:0:18750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b7d3ccd/0x25c454990262d6d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.694415:0:18750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788639271.694926:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788639271.694935:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005bbae92c/0x25c454990262d6ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.694945:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef5e00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:3.0:1788639271.694950:0:17229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005bbae92c/0x25c454990262d6ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.694960:0:17229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005bbae92c/0x25c454990262d6ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.694986:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005bbae92c/0x25c454990262d6ce lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.694994:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005bbae92c/0x25c454990262d6ce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.695013:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788639271.695017:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b7d3ccd/0x25c454990262d6d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.695024:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef5400 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:3.0:1788639271.695028:0:17229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b7d3ccd/0x25c454990262d6d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.695036:0:17229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b7d3ccd/0x25c454990262d6d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.695046:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b7d3ccd/0x25c454990262d6d5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.695054:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b7d3ccd/0x25c454990262d6d5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.695065:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639271.695067:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639271.695074:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639271.695233:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788639271.699560:0:18750:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788639271.699573:0:18750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f35e999/0x25c454990262d6dc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.699590:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=530s v=(0 0) 00010000:00010000:3.0:1788639271.699594:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639271.699599:0:18750:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f35e999/0x25c454990262d6dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.699647:0:18750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f35e999/0x25c454990262d6dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.699659:0:18750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f35e999/0x25c454990262d6dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.699667:0:18750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f35e999/0x25c454990262d6dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.699692:0:18750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788639271.700140:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639271.700148:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f35e999/0x25c454990262d6dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.700156:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9f400 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639271.700161:0:17230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f35e999/0x25c454990262d6dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.700170:0:17230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f35e999/0x25c454990262d6dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.700199:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f35e999/0x25c454990262d6dc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.700207:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f35e999/0x25c454990262d6dc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.700225:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639271.700227:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639271.700228:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788639271.700414:0:18750:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788639271.700420:0:18750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000587d9fc6/0x25c454990262d6e3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.700429:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=530s v=(0 0) 00010000:00010000:0.0:1788639271.700432:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788639271.700437:0:18750:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000587d9fc6/0x25c454990262d6e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.700446:0:18750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000587d9fc6/0x25c454990262d6e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.700453:0:18750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000587d9fc6/0x25c454990262d6e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.700460:0:18750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000587d9fc6/0x25c454990262d6e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.700491:0:18750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788639271.700855:0:18750:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788639271.700861:0:18750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5f5b35f/0x25c454990262d6ea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.700869:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=530s v=(0 0) 00010000:00010000:0.0:1788639271.700873:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788639271.700877:0:18750:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5f5b35f/0x25c454990262d6ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.700885:0:18750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5f5b35f/0x25c454990262d6ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.700894:0:18750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5f5b35f/0x25c454990262d6ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.700901:0:18750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5f5b35f/0x25c454990262d6ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.700917:0:18750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788639271.700925:0:18396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788639271.700928:0:18396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000587d9fc6/0x25c454990262d6e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.700934:0:18396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef4200 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639271.700943:0:18396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000587d9fc6/0x25c454990262d6e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.700951:0:18396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000587d9fc6/0x25c454990262d6e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.700960:0:18396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000587d9fc6/0x25c454990262d6e3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.700966:0:18396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000587d9fc6/0x25c454990262d6e3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.700981:0:18396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639271.700984:0:18396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5f5b35f/0x25c454990262d6ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.700989:0:18396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef5200 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639271.700992:0:18396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5f5b35f/0x25c454990262d6ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.700999:0:18396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5f5b35f/0x25c454990262d6ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.701008:0:18396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5f5b35f/0x25c454990262d6ea lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.701015:0:18396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5f5b35f/0x25c454990262d6ea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.701033:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639271.701034:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639271.701036:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639271.701339:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788639271.701883:0:18750:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788639271.701891:0:18750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ec3eeb2/0x25c454990262d6f1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.701902:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=530s v=(0 0) 00010000:00010000:0.0:1788639271.701905:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788639271.701910:0:18750:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ec3eeb2/0x25c454990262d6f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.701920:0:18750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ec3eeb2/0x25c454990262d6f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.701928:0:18750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ec3eeb2/0x25c454990262d6f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.701935:0:18750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ec3eeb2/0x25c454990262d6f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.701957:0:18750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788639271.702257:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788639271.702263:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ec3eeb2/0x25c454990262d6f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.702271:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef4c00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:3.0:1788639271.702275:0:17230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ec3eeb2/0x25c454990262d6f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.702294:0:17230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ec3eeb2/0x25c454990262d6f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.702307:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ec3eeb2/0x25c454990262d6f1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.702314:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ec3eeb2/0x25c454990262d6f1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.702330:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639271.702332:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788639271.702334:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788639271.703123:0:18750:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788639271.703143:0:18750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3c24af7/0x25c454990262d6f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.703156:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=530s v=(0 0) 00010000:00010000:3.0:1788639271.703160:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639271.703165:0:18750:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3c24af7/0x25c454990262d6f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.703177:0:18750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3c24af7/0x25c454990262d6f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.703186:0:18750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3c24af7/0x25c454990262d6f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.703202:0:18750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3c24af7/0x25c454990262d6f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.703218:0:18750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788639271.703675:0:18396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639271.703682:0:18396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3c24af7/0x25c454990262d6f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.703702:0:18396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9ea00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639271.703707:0:18396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3c24af7/0x25c454990262d6f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.703715:0:18396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3c24af7/0x25c454990262d6f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.703731:0:18396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3c24af7/0x25c454990262d6f8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.703738:0:18396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3c24af7/0x25c454990262d6f8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.703755:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639271.703757:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639271.703758:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788639271.703883:0:18750:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788639271.703889:0:18750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d0b274d/0x25c454990262d6ff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.703898:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=530s v=(0 0) 00010000:00010000:3.0:1788639271.703900:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639271.703904:0:18750:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d0b274d/0x25c454990262d6ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.703913:0:18750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d0b274d/0x25c454990262d6ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.703920:0:18750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d0b274d/0x25c454990262d6ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.703926:0:18750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d0b274d/0x25c454990262d6ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.703948:0:18750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788639271.704237:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788639271.704244:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d0b274d/0x25c454990262d6ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639271.704251:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9e000 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:1.0:1788639271.704254:0:17229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d0b274d/0x25c454990262d6ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639271.704275:0:17229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d0b274d/0x25c454990262d6ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639271.704287:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d0b274d/0x25c454990262d6ff lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639271.704295:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d0b274d/0x25c454990262d6ff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639271.704309:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639271.704310:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639271.704312:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788639271.705769:0:18750:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788639271.705780:0:18750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092b0164c/0x25c454990262d706 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.705801:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=530s v=(0 0) 00010000:00010000:3.0:1788639271.705804:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639271.705811:0:18750:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092b0164c/0x25c454990262d706 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.705823:0:18750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092b0164c/0x25c454990262d706 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.705833:0:18750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092b0164c/0x25c454990262d706 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.705840:0:18750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092b0164c/0x25c454990262d706 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.705859:0:18750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788639271.706269:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639271.706276:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092b0164c/0x25c454990262d706 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.706284:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9fa00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639271.706288:0:17230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092b0164c/0x25c454990262d706 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.706297:0:17230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092b0164c/0x25c454990262d706 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.706319:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092b0164c/0x25c454990262d706 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.706326:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092b0164c/0x25c454990262d706 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.706343:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639271.706345:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639271.706346:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788639271.706421:0:18750:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788639271.706426:0:18750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d117fcf3/0x25c454990262d70d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.706434:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=530s v=(0 0) 00010000:00010000:3.0:1788639271.706437:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639271.706441:0:18750:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d117fcf3/0x25c454990262d70d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.706450:0:18750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d117fcf3/0x25c454990262d70d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.706467:0:18750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d117fcf3/0x25c454990262d70d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.706474:0:18750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d117fcf3/0x25c454990262d70d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.706493:0:18750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788639271.706832:0:18396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639271.706838:0:18396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d117fcf3/0x25c454990262d70d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.706845:0:18396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9f600 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639271.706849:0:18396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d117fcf3/0x25c454990262d70d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.706857:0:18396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d117fcf3/0x25c454990262d70d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.706868:0:18396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d117fcf3/0x25c454990262d70d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.706875:0:18396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d117fcf3/0x25c454990262d70d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.706900:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639271.706902:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639271.706903:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788639271.708239:0:18750:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788639271.708251:0:18750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3f169ab/0x25c454990262d714 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.708265:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=530s v=(0 0) 00010000:00010000:3.0:1788639271.708270:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639271.708276:0:18750:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3f169ab/0x25c454990262d714 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.708288:0:18750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3f169ab/0x25c454990262d714 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.708298:0:18750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3f169ab/0x25c454990262d714 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.708306:0:18750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3f169ab/0x25c454990262d714 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.708342:0:18750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788639271.709038:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639271.709046:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3f169ab/0x25c454990262d714 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.709055:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9f000 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639271.709060:0:17229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3f169ab/0x25c454990262d714 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.709071:0:17229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3f169ab/0x25c454990262d714 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.709088:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3f169ab/0x25c454990262d714 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.709096:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3f169ab/0x25c454990262d714 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.709114:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639271.709116:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639271.709117:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788639271.709935:0:18750:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788639271.709944:0:18750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee8cb798/0x25c454990262d71b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.709956:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=530s v=(0 0) 00010000:00010000:3.0:1788639271.709960:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639271.709966:0:18750:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee8cb798/0x25c454990262d71b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.709976:0:18750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee8cb798/0x25c454990262d71b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.709984:0:18750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee8cb798/0x25c454990262d71b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.709991:0:18750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee8cb798/0x25c454990262d71b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.710011:0:18750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788639271.710316:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639271.710322:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee8cb798/0x25c454990262d71b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.710341:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9fe00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639271.710346:0:17230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee8cb798/0x25c454990262d71b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.710353:0:17230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee8cb798/0x25c454990262d71b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.710366:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee8cb798/0x25c454990262d71b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.710374:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee8cb798/0x25c454990262d71b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.710389:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639271.710391:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639271.710393:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788639271.710601:0:18750:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788639271.710607:0:18750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000332faad8/0x25c454990262d722 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.710649:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=530s v=(0 0) 00010000:00010000:3.0:1788639271.710659:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639271.710664:0:18750:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000332faad8/0x25c454990262d722 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.710674:0:18750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000332faad8/0x25c454990262d722 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.710682:0:18750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000332faad8/0x25c454990262d722 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.710689:0:18750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000332faad8/0x25c454990262d722 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.710705:0:18750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788639271.710997:0:18396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639271.711003:0:18396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000332faad8/0x25c454990262d722 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.711010:0:18396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9e400 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639271.711013:0:18396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000332faad8/0x25c454990262d722 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.711021:0:18396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000332faad8/0x25c454990262d722 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.711040:0:18396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000332faad8/0x25c454990262d722 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.711047:0:18396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000332faad8/0x25c454990262d722 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.711062:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639271.711064:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639271.711065:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788639271.711766:0:18750:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788639271.711774:0:18750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000373deb2d/0x25c454990262d729 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.711784:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=530s v=(0 0) 00010000:00010000:3.0:1788639271.711788:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639271.711793:0:18750:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000373deb2d/0x25c454990262d729 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.711803:0:18750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000373deb2d/0x25c454990262d729 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.711812:0:18750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000373deb2d/0x25c454990262d729 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.711826:0:18750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000373deb2d/0x25c454990262d729 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.711847:0:18750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788639271.712066:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639271.712072:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000373deb2d/0x25c454990262d729 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.712079:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9ee00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639271.712083:0:17229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000373deb2d/0x25c454990262d729 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.712092:0:17229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000373deb2d/0x25c454990262d729 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.712104:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000373deb2d/0x25c454990262d729 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.712111:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000373deb2d/0x25c454990262d729 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.712149:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639271.712151:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639271.712152:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788639271.712341:0:18750:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788639271.712347:0:18750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c76a2053/0x25c454990262d730 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.712355:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=530s v=(0 0) 00010000:00010000:3.0:1788639271.712358:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639271.712362:0:18750:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c76a2053/0x25c454990262d730 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.712371:0:18750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c76a2053/0x25c454990262d730 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.712378:0:18750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c76a2053/0x25c454990262d730 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.712384:0:18750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c76a2053/0x25c454990262d730 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.712402:0:18750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788639271.712645:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639271.712651:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c76a2053/0x25c454990262d730 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.712657:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9fc00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639271.712660:0:17230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c76a2053/0x25c454990262d730 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.712667:0:17230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c76a2053/0x25c454990262d730 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.712676:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c76a2053/0x25c454990262d730 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.712682:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c76a2053/0x25c454990262d730 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.712696:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639271.712698:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639271.712700:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788639271.712826:0:18750:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788639271.712832:0:18750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085189fa5/0x25c454990262d737 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.712846:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=530s v=(0 0) 00010000:00010000:3.0:1788639271.712849:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639271.712853:0:18750:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085189fa5/0x25c454990262d737 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.712863:0:18750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085189fa5/0x25c454990262d737 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.712871:0:18750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085189fa5/0x25c454990262d737 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.712878:0:18750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085189fa5/0x25c454990262d737 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.712890:0:18750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788639271.715775:0:18750:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788639271.715788:0:18750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d356b787/0x25c454990262d73e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.715804:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=530s v=(0 0) 00010000:00010000:3.0:1788639271.715809:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639271.715815:0:18750:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d356b787/0x25c454990262d73e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.715829:0:18750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d356b787/0x25c454990262d73e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.715857:0:18750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d356b787/0x25c454990262d73e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.715866:0:18750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d356b787/0x25c454990262d73e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.715881:0:18750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788639271.716265:0:18396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788639271.716273:0:18396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085189fa5/0x25c454990262d737 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.716293:0:18396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9ec00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639271.716298:0:18396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085189fa5/0x25c454990262d737 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.716308:0:18396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085189fa5/0x25c454990262d737 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.716324:0:18396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085189fa5/0x25c454990262d737 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.716332:0:18396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085189fa5/0x25c454990262d737 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.716351:0:18396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639271.716355:0:18396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d356b787/0x25c454990262d73e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.716361:0:18396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9f200 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639271.716364:0:18396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d356b787/0x25c454990262d73e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.716371:0:18396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d356b787/0x25c454990262d73e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.716381:0:18396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d356b787/0x25c454990262d73e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.716394:0:18396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d356b787/0x25c454990262d73e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.716408:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639271.716410:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639271.716412:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639271.716418:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788639271.716503:0:18750:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788639271.716509:0:18750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054afb837/0x25c454990262d745 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.716518:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=530s v=(0 0) 00010000:00010000:3.0:1788639271.716522:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639271.716526:0:18750:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054afb837/0x25c454990262d745 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.716536:0:18750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054afb837/0x25c454990262d745 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.716544:0:18750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054afb837/0x25c454990262d745 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.716551:0:18750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054afb837/0x25c454990262d745 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.716581:0:18750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788639271.716882:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639271.716887:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054afb837/0x25c454990262d745 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.716894:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9e800 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639271.716897:0:17230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054afb837/0x25c454990262d745 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.716905:0:17230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054afb837/0x25c454990262d745 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.716916:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054afb837/0x25c454990262d745 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.716923:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054afb837/0x25c454990262d745 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.716937:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639271.716938:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639271.716946:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788639271.717021:0:18750:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788639271.717027:0:18750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3c24af7/0x25c454990262d74c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.717035:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=530s v=(0 0) 00010000:00010000:3.0:1788639271.717038:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639271.717042:0:18750:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3c24af7/0x25c454990262d74c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.717051:0:18750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3c24af7/0x25c454990262d74c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.717059:0:18750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3c24af7/0x25c454990262d74c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.717067:0:18750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3c24af7/0x25c454990262d74c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.717088:0:18750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788639271.717327:0:18396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639271.717333:0:18396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3c24af7/0x25c454990262d74c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.717341:0:18396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9ea00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639271.717344:0:18396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3c24af7/0x25c454990262d74c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.717351:0:18396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3c24af7/0x25c454990262d74c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.717362:0:18396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3c24af7/0x25c454990262d74c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.717370:0:18396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3c24af7/0x25c454990262d74c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.717384:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639271.717385:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639271.717387:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788639271.717582:0:18750:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788639271.717588:0:18750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f35e999/0x25c454990262d753 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.717597:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=530s v=(0 0) 00010000:00010000:3.0:1788639271.717605:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639271.717610:0:18750:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f35e999/0x25c454990262d753 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.717659:0:18750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f35e999/0x25c454990262d753 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.717667:0:18750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f35e999/0x25c454990262d753 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.717674:0:18750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f35e999/0x25c454990262d753 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.717688:0:18750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788639271.717961:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639271.717967:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f35e999/0x25c454990262d753 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.717975:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9f400 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639271.717978:0:17229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f35e999/0x25c454990262d753 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.717997:0:17229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f35e999/0x25c454990262d753 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.718009:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f35e999/0x25c454990262d753 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.718017:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f35e999/0x25c454990262d753 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.718033:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639271.718035:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639271.718036:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788639271.718373:0:18750:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788639271.718380:0:18750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1a2a0c3/0x25c454990262d75a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.718390:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=530s v=(0 0) 00010000:00010000:3.0:1788639271.718393:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788639271.718397:0:18750:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1a2a0c3/0x25c454990262d75a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.718407:0:18750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1a2a0c3/0x25c454990262d75a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.718415:0:18750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1a2a0c3/0x25c454990262d75a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.718428:0:18750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b1a2a0c3/0x25c454990262d75a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639271.718449:0:18750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1788639271.718489:0:18750:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:3.0:1788639271.718587:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17267:x1875523773072256:12345-0@lo:5:osp-pre-1-0.0 Request processed in 96753us (98158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639271.718596:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788639271.718723:0:17267:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b14380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17267:1875523773072256:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788639271.718739:0:17267:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:1.0:1788639271.718778:0:17267:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243314380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17267:1875523773072768:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788639271.718811:0:17267:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639271.718841:0:17267:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3801eca80 going to sleep for 11 seconds 00010000:00010000:0.0:1788639271.718892:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639271.718898:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b1a2a0c3/0x25c454990262d75a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.718906:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9e200 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639271.718909:0:17230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1a2a0c3/0x25c454990262d75a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.718917:0:17230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1a2a0c3/0x25c454990262d75a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.718929:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b1a2a0c3/0x25c454990262d75a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.718948:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1a2a0c3/0x25c454990262d75a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639271.718963:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639271.718965:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639271.718966:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639271.721329:0:19077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773072768 00000100:00100000:3.0:1788639271.721342:0:19077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773072768 00000100:00100000:3.0:1788639271.721404:0:19077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788639271.721413:0:19077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243950000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17267:x1875523773072768:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788639271.721452:0:19077:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:0.0:1788639271.724153:0:19077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243950000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17267:x1875523773072768:12345-0@lo:5:osp-pre-1-0.0 Request processed in 2735us (5335us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788639271.724164:0:19077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788639271.724289:0:17267:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243314380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17267:1875523773072768:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788639271.724306:0:17267:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:1.0:1788639272.252436:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639272.630691:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243951f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773072896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788639272.630759:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639272.630844:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773072896 00000100:00100000:1.0:1788639272.630851:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773072896 00000100:00100000:1.0:1788639272.630901:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788639272.630910:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773072896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788639272.630946:0:18751:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788639272.630990:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773072896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639272.630998:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788639272.631041:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243951f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773072896:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1788639272.839954:0:19918:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg618-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788639273.269239:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788639273.810355:0:19971:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788639273.810606:0:19971:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788639274.292714:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639274.682729:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788639274.682749:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773073024:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788639274.682810:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639274.682857:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773073024 00000100:00100000:0.0:1788639274.682863:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773073024 00000100:00100000:0.0:1788639274.682914:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788639274.682924:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773073024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788639274.682969:0:18751:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788639274.683011:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773073024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639274.683018:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1788639274.683046:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788639274.686486:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773073024:0@lo:13:osp-pre-0-1.0 00000020:00000004:2.0:1788639274.692863:0:20021:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788639274.694297:0:20021:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788639275.036803:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639275.036896:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754116608 00000100:00100000:2.0:1788639275.036914:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754116608 00000100:00100000:2.0:1788639275.036956:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 113 00000100:00100000:2.0:1788639275.036963:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2404:x1875523754116608:12345-192.168.206.18@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788639275.036987:0:17235:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3@192.168.206.18@tcp t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:2.0:1788639275.037011:0:17235:0:(genops.c:1385:class_connect()) connect: client 275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3, cookie 0x25c454990262d761 00000100:00080000:2.0:1788639275.037150:0:17235:0:(import.c:65:import_set_state_nolock()) ffff9ae36d08c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788639275.037224:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+5:2404:x1875523754116608:12345-192.168.206.18@tcp:250:mount.lustre.0 Request processed in 259us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639275.037232:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 113 00000100:00100000:0.0:1788639275.039254:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639275.039555:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754116736 00000100:00100000:1.0:1788639275.039564:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754116736 00000100:00100000:1.0:1788639275.039672:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 114 00000100:00100000:1.0:1788639275.039684:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+5:14932:x1875523754116736:12345-192.168.206.18@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788639275.039699:0:17236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639275.039715:0:17236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae3750fbe00/0x25c454990262d768 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e8586e expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639275.039741:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae3750fbe00/0x25c454990262d768 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8586e expref: 6 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639275.039751:0:17236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae3750fbe00/0x25c454990262d768 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8586e expref: 6 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639275.039760:0:17236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fbe00, rc 0) 00000100:00100000:1.0:1788639275.039821:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+6:14932:x1875523754116736:12345-192.168.206.18@tcp:101:mount.lustre.0 Request processed in 140us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639275.039828:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 114 00000100:00100000:1.0:1788639275.054499:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639275.054600:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754116864 00000100:00100000:2.0:1788639275.054664:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754116864 00000100:00100000:2.0:1788639275.054720:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 115 00000100:00100000:2.0:1788639275.054730:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+6:14932:x1875523754116864:12345-192.168.206.18@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788639275.054850:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+6:14932:x1875523754116864:12345-192.168.206.18@tcp:501:mount.lustre.0 Request processed in 121us (359us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788639275.054858:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 115 00000100:00100000:3.0:1788639275.063555:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639275.063857:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754116992 00000100:00100000:0.0:1788639275.063871:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754116992 00000100:00100000:0.0:1788639275.063966:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 116 00000100:00100000:0.0:1788639275.063978:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f722450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+6:14932:x1875523754116992:12345-192.168.206.18@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788639275.064003:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639275.064032:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae375ef5400/0x25c454990262d76f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85875 expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639275.064067:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae375ef5400/0x25c454990262d76f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85875 expref: 7 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639275.064080:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae375ef5400/0x25c454990262d76f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85875 expref: 7 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639275.064090:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375ef5400, rc 0) 00000100:00100000:0.0:1788639275.064243:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f722450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+7:14932:x1875523754116992:12345-192.168.206.18@tcp:101:mount.lustre.0 Request processed in 265us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639275.064251:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 116 00000100:00100000:0.0:1788639275.068987:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639275.069104:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754117120 00000100:00100000:1.0:1788639275.069199:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754117120 00000100:00100000:1.0:1788639275.069311:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 117 00000100:00100000:1.0:1788639275.069324:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f721c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+7:14932:x1875523754117120:12345-192.168.206.18@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788639275.069547:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f721c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+8:14932:x1875523754117120:12345-192.168.206.18@tcp:501:mount.lustre.0 Request processed in 224us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639275.069556:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 117 00000100:00100000:3.0:1788639275.074268:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639275.077426:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754117248 00000100:00100000:0.0:1788639275.077449:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754117248 00000100:00100000:0.0:1788639275.077592:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 118 00000100:00100000:0.0:1788639275.077603:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f720c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+8:14932:x1875523754117248:12345-192.168.206.18@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788639275.077890:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f720c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+8:14932:x1875523754117248:12345-192.168.206.18@tcp:503:mount.lustre.0 Request processed in 289us (3636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639275.077899:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 118 00000100:00100000:0.0:1788639275.082550:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639275.082849:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754117376 00000100:00100000:2.0:1788639275.082864:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754117376 00000100:00100000:2.0:1788639275.082939:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 119 00000100:00100000:2.0:1788639275.082952:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f722850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+8:14951:x1875523754117376:12345-192.168.206.18@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788639275.083178:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f722850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+8:14951:x1875523754117376:12345-192.168.206.18@tcp:502:llog_process_th.0 Request processed in 227us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639275.083198:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 119 00000100:00100000:3.0:1788639275.139306:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639275.139488:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754117504 00000100:00100000:2.0:1788639275.139503:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754117504 00000100:00100000:2.0:1788639275.139585:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 120 00000100:00100000:2.0:1788639275.139596:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f720850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+8:14951:x1875523754117504:12345-192.168.206.18@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788639275.139851:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f720850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+8:14951:x1875523754117504:12345-192.168.206.18@tcp:502:llog_process_th.0 Request processed in 256us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639275.139860:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 120 00000100:00100000:2.0:1788639275.149037:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639275.150358:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754117632 00000100:00100000:1.0:1788639275.150376:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754117632 00000100:00100000:1.0:1788639275.150478:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 121 00000100:00100000:1.0:1788639275.150492:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f723850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+8:14951:x1875523754117632:12345-192.168.206.18@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788639275.150944:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f723850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+8:14951:x1875523754117632:12345-192.168.206.18@tcp:502:llog_process_th.0 Request processed in 454us (1919us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639275.150953:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 121 00000100:00100000:3.0:1788639275.165926:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639275.166242:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754117760 00000100:00100000:0.0:1788639275.166257:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754117760 00000100:00100000:0.0:1788639275.166353:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 122 00000100:00100000:0.0:1788639275.166365:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f723c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+8:14932:x1875523754117760:12345-192.168.206.18@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788639275.166386:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639275.166409:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae375ef4c00/0x25c454990262d776 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e858a6 expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639275.166444:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae375ef4c00/0x25c454990262d776 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e858a6 expref: 9 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639275.166456:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae375ef4c00/0x25c454990262d776 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e858a6 expref: 9 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639275.166466:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375ef4c00, rc 0) 00000100:00100000:0.0:1788639275.166542:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f723c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+9:14932:x1875523754117760:12345-192.168.206.18@tcp:101:mount.lustre.0 Request processed in 179us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639275.166550:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 122 00000100:00100000:3.0:1788639275.171729:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639275.172067:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754117888 00000100:00100000:2.0:1788639275.172077:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754117888 00000100:00100000:2.0:1788639275.172174:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 123 00000100:00100000:2.0:1788639275.172186:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f723050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+9:14932:x1875523754117888:12345-192.168.206.18@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788639275.172212:0:17235:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788639275.172234:0:17235:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788639275.172238:0:17235:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788639275.172241:0:17235:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788639275.172245:0:17235:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788639275.172247:0:17235:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1788639275.174806:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f723050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+9:14932:x1875523754117888:12345-192.168.206.18@tcp:256:mount.lustre.0 Request processed in 2606us (3187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639275.174820:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 123 00000100:00100000:3.0:1788639275.178527:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639275.178910:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754118016 00000100:00100000:1.0:1788639275.178919:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754118016 00000100:00100000:1.0:1788639275.179014:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 124 00000100:00100000:1.0:1788639275.179024:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f720450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+9:14932:x1875523754118016:12345-192.168.206.18@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788639275.179039:0:17236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639275.179056:0:17236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae3750fb400/0x25c454990262d77d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e858ad expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639275.179081:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae3750fb400/0x25c454990262d77d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e858ad expref: 10 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639275.179091:0:17236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae3750fb400/0x25c454990262d77d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e858ad expref: 10 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639275.179124:0:17236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fb400, rc 0) 00000100:00100000:1.0:1788639275.179172:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f720450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+10:14932:x1875523754118016:12345-192.168.206.18@tcp:101:mount.lustre.0 Request processed in 149us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639275.179178:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 124 00000100:00100000:3.0:1788639275.182805:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639275.183087:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754118144 00000100:00100000:0.0:1788639275.183097:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754118144 00000100:00100000:0.0:1788639275.183166:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 125 00000100:00100000:0.0:1788639275.183177:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f722050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+10:14932:x1875523754118144:12345-192.168.206.18@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788639275.183327:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f722050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+10:14932:x1875523754118144:12345-192.168.206.18@tcp:501:mount.lustre.0 Request processed in 151us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639275.183335:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 125 00000100:00100000:1.0:1788639275.185793:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639275.185954:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754118272 00000100:00100000:0.0:1788639275.185973:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754118272 00000100:00100000:0.0:1788639275.186059:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 126 00000100:00100000:0.0:1788639275.186069:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f721850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+10:14932:x1875523754118272:12345-192.168.206.18@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788639275.186212:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f721850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+10:14932:x1875523754118272:12345-192.168.206.18@tcp:503:mount.lustre.0 Request processed in 143us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639275.186221:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 126 00000100:00100000:3.0:1788639275.191776:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639275.191962:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754118400 00000100:00100000:1.0:1788639275.191972:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754118400 00000100:00100000:1.0:1788639275.192027:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 127 00000100:00100000:1.0:1788639275.192037:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f721450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+10:14955:x1875523754118400:12345-192.168.206.18@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788639275.192190:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f721450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+10:14955:x1875523754118400:12345-192.168.206.18@tcp:502:llog_process_th.0 Request processed in 153us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639275.192198:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 127 00000100:00100000:3.0:1788639275.197782:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639275.197783:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788639275.197802:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773073152:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788639275.197862:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639275.197918:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773073152 00000100:00100000:3.0:1788639275.197944:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773073152 00000100:00100000:3.0:1788639275.197995:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788639275.198004:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773073152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788639275.198037:0:17246:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788639275.198055:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754118528 00000100:00100000:0.0:1788639275.198059:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754118528 00000100:00100000:0.0:1788639275.198086:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 128 00000100:00100000:0.0:1788639275.198093:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243174050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+10:14955:x1875523754118528:12345-192.168.206.18@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788639275.198094:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773073152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639275.198101:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788639275.198236:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773073152:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788639275.198426:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243174050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+10:14955:x1875523754118528:12345-192.168.206.18@tcp:502:llog_process_th.0 Request processed in 331us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639275.198434:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 128 00000100:00100000:3.0:1788639275.209281:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639275.209354:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639275.209534:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754118656 00000100:00100000:1.0:1788639275.209543:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754118656 00000100:00100000:1.0:1788639275.209571:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754118912 00000100:00100000:1.0:1788639275.209574:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754118912 00000100:00100000:1.0:1788639275.209599:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 7 00000100:00100000:1.0:1788639275.209606:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2404:x1875523754118656:12345-192.168.206.18@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788639275.209667:0:17242:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 5f164030-9448-43be-b8f2-64db35b5d669@192.168.206.18@tcp t0 exp 0000000000000000 cur 534 last 0 00000020:00000080:1.0:1788639275.209712:0:17242:0:(genops.c:1385:class_connect()) connect: client 5f164030-9448-43be-b8f2-64db35b5d669, cookie 0x25c454990262d784 00000004:00100000:1.0:1788639275.209732:0:17242:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788639275.209917:0:17242:0:(import.c:65:import_set_state_nolock()) ffff9ae369174800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788639275.209974:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f164030-9448-43be-b8f2-64db35b5d669+6:2404:x1875523754118656:12345-192.168.206.18@tcp:38:mount.lustre.0 Request processed in 367us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639275.209997:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 7 00000100:00100000:1.0:1788639275.210014:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 8 00000100:00100000:1.0:1788639275.210019:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2404:x1875523754118912:12345-192.168.206.18@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788639275.210033:0:17242:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 5f164030-9448-43be-b8f2-64db35b5d669@192.168.206.18@tcp t0 exp 0000000000000000 cur 534 last 0 00000020:00000080:1.0:1788639275.210061:0:17242:0:(genops.c:1385:class_connect()) connect: client 5f164030-9448-43be-b8f2-64db35b5d669, cookie 0x25c454990262d78b 00000004:00100000:1.0:1788639275.210071:0:17242:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788639275.210194:0:17242:0:(import.c:65:import_set_state_nolock()) ffff9ae369175000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788639275.210216:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f164030-9448-43be-b8f2-64db35b5d669+6:2404:x1875523754118912:12345-192.168.206.18@tcp:38:mount.lustre.0 Request processed in 195us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639275.210222:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 8 00000100:00100000:3.0:1788639275.212933:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639275.212973:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639275.214943:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639275.215395:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754118784 00000100:00100000:2.0:1788639275.215405:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754118784 00000100:00100000:2.0:1788639275.215470:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754119168 00000100:00100000:2.0:1788639275.215487:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754119168 00000100:00100000:2.0:1788639275.215503:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754119040 00000100:00100000:2.0:1788639275.215506:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754119040 00000100:00100000:2.0:1788639275.215524:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 9 00000100:00100000:2.0:1788639275.215532:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f164030-9448-43be-b8f2-64db35b5d669+7:0:x1875523754118784:12345-192.168.206.18@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788639275.215567:0:17241:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788639275.215685:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f164030-9448-43be-b8f2-64db35b5d669+7:0:x1875523754118784:12345-192.168.206.18@tcp:41:mount.lustre.0 Request processed in 152us (2758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639275.215693:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 9 00000100:00100000:2.0:1788639275.215710:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 10 00000100:00100000:2.0:1788639275.215717:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f164030-9448-43be-b8f2-64db35b5d669+6:14932:x1875523754119168:12345-192.168.206.18@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788639275.215728:0:17241:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788639275.215750:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f164030-9448-43be-b8f2-64db35b5d669+6:14932:x1875523754119168:12345-192.168.206.18@tcp:41:mount.lustre.0 Request processed in 34us (2778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639275.215757:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 10 00000100:00100000:2.0:1788639275.215768:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 11 00000100:00100000:2.0:1788639275.215774:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f164030-9448-43be-b8f2-64db35b5d669+6:0:x1875523754119040:12345-192.168.206.18@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788639275.215790:0:17241:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788639275.215825:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f164030-9448-43be-b8f2-64db35b5d669+6:0:x1875523754119040:12345-192.168.206.18@tcp:41:mount.lustre.0 Request processed in 51us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639275.215831:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 11 00000100:00080000:3.0:1788639275.216075:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788639275.216079:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788639275.223507:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639275.223644:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754119296 00000100:00100000:2.0:1788639275.223654:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754119296 00000100:00100000:2.0:1788639275.223718:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 12 00000100:00100000:2.0:1788639275.223728:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f164030-9448-43be-b8f2-64db35b5d669+6:14932:x1875523754119296:12345-192.168.206.18@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788639275.223937:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f164030-9448-43be-b8f2-64db35b5d669+6:14932:x1875523754119296:12345-192.168.206.18@tcp:40:mount.lustre.0 Request processed in 210us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639275.223946:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 12 00000100:00100000:1.0:1788639275.244709:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639275.244754:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639275.244844:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754119424 00000100:00100000:0.0:1788639275.244854:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754119424 00000100:00100000:0.0:1788639275.244896:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754119552 00000100:00100000:0.0:1788639275.244900:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754119552 00000100:00100000:0.0:1788639275.244928:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 22 00000100:00100000:0.0:1788639275.244945:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243951f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2404:x1875523754119424:12345-192.168.206.18@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788639275.244976:0:18749:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 5f164030-9448-43be-b8f2-64db35b5d669@192.168.206.18@tcp t0 exp 0000000000000000 cur 534 last 0 00000100:00100000:2.0:1788639275.245005:0:19077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 23 00000020:00000080:0.0:1788639275.245006:0:18749:0:(genops.c:1385:class_connect()) connect: client 5f164030-9448-43be-b8f2-64db35b5d669, cookie 0x25c454990262d792 00000100:00100000:2.0:1788639275.245012:0:19077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243953800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2404:x1875523754119552:12345-192.168.206.18@tcp:8:mount.lustre.0 00002000:00100000:0.0:1788639275.245016:0:18749:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5f164030-9448-43be-b8f2-64db35b5d669/ffff9ae242d30000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788639275.245027:0:18749:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00010000:00080000:2.0:1788639275.245029:0:19077:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 5f164030-9448-43be-b8f2-64db35b5d669@192.168.206.18@tcp t0 exp 0000000000000000 cur 534 last 0 00000020:00000080:2.0:1788639275.245044:0:19077:0:(genops.c:1385:class_connect()) connect: client 5f164030-9448-43be-b8f2-64db35b5d669, cookie 0x25c454990262d799 00002000:00100000:2.0:1788639275.245048:0:19077:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5f164030-9448-43be-b8f2-64db35b5d669/ffff9ae36d088800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788639275.245060:0:19077:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788639275.245175:0:19077:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00002000:00080000:0.0:1788639275.245175:0:18749:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788639275.245201:0:19077:0:(import.c:65:import_set_state_nolock()) ffff9ae36d088000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1788639275.245201:0:18749:0:(import.c:65:import_set_state_nolock()) ffff9ae242d36000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788639275.245351:0:19077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243953800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f164030-9448-43be-b8f2-64db35b5d669+6:2404:x1875523754119552:12345-192.168.206.18@tcp:8:mount.lustre.0 Request processed in 336us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639275.245359:0:19077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 23 00000100:00100000:1.0:1788639275.251160:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243951f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f164030-9448-43be-b8f2-64db35b5d669+6:2404:x1875523754119424:12345-192.168.206.18@tcp:8:mount.lustre.0 Request processed in 6204us (6449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639275.251173:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 22 00000100:00100000:3.0:1788639275.251260:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639275.252925:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754119680 00000100:00100000:0.0:1788639275.252938:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754119680 00000100:00100000:0.0:1788639275.253000:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 3 00000100:00100000:0.0:1788639275.253011:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5f164030-9448-43be-b8f2-64db35b5d669+6:14932:x1875523754119680:12345-192.168.206.18@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788639275.253088:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5f164030-9448-43be-b8f2-64db35b5d669+6:14932:x1875523754119680:12345-192.168.206.18@tcp:900:mount.lustre.0 Request processed in 79us (1833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639275.253096:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 3 00000100:00100000:3.0:1788639275.264180:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639275.264291:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754119808 00000100:00100000:0.0:1788639275.264301:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754119808 00000100:00100000:0.0:1788639275.264358:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 0 00000100:00100000:0.0:1788639275.264368:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f164030-9448-43be-b8f2-64db35b5d669+6:14932:x1875523754119808:12345-192.168.206.18@tcp:33:mount.lustre.0 00000004:00080000:0.0:1788639275.266026:0:17243:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1565us 00000004:00200000:0.0:1788639275.300707:0:17243:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788639275.300829:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f164030-9448-43be-b8f2-64db35b5d669+6:14932:x1875523754119808:12345-192.168.206.18@tcp:33:mount.lustre.0 Request processed in 36457us (36653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639275.300840:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 0 00010000:00010000:1.0:1788639275.316853:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639275.552560:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639275.552655:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754119936 00000100:00100000:1.0:1788639275.552665:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754119936 00000100:00100000:1.0:1788639275.552732:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 13 00000100:00100000:1.0:1788639275.552743:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f164030-9448-43be-b8f2-64db35b5d669+6:14979:x1875523754119936:12345-192.168.206.18@tcp:101:mkdir.0 00010000:00010000:1.0:1788639275.552761:0:18565:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639275.552784:0:18565:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262d7a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e858de expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639275.552850:0:18565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262d7a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639275.552877:0:18565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262d7a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639275.552892:0:18565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262d7a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788639275.552943:0:18565:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788639275.552946:0:18565:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788639275.552998:0:18565:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262d7a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639275.553025:0:18565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fa600/0x25c454990262d7a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e858de expref: 8 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639275.553043:0:18565:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262d7a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e858de expref: 7 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639275.553050:0:18565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae35294cb00) 00010000:00010000:1.0:1788639275.553053:0:18565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788639275.553056:0:18565:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fb600, rc 0) 00000100:00100000:1.0:1788639275.553162:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f164030-9448-43be-b8f2-64db35b5d669+7:14979:x1875523754119936:12345-192.168.206.18@tcp:101:mkdir.0 Request processed in 421us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639275.553169:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 13 00000100:00100000:1.0:1788639275.701885:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788639275.701908:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3505d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773073280:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788639275.701993:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639275.702190:0:17981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773073280 00000100:00100000:3.0:1788639275.702197:0:17981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773073280 00000100:00100000:3.0:1788639275.702261:0:17981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788639275.702272:0:17981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243952d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773073280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788639275.702297:0:17981:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788639275.702354:0:17981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243952d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773073280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639275.702362:0:17981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788639275.702564:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3505d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773073280:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788639276.340863:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639276.725049:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243950e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523773073408:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788639276.725116:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639276.725188:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788639276.725208:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243951180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773073536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788639276.725257:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639276.725518:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773073408 00000100:00100000:0.0:1788639276.725526:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773073408 00000100:00100000:0.0:1788639276.725570:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773073536 00000100:00100000:0.0:1788639276.725573:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773073536 00000100:00100000:0.0:1788639276.725591:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788639276.725599:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523773073408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788639276.725652:0:18751:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788639276.725694:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523773073408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639276.725702:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788639276.725733:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788639276.725743:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243952a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875523773073536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788639276.725758:0:18751:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788639276.725793:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243952a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875523773073536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639276.725799:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788639276.725816:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773073792:0@lo:400:kworker.0 00000100:00100000:0.0:1788639276.725973:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639276.726003:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523773074048:0@lo:400:kworker.0 00000100:00100000:0.0:1788639276.726006:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773074304:0@lo:400:kworker.0 00000100:00100000:0.0:1788639276.726041:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639276.726059:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875523773074816:0@lo:400:kworker.0 00000100:00100000:0.0:1788639276.726085:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639276.726104:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788639276.726109:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773073920:0@lo:400:kworker.0 00000100:00100000:0.0:1788639276.726128:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639276.726146:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875523773074432:0@lo:400:kworker.0 00000100:00100000:0.0:1788639276.726169:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639276.726186:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875523773074944:0@lo:400:kworker.0 00000100:00080000:3.0:1788639276.726205:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788639276.726213:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639276.726218:0:17246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773073792 00000100:00100000:3.0:1788639276.726223:0:17246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773073792 00000100:00100000:3.0:1788639276.726250:0:17246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788639276.726256:0:17246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773073792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639276.726291:0:17246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773073792:12345-0@lo:400:kworker.0 Request processed in 35us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639276.726297:0:17246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788639276.726351:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243950e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523773073408:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788639276.726390:0:19077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773074304 00000100:00100000:3.0:1788639276.726393:0:19077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773074304 00000100:00100000:3.0:1788639276.726417:0:19077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773073920 00000100:00100000:3.0:1788639276.726420:0:19077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773073920 00000100:00100000:3.0:1788639276.726434:0:19077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788639276.726439:0:19077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773074304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639276.726466:0:19077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773074304:12345-0@lo:400:kworker.0 Request processed in 27us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639276.726472:0:19077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788639276.726480:0:19077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788639276.726485:0:19077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773073920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639276.726517:0:19077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773073920:12345-0@lo:400:kworker.0 Request processed in 32us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639276.726523:0:19077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1788639276.726534:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788639276.726642:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773074816 00000100:00100000:2.0:1788639276.726646:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773074816 00000100:00100000:2.0:1788639276.726671:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773074432 00000100:00100000:2.0:1788639276.726674:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773074432 00000100:00100000:2.0:1788639276.726688:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788639276.726693:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875523773074816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639276.726722:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875523773074816:12345-0@lo:400:kworker.0 Request processed in 28us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639276.726734:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788639276.726750:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788639276.726755:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875523773074432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639276.726782:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875523773074432:12345-0@lo:400:kworker.0 Request processed in 27us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639276.726787:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788639276.727112:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773073792:0@lo:400:kworker.0 00000100:00100000:0.0:1788639276.727123:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773074304:0@lo:400:kworker.0 00000100:00100000:0.0:1788639276.727133:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875523773074816:0@lo:400:kworker.0 00000100:00100000:0.0:1788639276.727154:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773073920:0@lo:400:kworker.0 00000100:00100000:0.0:1788639276.727176:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875523773074432:0@lo:400:kworker.0 00000100:00100000:1.0:1788639276.727190:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773074944 00000100:00100000:1.0:1788639276.727196:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773074944 00000100:00100000:1.0:1788639276.727231:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788639276.727239:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875523773074944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639276.727273:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875523773074944:12345-0@lo:400:kworker.0 Request processed in 35us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639276.727278:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788639276.727320:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4d225031-35be-4b74-b245-637fda218215:3644:1875523773073664:0@lo:400:kworker.0 00000100:00100000:3.0:1788639276.727353:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639276.727665:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639276.727693:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875523773074560:0@lo:400:kworker.0 00000100:00100000:2.0:1788639276.727718:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639276.727749:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773074048 00000100:00100000:2.0:1788639276.727753:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773074048 00000100:00100000:2.0:1788639276.727839:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773074560 00000100:00100000:2.0:1788639276.727843:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773074560 00000100:00100000:2.0:1788639276.727864:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788639276.727870:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523773074048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639276.727907:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523773074048:12345-0@lo:400:kworker.0 Request processed in 37us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639276.727913:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788639276.727924:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788639276.727931:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875523773074560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639276.727958:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875523773074560:12345-0@lo:400:kworker.0 Request processed in 28us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639276.727963:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788639276.728026:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773074176:0@lo:400:kworker.0 00000100:00100000:2.0:1788639276.728059:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523773074048:0@lo:400:kworker.0 00000100:00100000:3.0:1788639276.728073:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639276.728081:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875523773074560:0@lo:400:kworker.0 00000100:00100000:3.0:1788639276.728100:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875523773074688:0@lo:400:kworker.0 00000100:00080000:2.0:1788639276.728129:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788639276.728136:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639276.728172:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243951180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773073536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788639276.728196:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773074688 00000100:00100000:3.0:1788639276.728200:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773074688 00000100:00100000:3.0:1788639276.728225:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788639276.728231:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875523773074688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639276.728264:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875523773074688:12345-0@lo:400:kworker.0 Request processed in 33us (127us total) trans 0 rc 0/0 00000100:00080000:2.0:1788639276.728268:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788639276.728273:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788639276.728303:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773074176 00010000:00080000:3.0:1788639276.728306:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f3b100 x1875523773074688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639276.728309:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773074176 00000100:00100000:3.0:1788639276.728321:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875523773074688:0@lo:400:kworker.0 00000100:00100000:2.0:1788639276.728347:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788639276.728354:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773074176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639276.728531:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875523773074176:12345-0@lo:400:kworker.0 Request processed in 176us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639276.728538:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788639276.729021:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875523773074176:0@lo:400:kworker.0 00000100:00100000:1.0:1788639276.729140:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773073664 00000100:00100000:1.0:1788639276.729146:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773073664 00000100:00100000:1.0:1788639276.729293:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788639276.729302:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243176850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+24:3644:x1875523773073664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639276.729397:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243176850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+24:3644:x1875523773073664:12345-0@lo:400:kworker.0 Request processed in 97us (2043us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639276.729404:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788639276.729465:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4d225031-35be-4b74-b245-637fda218215:3644:1875523773073664:0@lo:400:kworker.0 00010000:00080000:0.0:1788639276.730156:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f38000 x1875523773074944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639276.730169:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875523773074944:0@lo:400:kworker.0 00000001:00100000:2.0:1788639277.241667:0:19562:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5f164030-9448-43be-b8f2-64db35b5d669 00000001:00080000:2.0:1788639277.241684:0:19562:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00010000:00010000:0.0:1788639277.364755:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639277.472542:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639277.472648:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754120064 00000100:00100000:0.0:1788639277.472659:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754120064 00000100:00100000:0.0:1788639277.472734:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 14 00000100:00100000:0.0:1788639277.472745:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f164030-9448-43be-b8f2-64db35b5d669+7:15031:x1875523754120064:12345-192.168.206.18@tcp:41:lfs.0 00000004:00000024:0.0:1788639277.472781:0:17241:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788639277.472890:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f164030-9448-43be-b8f2-64db35b5d669+7:15031:x1875523754120064:12345-192.168.206.18@tcp:41:lfs.0 Request processed in 147us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639277.472898:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 14 00000100:00080000:2.0:1788639277.473432:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788639277.476665:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639277.476760:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754120192 00000100:00100000:3.0:1788639277.476769:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754120192 00000100:00100000:3.0:1788639277.476840:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 15 00000100:00100000:3.0:1788639277.476852:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f164030-9448-43be-b8f2-64db35b5d669+6:15031:x1875523754120192:12345-192.168.206.18@tcp:41:lfs.0 00000004:00000024:3.0:1788639277.476889:0:17240:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788639277.476977:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f164030-9448-43be-b8f2-64db35b5d669+6:15031:x1875523754120192:12345-192.168.206.18@tcp:41:lfs.0 Request processed in 128us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639277.476985:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 15 00000100:00080000:2.0:1788639277.477071:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788639277.483750:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639277.483938:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754120320 00000100:00100000:0.0:1788639277.483951:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754120320 00000100:00100000:0.0:1788639277.484110:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 11 00000100:00100000:0.0:1788639277.484123:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243953480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5f164030-9448-43be-b8f2-64db35b5d669+6:15031:x1875523754120320:12345-192.168.206.18@tcp:13:lfs.0 00002000:00000024:0.0:1788639277.484266:0:18751:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788639277.484388:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243953480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5f164030-9448-43be-b8f2-64db35b5d669+6:15031:x1875523754120320:12345-192.168.206.18@tcp:13:lfs.0 Request processed in 267us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639277.484396:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 11 00000100:00080000:2.0:1788639277.484702:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788639277.488291:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639277.488390:0:18752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754120448 00000100:00100000:3.0:1788639277.488401:0:18752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754120448 00000100:00100000:3.0:1788639277.488477:0:18752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 12 00000100:00100000:3.0:1788639277.488489:0:18752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243951500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5f164030-9448-43be-b8f2-64db35b5d669+5:15031:x1875523754120448:12345-192.168.206.18@tcp:13:lfs.0 00002000:00000024:3.0:1788639277.488533:0:18752:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788639277.488695:0:18752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243951500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5f164030-9448-43be-b8f2-64db35b5d669+5:15031:x1875523754120448:12345-192.168.206.18@tcp:13:lfs.0 Request processed in 208us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639277.488704:0:18752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 12 00000100:00080000:2.0:1788639277.492585:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788639277.735808:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639277.736084:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754120576 00000100:00100000:1.0:1788639277.736099:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754120576 00000100:00100000:1.0:1788639277.736186:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 130 00000100:00100000:1.0:1788639277.736197:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243175c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+10:15064:x1875523754120576:12345-192.168.206.18@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788639277.736220:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639277.736244:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae3750fac00/0x25c454990262d7ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e858e5 expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639277.736284:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae3750fac00/0x25c454990262d7ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e858e5 expref: 11 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639277.736317:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae3750fac00/0x25c454990262d7ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e858e5 expref: 11 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639277.736327:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fac00, rc 0) 00000100:00100000:1.0:1788639277.736408:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243175c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+11:15064:x1875523754120576:12345-192.168.206.18@tcp:101:mount.lustre.0 Request processed in 213us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639277.736417:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 130 00000100:00100000:1.0:1788639277.742376:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639277.742501:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754120704 00000100:00100000:2.0:1788639277.742514:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754120704 00000100:00100000:2.0:1788639277.742584:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 131 00000100:00100000:2.0:1788639277.742606:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243176050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+11:15064:x1875523754120704:12345-192.168.206.18@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788639277.742863:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243176050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+11:15064:x1875523754120704:12345-192.168.206.18@tcp:501:mount.lustre.0 Request processed in 266us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639277.742871:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 131 00000100:00100000:3.0:1788639277.748275:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639277.748566:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754120832 00000100:00100000:2.0:1788639277.748579:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754120832 00000100:00100000:2.0:1788639277.748707:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 132 00000100:00100000:2.0:1788639277.748721:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243176c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+11:15064:x1875523754120832:12345-192.168.206.18@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788639277.749059:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243176c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+11:15064:x1875523754120832:12345-192.168.206.18@tcp:503:mount.lustre.0 Request processed in 340us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639277.749069:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 132 00000100:00100000:0.0:1788639277.749433:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773075072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788639277.757672:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639277.763940:0:18752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773075072 00000100:00100000:3.0:1788639277.763965:0:18752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773075072 00000100:00100000:3.0:1788639277.764049:0:18752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788639277.764062:0:18752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523773075072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788639277.764094:0:18752:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788639277.764223:0:18752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523773075072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 163us (6562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639277.764230:0:18752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788639277.765812:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773075072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788639277.767389:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639277.767786:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754120960 00000100:00100000:1.0:1788639277.767797:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754120960 00000100:00100000:1.0:1788639277.767884:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 133 00000100:00100000:1.0:1788639277.767896:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243177850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+11:15070:x1875523754120960:12345-192.168.206.18@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788639277.768095:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243177850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+11:15070:x1875523754120960:12345-192.168.206.18@tcp:502:llog_process_th.0 Request processed in 200us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639277.768115:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 133 00000100:00100000:1.0:1788639277.790196:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639277.790351:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754121088 00000100:00100000:2.0:1788639277.790365:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754121088 00000100:00100000:2.0:1788639277.790436:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 134 00000100:00100000:2.0:1788639277.790463:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+11:15070:x1875523754121088:12345-192.168.206.18@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788639277.790703:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+11:15070:x1875523754121088:12345-192.168.206.18@tcp:502:llog_process_th.0 Request processed in 242us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639277.790711:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 134 00000100:00100000:3.0:1788639277.805402:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639277.806708:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754121216 00000100:00100000:2.0:1788639277.806725:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754121216 00000100:00100000:2.0:1788639277.806998:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 135 00000100:00100000:2.0:1788639277.807012:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243174850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+11:15070:x1875523754121216:12345-192.168.206.18@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788639277.807241:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243174850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+11:15070:x1875523754121216:12345-192.168.206.18@tcp:502:llog_process_th.0 Request processed in 223us (1843us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639277.807251:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 135 00000100:00100000:3.0:1788639277.817374:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639277.819929:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754121344 00000100:00100000:1.0:1788639277.819955:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754121344 00000100:00100000:1.0:1788639277.820060:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 136 00000100:00100000:1.0:1788639277.820074:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243177c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+11:15064:x1875523754121344:12345-192.168.206.18@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788639277.820221:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639277.820248:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae3750fa600/0x25c454990262d7b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85916 expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639277.820290:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae3750fa600/0x25c454990262d7b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85916 expref: 12 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639277.820325:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae3750fa600/0x25c454990262d7b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85916 expref: 12 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639277.820336:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fa600, rc 0) 00000100:00100000:1.0:1788639277.820425:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243177c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+12:15064:x1875523754121344:12345-192.168.206.18@tcp:101:mount.lustre.0 Request processed in 355us (3065us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639277.820433:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 136 00000100:00100000:1.0:1788639277.826093:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639277.826263:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754121472 00000100:00100000:2.0:1788639277.826278:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754121472 00000100:00100000:2.0:1788639277.826354:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 137 00000100:00100000:2.0:1788639277.826365:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243174450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+12:15064:x1875523754121472:12345-192.168.206.18@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788639277.826401:0:17235:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788639277.826436:0:17235:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788639277.826525:0:17235:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788639277.826530:0:17235:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788639277.826534:0:17235:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788639277.826537:0:17235:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1788639277.830756:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243174450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+12:15064:x1875523754121472:12345-192.168.206.18@tcp:256:mount.lustre.0 Request processed in 4365us (4651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639277.830775:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 137 00000100:00100000:2.0:1788639277.839365:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639277.839717:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754121600 00000100:00100000:0.0:1788639277.839801:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754121600 00000100:00100000:0.0:1788639277.839980:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 138 00000100:00100000:0.0:1788639277.839994:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243177050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+12:15064:x1875523754121600:12345-192.168.206.18@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788639277.840017:0:17236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639277.840043:0:17236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae375ef4200/0x25c454990262d7bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e8591d expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639277.840081:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae375ef4200/0x25c454990262d7bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8591d expref: 13 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639277.840095:0:17236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae375ef4200/0x25c454990262d7bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8591d expref: 13 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639277.840125:0:17236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375ef4200, rc 0) 00000100:00100000:0.0:1788639277.840204:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243177050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+13:15064:x1875523754121600:12345-192.168.206.18@tcp:101:mount.lustre.0 Request processed in 213us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639277.840212:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 138 00000100:00100000:1.0:1788639277.843399:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639277.848646:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754121728 00000100:00100000:2.0:1788639277.848668:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754121728 00000100:00100000:2.0:1788639277.848767:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 139 00000100:00100000:2.0:1788639277.848780:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+13:15064:x1875523754121728:12345-192.168.206.18@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788639277.849235:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+13:15064:x1875523754121728:12345-192.168.206.18@tcp:501:mount.lustre.0 Request processed in 456us (5850us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639277.849245:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 139 00000100:00100000:3.0:1788639277.852069:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639277.852244:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754121856 00000100:00100000:0.0:1788639277.852257:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754121856 00000100:00100000:0.0:1788639277.852327:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 140 00000100:00100000:0.0:1788639277.852337:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+13:15064:x1875523754121856:12345-192.168.206.18@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788639277.853332:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+13:15064:x1875523754121856:12345-192.168.206.18@tcp:503:mount.lustre.0 Request processed in 991us (1273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639277.853344:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 140 00000100:00100000:3.0:1788639277.869128:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639277.871256:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754121984 00000100:00100000:1.0:1788639277.871278:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754121984 00000100:00100000:2.0:1788639277.871474:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 141 00000100:00100000:2.0:1788639277.871487:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+13:15073:x1875523754121984:12345-192.168.206.18@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788639277.871729:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+13:15073:x1875523754121984:12345-192.168.206.18@tcp:502:llog_process_th.0 Request processed in 243us (2620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639277.872353:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 141 00000100:00100000:0.0:1788639277.876833:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639277.877102:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754122112 00000100:00100000:2.0:1788639277.877126:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754122112 00000100:00100000:2.0:1788639277.877204:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 142 00000100:00100000:2.0:1788639277.877217:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+13:15073:x1875523754122112:12345-192.168.206.18@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788639277.877423:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+13:15073:x1875523754122112:12345-192.168.206.18@tcp:502:llog_process_th.0 Request processed in 209us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639277.877441:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 142 00000100:00100000:3.0:1788639277.884889:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639277.884938:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639277.884973:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639277.885162:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639277.889878:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754122240 00000100:00100000:0.0:1788639277.889920:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754122240 00000100:00100000:2.0:1788639277.890024:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754122496 00000100:00100000:2.0:1788639277.890030:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754122496 00000100:00100000:2.0:1788639277.890075:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754122880 00000100:00100000:2.0:1788639277.890078:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754122880 00000100:00100000:2.0:1788639277.890130:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 36 00000100:00100000:2.0:1788639277.890144:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f164030-9448-43be-b8f2-64db35b5d669+7:2406:x1875523754122880:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639277.890253:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f164030-9448-43be-b8f2-64db35b5d669+7:2406:x1875523754122880:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 112us (5279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639277.890261:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 36 00000100:00100000:2.0:1788639277.890285:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 16 00000100:00100000:2.0:1788639277.890290:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2404:x1875523754122240:12345-192.168.206.18@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788639277.890318:0:17242:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 64907637-38d0-4ad4-9e99-06074f162345@192.168.206.18@tcp t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:2.0:1788639277.890359:0:17242:0:(genops.c:1385:class_connect()) connect: client 64907637-38d0-4ad4-9e99-06074f162345, cookie 0x25c454990262d7c3 00000004:00100000:2.0:1788639277.890390:0:17242:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788639277.890511:0:17242:0:(import.c:65:import_set_state_nolock()) ffff9ae36d08d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788639277.890544:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64907637-38d0-4ad4-9e99-06074f162345+6:2404:x1875523754122240:12345-192.168.206.18@tcp:38:mount.lustre.0 Request processed in 253us (5671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639277.890552:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 16 00000100:00100000:2.0:1788639277.890569:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 17 00000100:00100000:2.0:1788639277.890573:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2404:x1875523754122496:12345-192.168.206.18@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788639277.890590:0:17242:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 64907637-38d0-4ad4-9e99-06074f162345@192.168.206.18@tcp t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:2.0:1788639277.890655:0:17242:0:(genops.c:1385:class_connect()) connect: client 64907637-38d0-4ad4-9e99-06074f162345, cookie 0x25c454990262d7ca 00000004:00100000:2.0:1788639277.890670:0:17242:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788639277.892004:0:17242:0:(import.c:65:import_set_state_nolock()) ffff9ae3461e3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788639277.892135:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64907637-38d0-4ad4-9e99-06074f162345+6:2404:x1875523754122496:12345-192.168.206.18@tcp:38:mount.lustre.0 Request processed in 1554us (7191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639277.892146:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 17 00000100:00100000:3.0:1788639277.893993:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639277.894038:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639277.895181:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754123008 00000100:00100000:1.0:1788639277.895200:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754123008 00000100:00100000:1.0:1788639277.895264:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754122368 00000100:00100000:1.0:1788639277.895268:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754122368 00000100:00100000:1.0:1788639277.895311:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754122752 00000100:00100000:1.0:1788639277.895315:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754122752 00000100:00100000:1.0:1788639277.895337:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 37 00000100:00100000:1.0:1788639277.895347:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f164030-9448-43be-b8f2-64db35b5d669+6:2406:x1875523754123008:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:1.0:1788639277.895461:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f164030-9448-43be-b8f2-64db35b5d669+6:2406:x1875523754123008:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 115us (10299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639277.895469:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 37 00000100:00100000:1.0:1788639277.895491:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 18 00000100:00100000:1.0:1788639277.895499:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64907637-38d0-4ad4-9e99-06074f162345+7:0:x1875523754122368:12345-192.168.206.18@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788639277.895522:0:17240:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788639277.895562:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64907637-38d0-4ad4-9e99-06074f162345+7:0:x1875523754122368:12345-192.168.206.18@tcp:41:mount.lustre.0 Request processed in 65us (1581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639277.895931:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 18 00000100:00080000:3.0:1788639277.895980:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788639277.897830:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639277.897856:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 19 00000100:00100000:2.0:1788639277.898027:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64907637-38d0-4ad4-9e99-06074f162345+6:15064:x1875523754122752:12345-192.168.206.18@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788639277.898067:0:18565:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788639277.900965:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64907637-38d0-4ad4-9e99-06074f162345+6:15064:x1875523754122752:12345-192.168.206.18@tcp:41:mount.lustre.0 Request processed in 2932us (6904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639277.900987:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 19 00000100:00100000:2.0:1788639277.901043:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754122624 00000100:00100000:2.0:1788639277.901054:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754122624 00000100:00100000:2.0:1788639277.901128:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 20 00000100:00100000:2.0:1788639277.901139:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64907637-38d0-4ad4-9e99-06074f162345+6:0:x1875523754122624:12345-192.168.206.18@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788639277.901175:0:18565:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00080000:3.0:1788639277.901227:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788639277.901233:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64907637-38d0-4ad4-9e99-06074f162345+6:0:x1875523754122624:12345-192.168.206.18@tcp:41:mount.lustre.0 Request processed in 93us (3414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639277.901242:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 20 00000100:00100000:3.0:1788639277.904007:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639277.904209:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754123136 00000100:00100000:2.0:1788639277.904222:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754123136 00000100:00100000:2.0:1788639277.904345:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 21 00000100:00100000:2.0:1788639277.904358:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64907637-38d0-4ad4-9e99-06074f162345+6:15064:x1875523754123136:12345-192.168.206.18@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788639277.904508:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64907637-38d0-4ad4-9e99-06074f162345+6:15064:x1875523754123136:12345-192.168.206.18@tcp:40:mount.lustre.0 Request processed in 151us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639277.904516:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 21 00000100:00100000:3.0:1788639277.907235:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639277.907984:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754123520 00000100:00100000:0.0:1788639277.907998:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754123520 00000100:00100000:0.0:1788639277.908079:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 4 00000100:00100000:0.0:1788639277.908091:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:64907637-38d0-4ad4-9e99-06074f162345+6:15064:x1875523754123520:12345-192.168.206.18@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788639277.908211:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:64907637-38d0-4ad4-9e99-06074f162345+6:15064:x1875523754123520:12345-192.168.206.18@tcp:900:mount.lustre.0 Request processed in 121us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639277.908218:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 4 00000100:00100000:3.0:1788639277.908571:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639277.908727:0:19077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754123264 00000100:00100000:1.0:1788639277.908840:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639277.909024:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754123392 00000100:00100000:3.0:1788639277.909029:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754123392 00000100:00100000:3.0:1788639277.909067:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 24 00000100:00100000:3.0:1788639277.909075:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243950700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2404:x1875523754123392:12345-192.168.206.18@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788639277.909124:0:18749:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 64907637-38d0-4ad4-9e99-06074f162345@192.168.206.18@tcp t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:3.0:1788639277.909164:0:18749:0:(genops.c:1385:class_connect()) connect: client 64907637-38d0-4ad4-9e99-06074f162345, cookie 0x25c454990262d7d1 00002000:00100000:3.0:1788639277.909181:0:18749:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 64907637-38d0-4ad4-9e99-06074f162345/ffff9ae374820800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788639277.909194:0:18749:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788639277.909318:0:18749:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788639277.909355:0:18749:0:(import.c:65:import_set_state_nolock()) ffff9ae374823800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788639277.909417:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243950700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64907637-38d0-4ad4-9e99-06074f162345+6:2404:x1875523754123392:12345-192.168.206.18@tcp:8:mount.lustre.0 Request processed in 342us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639277.909424:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 24 00000100:00100000:0.0:1788639277.909842:0:19077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754123264 00000100:00100000:0.0:1788639277.910013:0:19077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 25 00000100:00100000:0.0:1788639277.910021:0:19077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2404:x1875523754123264:12345-192.168.206.18@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788639277.910046:0:19077:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 64907637-38d0-4ad4-9e99-06074f162345@192.168.206.18@tcp t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:0.0:1788639277.910072:0:19077:0:(genops.c:1385:class_connect()) connect: client 64907637-38d0-4ad4-9e99-06074f162345, cookie 0x25c454990262d7d8 00002000:00100000:0.0:1788639277.910081:0:19077:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 64907637-38d0-4ad4-9e99-06074f162345/ffff9ae242d33800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788639277.910088:0:19077:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788639277.910158:0:19077:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788639277.910187:0:19077:0:(import.c:65:import_set_state_nolock()) ffff9ae242d30800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788639277.910232:0:19077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64907637-38d0-4ad4-9e99-06074f162345+6:2404:x1875523754123264:12345-192.168.206.18@tcp:8:mount.lustre.0 Request processed in 210us (1661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639277.910240:0:19077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 25 00000100:00100000:1.0:1788639277.915269:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639277.915987:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754123648 00000100:00100000:0.0:1788639277.916001:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754123648 00000100:00100000:0.0:1788639277.916077:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 1 00000100:00100000:0.0:1788639277.916092:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64907637-38d0-4ad4-9e99-06074f162345+6:15064:x1875523754123648:12345-192.168.206.18@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788639277.916206:0:17244:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788639277.916393:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64907637-38d0-4ad4-9e99-06074f162345+6:15064:x1875523754123648:12345-192.168.206.18@tcp:33:mount.lustre.0 Request processed in 303us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639277.916402:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 1 00000100:00100000:3.0:1788639278.087866:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639278.087976:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754123776 00000100:00100000:0.0:1788639278.087992:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754123776 00000100:00100000:0.0:1788639278.088136:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 22 00000100:00100000:0.0:1788639278.088149:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64907637-38d0-4ad4-9e99-06074f162345+6:15096:x1875523754123776:12345-192.168.206.18@tcp:101:mkdir.0 00010000:00010000:0.0:1788639278.088175:0:17241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639278.088206:0:17241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262d7df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e8594e expref: -99 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639278.088290:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5200/0x25c454990262d7e6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639278.088307:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5200/0x25c454990262d7e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639278.088321:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5200/0x25c454990262d7e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788639278.088378:0:17241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788639278.088383:0:17241:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788639278.088411:0:17241:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5200/0x25c454990262d7e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639278.088442:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5e00/0x25c454990262d7df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8594e expref: 8 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639278.088464:0:17241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5200/0x25c454990262d7e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8594e expref: 7 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639278.088497:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae35294cb00) 00010000:00010000:0.0:1788639278.088500:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788639278.088504:0:17241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae375ef5200, rc 0) 00000100:00100000:0.0:1788639278.088600:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64907637-38d0-4ad4-9e99-06074f162345+7:15096:x1875523754123776:12345-192.168.206.18@tcp:101:mkdir.0 Request processed in 445us (2628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639278.088608:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 22 00010000:00010000:1.0:1788639278.389059:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639279.413952:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788639279.797016:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788639279.797038:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773075200:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788639279.797100:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1788639279.798386:0:17279:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788639279.801102:0:18752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773075200 00000100:00100000:1.0:1788639279.801117:0:18752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773075200 00000100:00100000:1.0:1788639279.801187:0:18752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788639279.801199:0:18752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773075200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788639279.801228:0:18752:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788639279.801303:0:18752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773075200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (4202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639279.801310:0:18752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788639279.801368:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773075200:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788639279.801601:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788639280.310188:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788639280.310213:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523773075328:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788639280.310278:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639280.312385:0:17981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773075328 00000100:00100000:2.0:1788639280.312398:0:17981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773075328 00000100:00100000:2.0:1788639280.312464:0:17981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788639280.312475:0:17981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523773075328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788639280.312510:0:17981:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788639280.312600:0:17981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875523773075328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (2320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639280.312610:0:17981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788639280.312653:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875523773075328:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788639280.440986:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788639280.641707:0:20118:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1788639280.821650:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3505d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773075456:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788639280.821746:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639280.821835:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773075456 00000100:00100000:0.0:1788639280.821844:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773075456 00000100:00100000:0.0:1788639280.821897:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788639280.821907:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773075456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788639280.821950:0:17245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788639280.822004:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773075456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639280.822010:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788639280.822063:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3505d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773075456:0@lo:41:osp-pre-1-0.0 00000001:00100000:0.0:1788639281.345739:0:18744:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 64907637-38d0-4ad4-9e99-06074f162345 00000001:00100000:0.0:1788639281.345757:0:18744:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5f164030-9448-43be-b8f2-64db35b5d669 00000001:00100000:2.0:1788639281.349595:0:17973:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 64907637-38d0-4ad4-9e99-06074f162345 00000001:00100000:2.0:1788639281.349612:0:17973:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 5f164030-9448-43be-b8f2-64db35b5d669 00000001:00100000:2.0:1788639281.350910:0:17221:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 64907637-38d0-4ad4-9e99-06074f162345 00000001:00100000:2.0:1788639281.350923:0:17221:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5f164030-9448-43be-b8f2-64db35b5d669 00010000:00010000:1.0:1788639281.461775:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788639281.526282:0:17999:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788639281.844891:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773075584:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788639281.844990:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639281.845453:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773075840:0@lo:400:kworker.0 00000100:00100000:0.0:1788639281.845508:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639281.845546:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243153100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773076352:0@lo:400:kworker.0 00000100:00100000:0.0:1788639281.845572:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639281.845609:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243153800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875523773076864:0@lo:400:kworker.0 00000100:00100000:0.0:1788639281.845662:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639281.845686:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788639281.845691:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773075968:0@lo:400:kworker.0 00000100:00100000:0.0:1788639281.845713:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639281.845730:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243152680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773076480:0@lo:400:kworker.0 00000100:00100000:0.0:1788639281.845749:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639281.845767:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243152a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875523773076992:0@lo:400:kworker.0 00000100:00100000:0.0:1788639281.845807:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639281.845852:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773075840 00000100:00100000:0.0:1788639281.845862:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773075840 00000100:00100000:0.0:1788639281.845929:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773076352 00000100:00100000:0.0:1788639281.845933:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773076352 00000100:00100000:0.0:1788639281.845953:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788639281.845963:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243152300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773075840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639281.846086:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773076096:0@lo:400:kworker.0 00000100:00100000:2.0:1788639281.846119:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639281.846142:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243151180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875523773076608:0@lo:400:kworker.0 00000100:00100000:2.0:1788639281.846164:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639281.846185:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243151c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875523773077120:0@lo:400:kworker.0 00000100:00100000:2.0:1788639281.846210:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639281.846228:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788639281.846234:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4d225031-35be-4b74-b245-637fda218215:3643:1875523773075712:0@lo:400:kworker.0 00000100:00100000:2.0:1788639281.846276:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639281.846307:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243153b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523773076224:0@lo:400:kworker.0 00000100:00100000:2.0:1788639281.846331:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639281.846342:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243151880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875523773076736:0@lo:400:kworker.0 00000100:00100000:2.0:1788639281.846362:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639281.846396:0:18752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773075584 00000100:00100000:2.0:1788639281.846400:0:18752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773075584 00000100:00100000:2.0:1788639281.846443:0:18752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788639281.846451:0:18752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773075584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788639281.846480:0:18752:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788639281.846523:0:18752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773075584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (1532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639281.846530:0:18752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788639281.846559:0:17981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788639281.846567:0:17981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773076352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639281.846647:0:17981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773076352:12345-0@lo:400:kworker.0 Request processed in 80us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639281.846653:0:17981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788639281.846678:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773076864 00000100:00100000:2.0:1788639281.846682:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773076864 00000100:00100000:2.0:1788639281.846704:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773076992 00000100:00100000:2.0:1788639281.846707:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773076992 00000100:00100000:2.0:1788639281.846719:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773076608 00000100:00100000:2.0:1788639281.846721:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773076608 00000100:00100000:2.0:1788639281.846732:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773077120 00000100:00100000:2.0:1788639281.846735:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773077120 00000100:00100000:2.0:1788639281.846748:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773076224 00000100:00100000:2.0:1788639281.846757:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773076224 00000100:00100000:2.0:1788639281.846775:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773076736 00000100:00100000:2.0:1788639281.846777:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773076736 00000100:00100000:2.0:1788639281.846792:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788639281.846797:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875523773076864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639281.846831:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875523773076864:12345-0@lo:400:kworker.0 Request processed in 34us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639281.846839:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788639281.846853:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788639281.846861:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875523773076992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639281.846890:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875523773076992:12345-0@lo:400:kworker.0 Request processed in 31us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639281.846896:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788639281.846910:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788639281.846918:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875523773076608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639281.846948:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875523773076608:12345-0@lo:400:kworker.0 Request processed in 31us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639281.846953:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788639281.846965:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788639281.846973:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875523773077120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639281.847002:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875523773077120:12345-0@lo:400:kworker.0 Request processed in 31us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639281.847009:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788639281.847022:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788639281.847028:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523773076224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639281.847055:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523773076224:12345-0@lo:400:kworker.0 Request processed in 28us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639281.847069:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788639281.847083:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788639281.847089:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875523773076736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639281.847122:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875523773076736:12345-0@lo:400:kworker.0 Request processed in 34us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639281.847127:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788639281.847153:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773075712 00000100:00100000:2.0:1788639281.847157:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773075712 00000100:00100000:2.0:1788639281.847185:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788639281.847191:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+24:3643:x1875523773075712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639281.847220:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+24:3643:x1875523773075712:12345-0@lo:400:kworker.0 Request processed in 30us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639281.847226:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:2.0:1788639281.847255:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788639281.847260:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788639281.847262:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788639281.847308:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243152a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875523773076992:0@lo:400:kworker.0 00000100:00100000:2.0:1788639281.847323:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243153100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773076352:0@lo:400:kworker.0 00010000:00080000:2.0:1788639281.847338:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae243153800 x1875523773076864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639281.847350:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243153800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875523773076864:0@lo:400:kworker.0 00000100:00100000:2.0:1788639281.847393:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4d225031-35be-4b74-b245-637fda218215:3643:1875523773075712:0@lo:400:kworker.0 00000100:00100000:2.0:1788639281.847404:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243153b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523773076224:0@lo:400:kworker.0 00000100:00100000:2.0:1788639281.847426:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243151880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875523773076736:0@lo:400:kworker.0 00000100:00100000:2.0:1788639281.847440:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243151180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875523773076608:0@lo:400:kworker.0 00010000:00080000:2.0:1788639281.847450:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae243151c00 x1875523773077120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639281.847459:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243151c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875523773077120:0@lo:400:kworker.0 00000100:00100000:2.0:1788639281.847480:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773075584:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788639281.849271:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773075968 00000100:00100000:1.0:1788639281.849297:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773075968 00000100:00100000:1.0:1788639281.849376:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773076480 00000100:00100000:1.0:1788639281.849381:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773076480 00000100:00100000:1.0:1788639281.849395:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773076096 00000100:00100000:1.0:1788639281.849398:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773076096 00000100:00100000:1.0:1788639281.849420:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788639281.849429:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243153480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773075968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639281.849539:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243153480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773075968:12345-0@lo:400:kworker.0 Request processed in 109us (3823us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639281.849548:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788639281.849571:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788639281.849598:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243151500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773076480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639281.849659:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243151500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773076480:12345-0@lo:400:kworker.0 Request processed in 64us (3908us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639281.849665:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788639281.849677:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788639281.849684:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523773076096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639281.849714:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523773076096:12345-0@lo:400:kworker.0 Request processed in 31us (3594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639281.849720:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788639281.851125:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243951180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773077248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788639281.851213:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788639281.851268:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788639281.851277:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788639281.851735:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243152300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773075840:12345-0@lo:400:kworker.0 Request processed in 5768us (6221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639281.851748:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788639281.851805:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773077248 00000100:00100000:0.0:1788639281.851813:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773077248 00000100:00100000:3.0:1788639281.851818:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1788639281.851844:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773076096:0@lo:400:kworker.0 00000100:00100000:0.0:1788639281.851857:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788639281.851869:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523773077248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788639281.851911:0:18751:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788639281.851991:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523773077248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639281.851998:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788639281.852259:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243951180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773077248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788639281.872241:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773075968:0@lo:400:kworker.0 00000100:00100000:3.0:1788639281.872268:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243152680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773076480:0@lo:400:kworker.0 00000100:00100000:3.0:1788639281.872353:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773075840:0@lo:400:kworker.0 00010000:00010000:1.0:1788639282.485063:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639282.870825:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788639282.870857:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae3505d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773077376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788639282.870927:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639282.870975:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773077376 00000100:00100000:3.0:1788639282.870983:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773077376 00000100:00100000:3.0:1788639282.871027:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788639282.871037:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773077376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788639282.871064:0:18751:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788639282.871110:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773077376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639282.871117:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788639282.871162:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae3505d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773077376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788639283.177210:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639283.177329:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639283.177416:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639283.177449:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639283.177506:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754124416 00000100:00100000:0.0:1788639283.177516:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754124416 00000100:00100000:0.0:1788639283.177591:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 11 00000100:00100000:0.0:1788639283.177601:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f164030-9448-43be-b8f2-64db35b5d669+5:2406:x1875523754124416:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639283.177695:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f164030-9448-43be-b8f2-64db35b5d669+5:2406:x1875523754124416:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 95us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639283.177702:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 11 00000100:00080000:0.0:1788639283.177874:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788639283.178101:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754123904 00000100:00100000:1.0:1788639283.178107:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754123904 00000100:00100000:1.0:1788639283.178212:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 144 00000100:00100000:1.0:1788639283.178221:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+13:2406:x1875523754123904:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:1.0:1788639283.178260:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+13:2406:x1875523754123904:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 41us (1878us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639283.178266:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 144 00000100:00100000:2.0:1788639283.179834:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754124160 00000100:00100000:2.0:1788639283.179844:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754124160 00000100:00100000:1.0:1788639283.183094:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754124672 00000100:00100000:1.0:1788639283.183109:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754124672 00000100:00100000:1.0:1788639283.183182:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 44 00000100:00100000:1.0:1788639283.183194:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64907637-38d0-4ad4-9e99-06074f162345+5:2406:x1875523754124672:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:1.0:1788639283.185586:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64907637-38d0-4ad4-9e99-06074f162345+5:2406:x1875523754124672:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 2191us (7931us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639283.185601:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 44 00000100:00100000:3.0:1788639283.185686:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639283.185742:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639283.185768:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639283.185784:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639283.186717:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639283.186744:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754124928 00000100:00100000:3.0:1788639283.186753:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754124928 00000100:00100000:3.0:1788639283.186861:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754124288 00000100:00100000:3.0:1788639283.186865:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754124288 00000100:00100000:3.0:1788639283.186887:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754124800 00000100:00100000:3.0:1788639283.186890:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754124800 00000100:00100000:3.0:1788639283.186907:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 12 00000100:00100000:3.0:1788639283.186916:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243314380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64907637-38d0-4ad4-9e99-06074f162345+6:2406:x1875523754124928:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639283.186989:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243314380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64907637-38d0-4ad4-9e99-06074f162345+6:2406:x1875523754124928:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 74us (1303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639283.186996:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 12 00000100:00100000:3.0:1788639283.187010:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 13 00000100:00100000:3.0:1788639283.187017:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae36969f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f164030-9448-43be-b8f2-64db35b5d669+5:2406:x1875523754124288:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639283.187041:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae36969f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f164030-9448-43be-b8f2-64db35b5d669+5:2406:x1875523754124288:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 24us (1272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639283.187046:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 13 00000100:00100000:3.0:1788639283.187145:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 14 00000100:00100000:3.0:1788639283.187153:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae380295f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64907637-38d0-4ad4-9e99-06074f162345+5:2406:x1875523754124800:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639283.187174:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae380295f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64907637-38d0-4ad4-9e99-06074f162345+5:2406:x1875523754124800:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 23us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639283.187180:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 14 00000100:00100000:0.0:1788639283.187507:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754124032 00000100:00100000:0.0:1788639283.187512:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754124032 00000100:00100000:0.0:1788639283.187538:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754124544 00000100:00100000:0.0:1788639283.187541:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754124544 00000100:00100000:0.0:1788639283.187557:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 45 00000100:00100000:0.0:1788639283.187563:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae380296300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f164030-9448-43be-b8f2-64db35b5d669+6:2406:x1875523754124032:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639283.187630:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae380296300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f164030-9448-43be-b8f2-64db35b5d669+6:2406:x1875523754124032:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 51us (1871us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639283.187637:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 45 00000100:00100000:0.0:1788639283.187651:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 46 00000100:00100000:0.0:1788639283.187658:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae380294e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64907637-38d0-4ad4-9e99-06074f162345+6:2406:x1875523754124544:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639283.187682:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae380294e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64907637-38d0-4ad4-9e99-06074f162345+6:2406:x1875523754124544:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 25us (1896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639283.187688:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 46 00000100:00080000:0.0:1788639283.187709:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788639283.187725:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788639283.187727:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788639283.187729:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788639283.187796:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 47 00000100:00100000:0.0:1788639283.187802:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f164030-9448-43be-b8f2-64db35b5d669+5:2406:x1875523754124160:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639283.187829:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f164030-9448-43be-b8f2-64db35b5d669+5:2406:x1875523754124160:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 28us (10500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639283.187835:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 47 00000100:00080000:0.0:1788639283.187859:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788639283.509086:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788639284.125608:0:20266:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe036df4e0 20000000:00000080:2.0:1788639284.125820:0:20266:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ae242298000 uarg=0000000000000000 20000000:01000000:2.0:1788639284.125882:0:20266:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788639284.125890:0:20266:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788639284.125895:0:20266:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788639284.127169:0:20267:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1788639284.128935:0:20266:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788639284.140311:0:20266:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788639284.140364:0:20266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ae37f78a800/0x25c454990262d7ed lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639284.140388:0:20266:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae375ef4a00/0x25c454990262d482 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262d47b expref: 23 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639284.140398:0:20266:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae2421f8800/0x25c454990262d490 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262d489 expref: 23 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639284.140498:0:20266:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae2421f8400/0x25c454990262d4cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262d4c8 expref: 23 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639284.140527:0:20266:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae37f78aa00/0x25c454990262d62d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262d626 expref: 23 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639284.140538:0:20266:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae3750fb400/0x25c454990262d77d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e858ad expref: 12 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639284.140546:0:20266:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ae375ef4200/0x25c454990262d7bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8591d expref: 12 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639284.140554:0:20266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ae37f78a800/0x25c454990262d7ed lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639284.141858:0:20266:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae375ef4200/0x25c454990262d7bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8591d expref: 12 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639284.141881:0:20266:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae375ef4200/0x25c454990262d7bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8591d expref: 12 pid: 17236 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639284.141902:0:20266:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f34000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20266:1875523773077504:192.168.206.18@tcp:104: 00010000:00010000:2.0:1788639284.142094:0:20266:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae3750fb400/0x25c454990262d77d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e858ad expref: 12 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639284.142105:0:20266:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae3750fb400/0x25c454990262d77d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e858ad expref: 12 pid: 17236 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639284.142115:0:20266:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f36a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20266:1875523773077632:192.168.206.18@tcp:104: 00010000:00010000:2.0:1788639284.142149:0:20266:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae37f78aa00/0x25c454990262d62d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262d626 expref: 23 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639284.142179:0:20266:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae37f78aa00/0x25c454990262d62d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262d626 expref: 23 pid: 17236 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639284.142191:0:20266:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f37100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20266:1875523773077760:0@lo:104: 00000100:00100000:2.0:1788639284.142245:0:20266:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788639284.142296:0:20266:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae2421f8400/0x25c454990262d4cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262d4c8 expref: 23 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639284.142305:0:20266:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae2421f8400/0x25c454990262d4cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262d4c8 expref: 23 pid: 17235 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639284.142314:0:20266:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f37800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20266:1875523773077888:0@lo:104: 00000100:00100000:2.0:1788639284.142336:0:20266:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788639284.142369:0:20266:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae2421f8800/0x25c454990262d490 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262d489 expref: 23 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639284.142378:0:20266:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae2421f8800/0x25c454990262d490 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262d489 expref: 23 pid: 17236 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639284.142384:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773077760 00000100:00100000:2.0:1788639284.142387:0:20266:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f37b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20266:1875523773078016:0@lo:104: 00000100:00100000:0.0:1788639284.142395:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773077760 00000100:00100000:0.0:1788639284.142444:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773077888 00000100:00100000:0.0:1788639284.142448:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773077888 00000100:00100000:0.0:1788639284.142464:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788639284.142486:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4d225031-35be-4b74-b245-637fda218215+4:20266:x1875523773077760:12345-0@lo:104: 00010000:00010000:0.0:1788639284.142502:0:17224:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae37f78ac00/0x25c454990262d626 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262d62d expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639284.142575:0:17224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788639284.142582:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4d225031-35be-4b74-b245-637fda218215+4:20266:x1875523773077760:12345-0@lo:104: Request processed in 98us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639284.142589:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788639284.142609:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788639284.142675:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4d225031-35be-4b74-b245-637fda218215+3:20266:x1875523773077888:12345-0@lo:104: 00010000:00010000:0.0:1788639284.142684:0:17224:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4400/0x25c454990262d4c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262d4cf expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639284.142733:0:17224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788639284.142739:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4d225031-35be-4b74-b245-637fda218215+3:20266:x1875523773077888:12345-0@lo:104: Request processed in 124us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639284.142746:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788639284.143003:0:20266:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788639284.143055:0:20266:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ae375ef4a00/0x25c454990262d482 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x25c454990262d47b expref: 23 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639284.143092:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773078016 00000100:00100000:0.0:1788639284.143098:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773078016 00000100:00100000:0.0:1788639284.143126:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1788639284.143136:0:20266:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ae375ef4a00/0x25c454990262d482 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x25c454990262d47b expref: 23 pid: 17235 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639284.143137:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4d225031-35be-4b74-b245-637fda218215+3:20266:x1875523773078016:12345-0@lo:104: 00010000:00010000:0.0:1788639284.143153:0:17224:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae375ef5800/0x25c454990262d489 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262d490 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639284.143157:0:20266:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f34a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20266:1875523773078144:0@lo:104: 00000100:00100000:2.0:1788639284.143205:0:20266:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788639284.143208:0:17224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788639284.143217:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4d225031-35be-4b74-b245-637fda218215+3:20266:x1875523773078016:12345-0@lo:104: Request processed in 83us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639284.143221:0:20266:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3442673c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788639284.143226:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788639284.143242:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773078144 00000100:00100000:0.0:1788639284.143246:0:17224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773078144 00000100:00100000:2.0:1788639284.143254:0:20266:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f37100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20266:1875523773077760:0@lo:104: 00000100:00100000:0.0:1788639284.143266:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788639284.143269:0:20266:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f37800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20266:1875523773077888:0@lo:104: 00000100:00100000:0.0:1788639284.143278:0:17224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4d225031-35be-4b74-b245-637fda218215+3:20266:x1875523773078144:12345-0@lo:104: 00000100:00100000:2.0:1788639284.143282:0:20266:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f37b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20266:1875523773078016:0@lo:104: 00010000:00010000:0.0:1788639284.143289:0:17224:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb000/0x25c454990262d47b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262d482 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639284.143326:0:17224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788639284.143339:0:17224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4d225031-35be-4b74-b245-637fda218215+3:20266:x1875523773078144:12345-0@lo:104: Request processed in 65us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639284.143345:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1788639284.143364:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788639284.143378:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae37f78ac00/0x25c454990262d626 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262d62d expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639284.143385:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78ac00 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:0.0:1788639284.143390:0:17230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae37f78ac00/0x25c454990262d626 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262d62d expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639284.143399:0:17230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae37f78ac00/0x25c454990262d626 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262d62d expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788639284.143408:0:17230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae37f78ac00/0x25c454990262d626 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262d62d expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639284.143414:0:17230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788639284.143453:0:17230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae37f78ac00/0x25c454990262d626 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262d62d expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639284.143460:0:17230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788639284.143487:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae37f78ac00/0x25c454990262d626 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262d62d expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639284.143494:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae37f78ac00/0x25c454990262d626 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262d62d expref: -99 pid: 19561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639284.143516:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788639284.143519:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4400/0x25c454990262d4c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262d4cf expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639284.143525:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef4400 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:0.0:1788639284.143527:0:17230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4400/0x25c454990262d4c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262d4cf expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639284.143546:0:17230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4400/0x25c454990262d4c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262d4cf expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788639284.143553:0:17230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4400/0x25c454990262d4c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262d4cf expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639284.143558:0:17230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788639284.143582:0:17230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4400/0x25c454990262d4c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262d4cf expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639284.143589:0:17230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788639284.143607:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4400/0x25c454990262d4c8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262d4cf expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639284.143647:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae375ef4400/0x25c454990262d4c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262d4cf expref: -99 pid: 18743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639284.143658:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788639284.143665:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae375ef5800/0x25c454990262d489 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262d490 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639284.143672:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae375ef5800 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:0.0:1788639284.143675:0:17230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae375ef5800/0x25c454990262d489 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262d490 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639284.143682:0:17230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae375ef5800/0x25c454990262d489 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262d490 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788639284.143688:0:17230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae375ef5800/0x25c454990262d489 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262d490 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639284.143701:0:17230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788639284.143717:0:17230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae375ef5800/0x25c454990262d489 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262d490 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639284.143723:0:17230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788639284.143730:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae375ef5800/0x25c454990262d489 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262d490 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639284.143737:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae375ef5800/0x25c454990262d489 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262d490 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639284.143746:0:17230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788639284.143750:0:17230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb000/0x25c454990262d47b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x25c454990262d482 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639284.143756:0:17230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fb000 already unused, calling callback (ffffffffc131ec20) 10000000:00010000:0.0:1788639284.143758:0:17230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb000/0x25c454990262d47b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x25c454990262d482 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639284.143765:0:17230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb000/0x25c454990262d47b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x25c454990262d482 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788639284.143771:0:17230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb000/0x25c454990262d47b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x25c454990262d482 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788639284.143776:0:17230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788639284.143789:0:17230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb000/0x25c454990262d47b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262d482 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639284.143795:0:17230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788639284.143809:0:17230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb000/0x25c454990262d47b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262d482 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639284.143815:0:17230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9ae3750fb000/0x25c454990262d47b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x25c454990262d482 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639284.143829:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639284.143831:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788639284.143832:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639284.143858:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4d225031-35be-4b74-b245-637fda218215:3642:1875523773078272:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788639284.143893:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639284.143926:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788639284.143932:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244034e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4d225031-35be-4b74-b245-637fda218215:3642:1875523773078656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788639284.143950:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639284.144310:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4d225031-35be-4b74-b245-637fda218215:3643:1875523773078400:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788639284.144442:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639284.144467:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788639284.144473:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244034000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4d225031-35be-4b74-b245-637fda218215:3643:1875523773078528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788639284.144497:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639284.144526:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773078272 00000100:00100000:0.0:1788639284.144533:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773078272 00010000:00010000:0.0:1788639284.144575:0:17228:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae37f78aa00/0x25c454990262d62d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262d626 expref: 24 pid: 17236 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639284.144599:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773078656 00000100:00100000:0.0:1788639284.144602:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773078656 00000100:00100000:2.0:1788639284.144637:0:20266:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f34a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20266:1875523773078144:0@lo:104: 00010000:00010000:0.0:1788639284.144649:0:17228:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae375ef4a00/0x25c454990262d482 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262d47b expref: 25 pid: 17235 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639284.144665:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773078400 00000100:00100000:0.0:1788639284.144677:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773078400 00010000:00010000:0.0:1788639284.144692:0:17228:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae2421f8400/0x25c454990262d4cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262d4c8 expref: 26 pid: 17235 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639284.144704:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773078528 00000100:00100000:0.0:1788639284.144706:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773078528 00010000:00010000:0.0:1788639284.144717:0:17228:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae2421f8800/0x25c454990262d490 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262d489 expref: 27 pid: 17236 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639284.144732:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788639284.144742:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244034700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d225031-35be-4b74-b245-637fda218215+27:3642:x1875523773078272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788639284.144758:0:17228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788639284.144765:0:17228:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae37f78aa00/0x25c454990262d62d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262d626 expref: 27 pid: 17236 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639284.144777:0:17228:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae37f78aa00/0x25c454990262d62d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262d626 expref: 27 pid: 17236 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639284.144798:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae37f78aa00/0x25c454990262d62d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262d626 expref: 27 pid: 17236 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639284.144820:0:17228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788639284.144869:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244034700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d225031-35be-4b74-b245-637fda218215+26:3642:x1875523773078272:12345-0@lo:103:ldlm_bl.0 Request processed in 129us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639284.144877:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788639284.144892:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788639284.144898:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244037480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d225031-35be-4b74-b245-637fda218215+25:3642:x1875523773078656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788639284.144904:0:17228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788639284.144909:0:17228:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae375ef4a00/0x25c454990262d482 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262d47b expref: 25 pid: 17235 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639284.144926:0:17228:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae375ef4a00/0x25c454990262d482 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262d47b expref: 25 pid: 17235 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639284.144936:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae375ef4a00/0x25c454990262d482 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262d47b expref: 25 pid: 17235 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639284.144944:0:17228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788639284.146267:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244037480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d225031-35be-4b74-b245-637fda218215+24:3642:x1875523773078656:12345-0@lo:103:ldlm_bl.0 Request processed in 1357us (2303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639284.146283:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788639284.146322:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788639284.146336:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244034380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d225031-35be-4b74-b245-637fda218215+23:3643:x1875523773078400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788639284.146352:0:17228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788639284.146362:0:17228:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae2421f8400/0x25c454990262d4cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262d4c8 expref: 23 pid: 17235 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639284.146376:0:17228:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae2421f8400/0x25c454990262d4cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262d4c8 expref: 23 pid: 17235 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639284.146394:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae2421f8400/0x25c454990262d4cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262d4c8 expref: 23 pid: 17235 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639284.146410:0:17228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788639284.146690:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244034380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d225031-35be-4b74-b245-637fda218215+22:3643:x1875523773078400:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (2024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639284.146698:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788639284.146713:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788639284.146721:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244037800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d225031-35be-4b74-b245-637fda218215+21:3643:x1875523773078528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788639284.146751:0:17228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788639284.146756:0:17228:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae2421f8800/0x25c454990262d490 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x25c454990262d489 expref: 21 pid: 17236 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639284.146766:0:17228:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae2421f8800/0x25c454990262d490 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x25c454990262d489 expref: 21 pid: 17236 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639284.146776:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae2421f8800/0x25c454990262d490 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x25c454990262d489 expref: 21 pid: 17236 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639284.146785:0:17228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788639284.146813:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244037800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d225031-35be-4b74-b245-637fda218215+20:3643:x1875523773078528:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (2315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639284.146820:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1788639284.147310:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639284.147319:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639284.147453:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244034000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4d225031-35be-4b74-b245-637fda218215:3643:1875523773078528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788639284.147463:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4d225031-35be-4b74-b245-637fda218215:3643:1875523773078400:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788639284.151396:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244034e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4d225031-35be-4b74-b245-637fda218215:3642:1875523773078656:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788639284.151425:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4d225031-35be-4b74-b245-637fda218215:3642:1875523773078272:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788639284.152799:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639284.152837:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639284.152991:0:20266:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f34000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20266:1875523773077504:192.168.206.18@tcp:104: 00000100:00100000:3.0:1788639284.153028:0:20266:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f36a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20266:1875523773077632:192.168.206.18@tcp:104: 00010000:00010000:3.0:1788639284.153142:0:20266:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ae37f78a800/0x25c454990262d7ed lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639284.153611:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754125056 00000100:00100000:1.0:1788639284.153653:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754125056 00000100:00100000:2.0:1788639284.153688:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754125184 00000100:00100000:2.0:1788639284.153695:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754125184 00010000:00010000:1.0:1788639284.153702:0:17226:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae375ef4200/0x25c454990262d7bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8591d expref: 14 pid: 17236 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639284.153720:0:17227:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ae3750fb400/0x25c454990262d77d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e858ad expref: 14 pid: 17236 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639284.153739:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 13 00000100:00100000:1.0:1788639284.153751:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3820c1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+14:2408:x1875523754125056:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788639284.153768:0:17226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788639284.153776:0:17226:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae375ef4200/0x25c454990262d7bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8591d expref: 14 pid: 17236 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639284.153790:0:17226:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae375ef4200/0x25c454990262d7bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8591d expref: 14 pid: 17236 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639284.153812:0:17226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae375ef4200/0x25c454990262d7bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8591d expref: 14 pid: 17236 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639284.153830:0:17226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788639284.153902:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3820c1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+13:2408:x1875523754125056:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 153us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639284.156478:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 14 00000100:00100000:3.0:1788639284.156720:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+13:2408:x1875523754125184:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788639284.156751:0:17227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639284.156764:0:17227:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ae3750fb400/0x25c454990262d77d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e858ad expref: 13 pid: 17236 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639284.156785:0:17227:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ae3750fb400/0x25c454990262d77d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e858ad expref: 13 pid: 17236 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639284.156809:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae3750fb400/0x25c454990262d77d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e858ad expref: 13 pid: 17236 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639284.156831:0:17227:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ae37f78a800/0x25c454990262d7ed lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639284.156842:0:17227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae37f78a800/0x25c454990262d7ed lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639284.157251:0:17227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae37f78a800/0x25c454990262d7ed lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639284.157262:0:17227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ae37f78a800/0x25c454990262d7ed lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639284.157269:0:17227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ae37f78a800/0x25c454990262d7ed lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639284.157299:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ae37f78a800/0x25c454990262d7ed lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639284.157306:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78a800 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:3.0:1788639284.157311:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ae37f78a800/0x25c454990262d7ed lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639284.157321:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ae37f78a800/0x25c454990262d7ed lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639284.157595:0:20266:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ae37f78a800/0x25c454990262d7ed lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639284.157606:0:20266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ae37f78a800/0x25c454990262d7ed lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639284.158971:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ae37f78a800/0x25c454990262d7ed lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639284.158996:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ae37f78a800/0x25c454990262d7ed lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639284.159035:0:17227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639284.159195:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+12:2408:x1875523754125184:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 2694us (6350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639284.159208:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 14 00000100:00100000:1.0:1788639284.162959:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 13 00000001:00100000:2.0:1788639284.448519:0:19562:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 64907637-38d0-4ad4-9e99-06074f162345 00010000:00010000:0.0:1788639284.532857:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788639284.917240:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788639284.917270:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244034000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773078784:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788639284.917362:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639284.918739:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773078784 00000100:00100000:0.0:1788639284.918755:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773078784 00000100:00100000:0.0:1788639284.918841:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788639284.918853:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244036d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773078784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788639284.918896:0:18751:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788639284.918984:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244036d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773078784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 133us (1622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639284.919003:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788639284.919069:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244034000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773078784:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788639284.919505:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:3.0:1788639285.430714:0:17238:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788639285.430722:0:17238:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae2433ef000 from 13 10000000:01000000:3.0:1788639285.430728:0:17238:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788639285.430782:0:17238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f9f400/0x25c454990262d7f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639285.430794:0:17238:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae242f9f400/0x25c454990262d7f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639285.430806:0:17238:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae242f9f400/0x25c454990262d7f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639285.430843:0:17238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae380295500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773078912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788639285.430886:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773079040:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788639285.430907:0:17238:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639285.430928:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639285.430954:0:17238:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae343acb180 going to sleep for 11 seconds 00000100:00100000:2.0:1788639285.430990:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773078912 00000100:00100000:2.0:1788639285.430998:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773078912 00000100:00100000:2.0:1788639285.431042:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788639285.431050:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+20:17238:x1875523773078912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788639285.431068:0:17236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639285.431082:0:17236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae37f78ac00/0x25c454990262d7fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262d7f4 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639285.431103:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae37f78ac00/0x25c454990262d7fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262d7f4 expref: 21 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639285.431113:0:17236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae37f78ac00/0x25c454990262d7fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262d7f4 expref: 21 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639285.431123:0:17236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78ac00, rc 0) 00000100:00100000:2.0:1788639285.431200:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+21:17238:x1875523773078912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639285.431207:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788639285.431261:0:17981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773079040 00000100:00100000:2.0:1788639285.431264:0:17981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773079040 00000100:00100000:2.0:1788639285.431306:0:17981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788639285.431314:0:17981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244034000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773079040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788639285.431337:0:17981:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788639285.431368:0:17981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244034000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773079040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639285.431374:0:17981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788639285.431771:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773079040:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788639285.431930:0:17238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae380295500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773078912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788639285.431947:0:17238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae242f9f400/0x25c454990262d7f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d7fb expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639285.431957:0:17238:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae242f9f400/0x25c454990262d7f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262d7fb expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639285.432511:0:17238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae380295500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773079168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788639285.432568:0:17238:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639285.432771:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773079168 00000100:00100000:0.0:1788639285.432778:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773079168 00000100:00100000:3.0:1788639285.432788:0:17238:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae343acb180 going to sleep for 11 seconds 00000100:00100000:0.0:1788639285.432824:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788639285.432833:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+21:17238:x1875523773079168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788639285.432955:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+21:17238:x1875523773079168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639285.432963:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788639285.434543:0:17238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae380295500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773079168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788639285.434666:0:17238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae380295500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773079296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788639285.434728:0:17238:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639285.434957:0:17238:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae343acb180 going to sleep for 11 seconds 00000100:00100000:0.0:1788639285.435072:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773079296 00000100:00100000:0.0:1788639285.435079:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773079296 00000100:00100000:0.0:1788639285.435177:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788639285.435188:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+21:17238:x1875523773079296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788639285.435488:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+21:17238:x1875523773079296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 301us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639285.435496:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788639285.435580:0:17238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae380295500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773079296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788639285.436891:0:20319:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788639285.442477:0:17238:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788639285.442524:0:17238:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788639285.442537:0:17238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f9f400/0x25c454990262d7f4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d7fb expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639285.442550:0:17238:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae242f9f400/0x25c454990262d7f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d7fb expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639285.442579:0:17238:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788639285.442582:0:17238:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae375ea7800 from 13 10000000:01000000:3.0:1788639285.442585:0:17238:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788639285.442743:0:17238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262d802 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639285.442752:0:17238:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262d802 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639285.442762:0:17238:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262d802 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639285.442786:0:17238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae380295500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773079424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788639285.442853:0:17238:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639285.442893:0:17238:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae343acb180 going to sleep for 11 seconds 00000100:00100000:0.0:1788639285.442975:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773079424 00000100:00100000:0.0:1788639285.442983:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773079424 00000100:00100000:0.0:1788639285.443046:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788639285.443055:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+21:17238:x1875523773079424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788639285.443068:0:17236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639285.443085:0:17236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae3748dce00/0x25c454990262d809 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262d802 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639285.443107:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae3748dce00/0x25c454990262d809 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262d802 expref: 22 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639285.443118:0:17236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae3748dce00/0x25c454990262d809 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262d802 expref: 22 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639285.443126:0:17236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3748dce00, rc 0) 00000100:00100000:0.0:1788639285.443167:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+22:17238:x1875523773079424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639285.443173:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788639285.443215:0:17238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae380295500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773079424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788639285.443228:0:17238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262d802 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d809 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639285.443237:0:17238:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262d802 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262d809 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639285.443286:0:17238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244034a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773079552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788639285.443308:0:17238:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639285.443327:0:17238:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36a0119c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788639285.443339:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773079552 00000100:00100000:0.0:1788639285.443342:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773079552 00000100:00100000:0.0:1788639285.443364:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788639285.443369:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+22:17238:x1875523773079552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788639285.444804:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+22:17238:x1875523773079552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1429us (1489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639285.444823:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788639285.446011:0:17238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244034a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773079552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788639285.446066:0:17238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae380297800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773079680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788639285.446125:0:17238:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639285.446165:0:17238:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae343acb780 going to sleep for 11 seconds 00000100:00100000:1.0:1788639285.446219:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773079680 00000100:00100000:1.0:1788639285.446225:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773079680 00000100:00100000:1.0:1788639285.446264:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788639285.446273:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+22:17238:x1875523773079680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788639285.446389:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+22:17238:x1875523773079680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639285.446413:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788639285.446769:0:17238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae380297800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773079680:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788639285.451061:0:20320:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788639285.451491:0:17238:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788639285.451513:0:17238:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788639285.451523:0:17238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262d802 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d809 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639285.451534:0:17238:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae242f9e200/0x25c454990262d802 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d809 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788639285.451551:0:17238:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788639285.451562:0:17238:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae34303d000 from 13 10000000:01000000:3.0:1788639285.451564:0:17238:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788639285.451600:0:17238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f9ea00/0x25c454990262d810 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639285.451609:0:17238:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae242f9ea00/0x25c454990262d810 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639285.451649:0:17238:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae242f9ea00/0x25c454990262d810 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639285.451675:0:17238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae380297800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773079808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788639285.451740:0:17238:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639285.451778:0:17238:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae343acb780 going to sleep for 11 seconds 00000100:00100000:0.0:1788639285.451840:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773079808 00000100:00100000:0.0:1788639285.451848:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773079808 00000100:00100000:0.0:1788639285.451900:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788639285.451910:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+22:17238:x1875523773079808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788639285.451922:0:17236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639285.451935:0:17236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae3748dc400/0x25c454990262d817 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262d810 expref: -99 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639285.451956:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae3748dc400/0x25c454990262d817 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262d810 expref: 23 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639285.451967:0:17236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae3748dc400/0x25c454990262d817 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262d810 expref: 23 pid: 17236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639285.451976:0:17236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3748dc400, rc 0) 00000100:00100000:0.0:1788639285.452020:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+23:17238:x1875523773079808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639285.452027:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788639285.452188:0:17238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae380297800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773079808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788639285.452203:0:17238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae242f9ea00/0x25c454990262d810 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d817 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639285.452213:0:17238:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae242f9ea00/0x25c454990262d810 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262d817 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639285.452269:0:17238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae380297800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773079936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788639285.452297:0:17238:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639285.452317:0:17238:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae343acb780 going to sleep for 11 seconds 00000100:00100000:0.0:1788639285.452358:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773079936 00000100:00100000:0.0:1788639285.452362:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773079936 00000100:00100000:0.0:1788639285.452392:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788639285.452399:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+23:17238:x1875523773079936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788639285.452501:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+23:17238:x1875523773079936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639285.452508:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788639285.452535:0:17238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae380297800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773079936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788639285.452582:0:17238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244035f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773080064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788639285.452654:0:17238:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639285.452670:0:17238:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36a0113c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788639285.452682:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773080064 00000100:00100000:0.0:1788639285.452686:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773080064 00000100:00100000:0.0:1788639285.452705:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788639285.452712:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+23:17238:x1875523773080064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788639285.452799:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+23:17238:x1875523773080064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639285.452806:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788639285.452847:0:17238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244035f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773080064:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788639285.454433:0:20322:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788639285.455821:0:17238:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788639285.455851:0:17238:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788639285.455862:0:17238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae242f9ea00/0x25c454990262d810 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d817 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639285.455874:0:17238:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae242f9ea00/0x25c454990262d810 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d817 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788639285.455889:0:17238:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788639285.455892:0:17238:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ae243aeb000 from 13 10000000:01000000:2.0:1788639285.455894:0:17238:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788639285.455925:0:17238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78aa00/0x25c454990262d81e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639285.455932:0:17238:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9ae37f78aa00/0x25c454990262d81e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639285.455942:0:17238:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9ae37f78aa00/0x25c454990262d81e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639285.455964:0:17238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f37480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773080192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788639285.456119:0:17238:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639285.456162:0:17238:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344267300 going to sleep for 11 seconds 00000100:00100000:1.0:1788639285.457011:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773080192 00000100:00100000:1.0:1788639285.457022:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773080192 00000100:00100000:1.0:1788639285.457076:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788639285.457087:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+23:17238:x1875523773080192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788639285.457101:0:17233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639285.457117:0:17233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae3750fa400/0x25c454990262d825 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x25c454990262d81e expref: -99 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639285.457143:0:17233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae3750fa400/0x25c454990262d825 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x25c454990262d81e expref: 24 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639285.457154:0:17233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae3750fa400/0x25c454990262d825 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x25c454990262d81e expref: 24 pid: 17233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639285.457163:0:17233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fa400, rc 0) 00000100:00100000:1.0:1788639285.457219:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d225031-35be-4b74-b245-637fda218215+24:17238:x1875523773080192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639285.457226:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788639285.462187:0:17238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f37480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773080192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788639285.462217:0:17238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9ae37f78aa00/0x25c454990262d81e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d825 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639285.462230:0:17238:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9ae37f78aa00/0x25c454990262d81e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x25c454990262d825 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639285.462377:0:17238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f37480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773080320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788639285.462430:0:17238:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639285.462469:0:17238:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344267300 going to sleep for 11 seconds 00000100:00100000:1.0:1788639285.463055:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773080320 00000100:00100000:1.0:1788639285.463064:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773080320 00000100:00100000:1.0:1788639285.463120:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788639285.463132:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+24:17238:x1875523773080320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788639285.463277:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d225031-35be-4b74-b245-637fda218215+24:17238:x1875523773080320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 147us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639285.463286:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788639285.463376:0:17238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f37480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773080320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788639285.463425:0:17238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f37480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773080448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788639285.463469:0:17238:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639285.463498:0:17238:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae344267300 going to sleep for 11 seconds 00000100:00100000:3.0:1788639285.463589:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773080448 00000100:00100000:3.0:1788639285.463594:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773080448 00000100:00100000:3.0:1788639285.463770:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788639285.463779:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+24:17238:x1875523773080448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788639285.463870:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+24:17238:x1875523773080448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639285.463876:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788639285.464704:0:17238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f37480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d225031-35be-4b74-b245-637fda218215:17238:1875523773080448:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788639285.470141:0:20324:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788639285.470742:0:17238:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788639285.470765:0:17238:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788639285.470776:0:17238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9ae37f78aa00/0x25c454990262d81e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d825 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639285.470786:0:17238:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9ae37f78aa00/0x25c454990262d81e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x25c454990262d825 expref: -99 pid: 17238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639285.556805:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639285.922015:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639285.922095:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754125312 00000100:00100000:1.0:1788639285.922106:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754125312 00000100:00100000:1.0:1788639285.922164:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 157 00000100:00100000:1.0:1788639285.922174:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+11:14946:x1875523754125312:12345-192.168.206.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788639285.922190:0:17235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639285.922210:0:17235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae3750fb000/0x25c454990262d82c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85955 expref: -99 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639285.922240:0:17235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae3750fb000/0x25c454990262d82c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85955 expref: 12 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639285.922253:0:17235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae3750fb000/0x25c454990262d82c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85955 expref: 12 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639285.922263:0:17235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fb000, rc 0) 00000100:00100000:1.0:1788639285.922318:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+12:14946:x1875523754125312:12345-192.168.206.18@tcp:101:ll_cfg_requeue.0 Request processed in 145us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639285.922324:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 157 00000100:00100000:3.0:1788639285.925938:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639285.926262:0:17233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754125440 00000100:00100000:2.0:1788639285.926271:0:17233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754125440 00000100:00100000:2.0:1788639285.926323:0:17233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 158 00000100:00100000:2.0:1788639285.926332:0:17233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+12:14946:x1875523754125440:12345-192.168.206.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788639285.926471:0:17233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+12:14946:x1875523754125440:12345-192.168.206.18@tcp:501:ll_cfg_requeue.0 Request processed in 140us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639285.926479:0:17233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 158 00000100:00100000:1.0:1788639285.929045:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639285.930868:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754125568 00000100:00100000:3.0:1788639285.930879:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754125568 00000100:00100000:3.0:1788639285.930937:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 159 00000100:00100000:3.0:1788639285.930947:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+12:14946:x1875523754125568:12345-192.168.206.18@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788639285.931427:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+12:14946:x1875523754125568:12345-192.168.206.18@tcp:503:ll_cfg_requeue.0 Request processed in 479us (2388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639285.931440:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 159 00000100:00100000:3.0:1788639285.936946:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639285.937041:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754125696 00000100:00100000:2.0:1788639285.937051:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754125696 00000100:00100000:2.0:1788639285.937194:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 160 00000100:00100000:2.0:1788639285.937205:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+12:14946:x1875523754125696:12345-192.168.206.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788639285.937221:0:17235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639285.937239:0:17235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ae37f78a600/0x25c454990262d833 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e8595c expref: -99 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639285.937267:0:17235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ae37f78a600/0x25c454990262d833 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8595c expref: 13 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639285.937288:0:17235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ae37f78a600/0x25c454990262d833 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8595c expref: 13 pid: 17235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639285.937298:0:17235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae37f78a600, rc 0) 00000100:00100000:2.0:1788639285.937352:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+13:14946:x1875523754125696:12345-192.168.206.18@tcp:101:ll_cfg_requeue.0 Request processed in 149us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639285.937360:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 160 00000100:00100000:2.0:1788639285.941002:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639285.941388:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243950e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773080576:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788639285.941439:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639285.941488:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773080576 00000100:00100000:1.0:1788639285.941495:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773080576 00000100:00100000:1.0:1788639285.941536:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788639285.941544:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243952300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523773080576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788639285.941587:0:17245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788639285.941665:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243952300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523773080576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639285.941673:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788639285.941725:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243950e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773080576:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788639285.945236:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754125824 00000100:00100000:3.0:1788639285.945249:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754125824 00000100:00100000:3.0:1788639285.945332:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 161 00000100:00100000:3.0:1788639285.945342:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+13:14946:x1875523754125824:12345-192.168.206.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788639285.945499:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+13:14946:x1875523754125824:12345-192.168.206.18@tcp:501:ll_cfg_requeue.0 Request processed in 158us (4505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639285.945508:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 161 00000100:00100000:0.0:1788639285.955246:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639285.955333:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754125952 00000100:00100000:2.0:1788639285.955342:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754125952 00000100:00100000:2.0:1788639285.955393:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 162 00000100:00100000:2.0:1788639285.955411:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+13:14946:x1875523754125952:12345-192.168.206.18@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788639285.955641:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+13:14946:x1875523754125952:12345-192.168.206.18@tcp:503:ll_cfg_requeue.0 Request processed in 206us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639285.955649:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 162 00010000:00010000:1.0:1788639286.580885:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639286.964880:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243950e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773080832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788639286.964888:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae380296680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773080960:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788639286.964964:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639286.965004:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639286.965012:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773081216:0@lo:400:kworker.0 00000100:00100000:2.0:1788639286.965023:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773080832 00000100:00100000:2.0:1788639286.965036:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773080832 00000100:00100000:1.0:1788639286.965056:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639286.965098:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773080960 00000100:00100000:3.0:1788639286.965102:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523773081472:0@lo:400:kworker.0 00000100:00100000:2.0:1788639286.965105:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773080960 00000100:00100000:1.0:1788639286.965125:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773081728:0@lo:400:kworker.0 00000100:00100000:2.0:1788639286.965138:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788639286.965152:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243950380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773080832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788639286.965185:0:18751:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788639286.965194:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639286.965198:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639286.965221:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875523773082240:0@lo:400:kworker.0 00000100:00100000:0.0:1788639286.965252:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773081472 00000100:00100000:0.0:1788639286.965258:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773081472 00000100:00100000:3.0:1788639286.965269:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875523773081984:0@lo:400:kworker.0 00000100:00100000:2.0:1788639286.965280:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243950380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773080832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639286.965287:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639286.965297:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788639286.965297:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773082240 00000100:00100000:0.0:1788639286.965303:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773082240 00000100:00100000:3.0:1788639286.965327:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639286.965338:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773081984 00000100:00100000:2.0:1788639286.965345:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788639286.965345:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773081984 00000100:00100000:1.0:1788639286.965353:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243950e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773080832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788639286.965363:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae380295c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773080960:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788639286.965364:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875523773082496:0@lo:400:kworker.0 00000100:00100000:0.0:1788639286.965374:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788639286.965378:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1788639286.965383:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae380297480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523773081472:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1788639286.965385:0:18751:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788639286.965388:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4d225031-35be-4b74-b245-637fda218215:3641:1875523773080704:0@lo:400:kworker.0 00000100:00100000:3.0:1788639286.965435:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639286.967500:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae380296680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773080960:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788639286.967563:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875523773081472:0@lo:400:kworker.0 00000100:00100000:3.0:1788639286.967588:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788639286.967601:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773081088:0@lo:400:kworker.0 00000100:00100000:3.0:1788639286.968257:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639286.968302:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773081600:0@lo:400:kworker.0 00000100:00100000:3.0:1788639286.969874:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639286.970101:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875523773082112:0@lo:400:kworker.0 00000100:00100000:3.0:1788639286.970500:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639286.970544:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae380297480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875523773081472:12345-0@lo:400:kworker.0 Request processed in 5151us (5351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639286.970568:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788639286.970573:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773081216 00000100:00100000:3.0:1788639286.970589:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773081216 00000100:00100000:0.0:1788639286.970604:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773082496 00000100:00100000:0.0:1788639286.970636:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773082496 00000100:00100000:0.0:1788639286.970672:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773082112 00000100:00100000:0.0:1788639286.970689:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773082112 00000100:00100000:0.0:1788639286.970712:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788639286.970720:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875523773082240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639286.970794:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875523773082240:12345-0@lo:400:kworker.0 Request processed in 74us (5517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639286.970801:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788639286.970818:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788639286.970826:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae380294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875523773081984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639286.971212:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773081728 00000100:00100000:3.0:1788639286.971219:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773081728 00000100:00100000:3.0:1788639286.971252:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788639286.971262:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243951c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773081216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639286.971327:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243951c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773081216:12345-0@lo:400:kworker.0 Request processed in 67us (6275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639286.971334:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788639286.971350:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788639286.971370:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243950a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773081728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639286.974131:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae380295c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773080960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 8765us (9120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639286.974145:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1788639286.974196:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788639286.974202:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788639286.974205:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788639286.974208:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788639286.974237:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788639286.974253:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae380295880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875523773082496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639286.974341:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae380295880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875523773082496:12345-0@lo:400:kworker.0 Request processed in 96us (8910us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639286.974347:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788639286.974362:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788639286.974368:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae380294700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875523773082112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639286.974397:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae380294700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875523773082112:12345-0@lo:400:kworker.0 Request processed in 30us (3898us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639286.974402:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788639286.974445:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875523773082112:0@lo:400:kworker.0 00010000:00080000:2.0:1788639286.974461:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f39f80 x1875523773082496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788639286.974471:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875523773082496:0@lo:400:kworker.0 00000100:00100000:2.0:1788639286.974521:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773081088 00000100:00100000:2.0:1788639286.974560:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773081088 00000100:00100000:2.0:1788639286.974601:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773081600 00000100:00100000:2.0:1788639286.974605:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773081600 00000100:00100000:2.0:1788639286.974641:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788639286.974647:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae380296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523773081088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639286.974688:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae380296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523773081088:12345-0@lo:400:kworker.0 Request processed in 42us (6434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639286.974694:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788639286.974705:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788639286.974710:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae380294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773081600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639286.974734:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae380294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773081600:12345-0@lo:400:kworker.0 Request processed in 25us (4870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639286.974740:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788639286.974768:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773081088:0@lo:400:kworker.0 00000100:00100000:2.0:1788639286.974780:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773081600:0@lo:400:kworker.0 00000100:00100000:1.0:1788639286.977787:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639286.977853:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773081344:0@lo:400:kworker.0 00000100:00100000:1.0:1788639286.977896:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639286.977919:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773081856:0@lo:400:kworker.0 00000100:00100000:1.0:1788639286.977941:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639286.977957:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375f39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875523773082368:0@lo:400:kworker.0 00000100:00100000:1.0:1788639286.977981:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639286.978000:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae380294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875523773081984:12345-0@lo:400:kworker.0 Request processed in 7174us (12674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639286.978010:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788639286.978017:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773081728:0@lo:400:kworker.0 00000100:00100000:3.0:1788639286.978049:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243950a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773081728:12345-0@lo:400:kworker.0 Request processed in 6668us (12857us total) trans 0 rc 0/0 00010000:00080000:1.0:1788639286.978054:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae375f37100 x1875523773082240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639286.978057:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875523773081984:0@lo:400:kworker.0 00000100:00100000:3.0:1788639286.978085:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788639286.978124:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773081344 00000100:00100000:3.0:1788639286.978134:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773081344 00000100:00100000:3.0:1788639286.978203:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773081856 00000100:00100000:3.0:1788639286.978207:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773081856 00000100:00100000:3.0:1788639286.978347:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788639286.978358:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243950e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773081344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639286.978442:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243950e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773081344:12345-0@lo:400:kworker.0 Request processed in 86us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639286.978449:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788639286.978460:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788639286.978466:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243953800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773081856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639286.978499:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243953800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773081856:12345-0@lo:400:kworker.0 Request processed in 33us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639286.978505:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788639286.978582:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773082368 00000100:00100000:3.0:1788639286.978587:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773082368 00000100:00100000:3.0:1788639286.978819:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788639286.978827:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243951f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875523773082368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788639286.978866:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243951f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875523773082368:12345-0@lo:400:kworker.0 Request processed in 41us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639286.978873:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1788639286.978895:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788639286.979078:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773080704 00000100:00100000:2.0:1788639286.979090:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773080704 00000100:00100000:2.0:1788639286.979152:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788639286.979163:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+24:3641:x1875523773080704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788639286.979238:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+24:3641:x1875523773080704:12345-0@lo:400:kworker.0 Request processed in 78us (1458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639286.979245:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788639286.981126:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875523773082240:0@lo:400:kworker.0 00000100:00100000:1.0:1788639286.981167:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773081216:0@lo:400:kworker.0 00000100:00100000:1.0:1788639286.981212:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4d225031-35be-4b74-b245-637fda218215:3641:1875523773080704:0@lo:400:kworker.0 00000100:00100000:1.0:1788639286.981226:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773081344:0@lo:400:kworker.0 00000100:00100000:1.0:1788639286.981237:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773081856:0@lo:400:kworker.0 00000100:00100000:1.0:1788639286.981250:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375f39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875523773082368:0@lo:400:kworker.0 00010000:00010000:0.0:1788639287.604764:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639287.703709:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639287.703812:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754126080 00000100:00100000:2.0:1788639287.703823:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754126080 00000100:00100000:2.0:1788639287.704043:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 23 00000100:00100000:2.0:1788639287.704056:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243950700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f164030-9448-43be-b8f2-64db35b5d669+6:15612:x1875523754126080:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788639287.704093:0:17241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639287.704130:0:17241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262d83a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85963 expref: -99 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.704196:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b800/0x25c454990262d841 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.704211:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b800/0x25c454990262d841 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.704225:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b800/0x25c454990262d841 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.704241:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22000/0x25c454990262d848 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788639287.704244:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788639287.704249:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22000/0x25c454990262d848 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.704260:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22000/0x25c454990262d848 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.704335:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23a00/0x25c454990262d84f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.704344:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23a00/0x25c454990262d84f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.704351:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23a00/0x25c454990262d84f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788639287.704380:0:17241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788639287.704389:0:17241:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788639287.704428:0:17241:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23a00/0x25c454990262d84f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.704577:0:17241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b800/0x25c454990262d841 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.704586:0:17241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b800/0x25c454990262d841 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.704593:0:17241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b800/0x25c454990262d841 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.704599:0:17241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae37f78b800 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639287.704603:0:17241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b800/0x25c454990262d841 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.704611:0:17241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b800/0x25c454990262d841 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.704648:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae35294cb00) 00010000:00010000:2.0:1788639287.704651:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639287.704656:0:17241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b800/0x25c454990262d841 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.704661:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78b800/0x25c454990262d841 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.704676:0:17241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22000/0x25c454990262d848 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.704683:0:17241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22000/0x25c454990262d848 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.704700:0:17241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22000/0x25c454990262d848 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.704705:0:17241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f22000 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639287.704708:0:17241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22000/0x25c454990262d848 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.704714:0:17241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22000/0x25c454990262d848 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.704721:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9ae242358200) 00010000:00010000:2.0:1788639287.704723:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639287.704726:0:17241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22000/0x25c454990262d848 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.704731:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22000/0x25c454990262d848 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.704765:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae37f78a800/0x25c454990262d83a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85963 expref: 8 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.704784:0:17241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23a00/0x25c454990262d84f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85963 expref: 7 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.705031:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ae242358d00) 00010000:00010000:2.0:1788639287.705035:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788639287.705038:0:17241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f23a00, rc 0) 00000100:00100000:2.0:1788639287.705197:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243950700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f164030-9448-43be-b8f2-64db35b5d669+7:15612:x1875523754126080:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 1143us (1495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639287.705214:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 23 00000100:00100000:2.0:1788639287.710976:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639287.711318:0:17252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754126208 00000100:00100000:1.0:1788639287.711328:0:17252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754126208 00000100:00100000:1.0:1788639287.711381:0:17252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 5 00000100:00100000:1.0:1788639287.711399:0:17252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5f164030-9448-43be-b8f2-64db35b5d669+7:15612:x1875523754126208:12345-192.168.206.18@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788639287.711648:0:17252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5f164030-9448-43be-b8f2-64db35b5d669+7:15612:x1875523754126208:12345-192.168.206.18@tcp:900:lhsmtool_posix.0 Request processed in 257us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639287.711657:0:17252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 5 00000100:00100000:1.0:1788639287.715653:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639287.715750:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754126464 00000100:00100000:3.0:1788639287.715760:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754126464 00000100:00100000:3.0:1788639287.715878:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 24 00000100:00100000:3.0:1788639287.715889:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243951180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f164030-9448-43be-b8f2-64db35b5d669+7:15612:x1875523754126464:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788639287.715908:0:17242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639287.715942:0:17242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9e800/0x25c454990262d856 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e8596a expref: -99 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.716017:0:17242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9f200/0x25c454990262d85d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.716033:0:17242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9f200/0x25c454990262d85d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.716056:0:17242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9f200/0x25c454990262d85d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.716120:0:17242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9ec00/0x25c454990262d864 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.716128:0:17242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9ec00/0x25c454990262d864 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.716136:0:17242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9ec00/0x25c454990262d864 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.716240:0:17242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9fc00/0x25c454990262d86b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.716248:0:17242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9fc00/0x25c454990262d86b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.716271:0:17242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9fc00/0x25c454990262d86b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788639287.716281:0:17242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1788639287.716436:0:17242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9f200/0x25c454990262d85d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.716455:0:17242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9f200/0x25c454990262d85d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.716462:0:17242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9f200/0x25c454990262d85d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.716468:0:17242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9f200 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639287.716473:0:17242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9f200/0x25c454990262d85d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.716480:0:17242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9f200/0x25c454990262d85d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.716493:0:17242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ae242358d00) 00010000:00010000:3.0:1788639287.716495:0:17242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639287.716500:0:17242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9f200/0x25c454990262d85d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.716507:0:17242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9f200/0x25c454990262d85d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.716521:0:17242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9ec00/0x25c454990262d864 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.716528:0:17242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9ec00/0x25c454990262d864 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.716539:0:17242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9ec00/0x25c454990262d864 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.716556:0:17242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9ec00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639287.716559:0:17242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9ec00/0x25c454990262d864 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.716566:0:17242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9ec00/0x25c454990262d864 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.716575:0:17242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9ae242375600) 00010000:00010000:3.0:1788639287.716578:0:17242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639287.716581:0:17242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9ec00/0x25c454990262d864 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.716588:0:17242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9ec00/0x25c454990262d864 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.718044:0:17242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9e800/0x25c454990262d856 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8596a expref: 10 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.718192:0:17242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9fc00/0x25c454990262d86b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8596a expref: 9 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.718201:0:17242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ae242375500) 00010000:00010000:3.0:1788639287.718204:0:17242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639287.718207:0:17242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f9fc00, rc 0) 00000100:00100000:3.0:1788639287.718331:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243951180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f164030-9448-43be-b8f2-64db35b5d669+9:15612:x1875523754126464:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 2443us (2713us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788639287.718357:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 24 00000100:00100000:2.0:1788639287.723862:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639287.723955:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754126592 00000100:00100000:0.0:1788639287.723965:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754126592 00000100:00100000:0.0:1788639287.724021:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 25 00000100:00100000:0.0:1788639287.724031:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f164030-9448-43be-b8f2-64db35b5d669+9:15612:x1875523754126592:12345-192.168.206.18@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788639287.724162:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f164030-9448-43be-b8f2-64db35b5d669+9:15612:x1875523754126592:12345-192.168.206.18@tcp:59:lhsmtool_posix.0 Request processed in 131us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639287.724170:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 25 00000100:00100000:2.0:1788639287.727672:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639287.727769:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754126720 00000100:00100000:0.0:1788639287.727778:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754126720 00000100:00100000:0.0:1788639287.727847:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 26 00000100:00100000:0.0:1788639287.727857:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f164030-9448-43be-b8f2-64db35b5d669+5:15612:x1875523754126720:12345-192.168.206.18@tcp:59:lhsmtool_posix.0 00000100:00080000:3.0:1788639287.728041:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1788639287.733661:0:18565:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 5765us 00000100:00100000:1.0:1788639287.757817:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639287.757934:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754126848 00000100:00100000:0.0:1788639287.757945:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754126848 00000100:00100000:0.0:1788639287.758006:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 27 00000100:00100000:0.0:1788639287.758017:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f164030-9448-43be-b8f2-64db35b5d669+9:15618:x1875523754126848:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:0.0:1788639287.758038:0:17241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639287.758066:0:17241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd000/0x25c454990262d879 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85971 expref: -99 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.758147:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd600/0x25c454990262d880 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.758162:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd600/0x25c454990262d880 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.758174:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd600/0x25c454990262d880 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.758190:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262d887 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.758198:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262d887 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.758205:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262d887 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.758254:0:17241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd600/0x25c454990262d880 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.758261:0:17241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd600/0x25c454990262d880 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.758287:0:17241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd600/0x25c454990262d880 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.758293:0:17241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3748dd600 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639287.758298:0:17241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd600/0x25c454990262d880 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.758307:0:17241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd600/0x25c454990262d880 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.758320:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae35294cb00) 00010000:00010000:0.0:1788639287.758323:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639287.758329:0:17241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd600/0x25c454990262d880 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.758337:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd600/0x25c454990262d880 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.758351:0:17241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262d887 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.758357:0:17241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262d887 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.758363:0:17241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262d887 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.758368:0:17241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3748dda00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639287.758371:0:17241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262d887 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.758387:0:17241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262d887 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.758396:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ae242376b00) 00010000:00010000:0.0:1788639287.758399:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639287.758402:0:17241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262d887 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.758408:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262d887 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.758738:0:17241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd000/0x25c454990262d879 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85971 expref: 10 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.758750:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae35294cb00) 00010000:00010000:0.0:1788639287.758753:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639287.758757:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd000/0x25c454990262d879 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85971 expref: 10 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.758767:0:17241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3748dd000, rc 0) 00000100:00100000:0.0:1788639287.758836:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f164030-9448-43be-b8f2-64db35b5d669+9:15618:x1875523754126848:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 822us (1030us total) trans 0 rc 301/301 00000100:00100000:0.0:1788639287.758844:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 27 00000100:00100000:3.0:1788639287.768034:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639287.769510:0:17249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754126976 00000100:00100000:2.0:1788639287.769525:0:17249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754126976 00000100:00100000:2.0:1788639287.769597:0:17249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 0 00000100:00100000:2.0:1788639287.769608:0:17249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae380294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5f164030-9448-43be-b8f2-64db35b5d669+9:15618:x1875523754126976:12345-192.168.206.18@tcp:700:lfs.0 00000100:00100000:2.0:1788639287.769703:0:17249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae380294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5f164030-9448-43be-b8f2-64db35b5d669+9:15618:x1875523754126976:12345-192.168.206.18@tcp:700:lfs.0 Request processed in 97us (1677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639287.769711:0:17249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 0 00000100:00100000:1.0:1788639287.781338:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f164030-9448-43be-b8f2-64db35b5d669+5:15612:x1875523754126720:12345-192.168.206.18@tcp:59:lhsmtool_posix.0 Request processed in 53260us (53451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639287.781353:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 26 00000100:00100000:3.0:1788639287.781769:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639287.783958:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754127232 00000100:00100000:1.0:1788639287.783987:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754127232 00000100:00100000:1.0:1788639287.784059:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 28 00000100:00100000:1.0:1788639287.784069:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae380296d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f164030-9448-43be-b8f2-64db35b5d669+9:15618:x1875523754127232:12345-192.168.206.18@tcp:36:lfs.0 00010000:00010000:1.0:1788639287.784133:0:17242:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788639287.784159:0:17242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262d7a7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e858de expref: 9 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639287.784178:0:17242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae35294cb00) 00010000:00010000:1.0:1788639287.784183:0:17242:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788639287.784240:0:17242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262d88e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639287.784254:0:17242:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5200/0x25c454990262d7e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8594e expref: 5 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639287.784262:0:17242:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262d88e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639287.784295:0:17242:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5200/0x25c454990262d7e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8594e expref: 5 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639287.784308:0:17242:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5200/0x25c454990262d7e6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8594e expref: 5 pid: 17241 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639287.784322:0:17242:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae24233f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17242:1875523773082624:192.168.206.18@tcp:104: 00000100:00100000:1.0:1788639287.784418:0:17242:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae34b331480 going to sleep for 11 seconds 00000100:00100000:3.0:1788639287.793312:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639287.793419:0:17242:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae24233f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17242:1875523773082624:192.168.206.18@tcp:104: 00010000:00010000:1.0:1788639287.793446:0:17242:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262d88e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639287.793607:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754127360 00000100:00100000:2.0:1788639287.793629:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754127360 00010000:00010000:2.0:1788639287.793679:0:17228:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5200/0x25c454990262d7e6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8594e expref: 6 pid: 17241 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639287.793776:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 15 00000100:00100000:1.0:1788639287.793792:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae380297b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64907637-38d0-4ad4-9e99-06074f162345+6:2408:x1875523754127360:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788639287.793807:0:17227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788639287.793814:0:17227:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5200/0x25c454990262d7e6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8594e expref: 6 pid: 17241 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639287.793827:0:17227:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5200/0x25c454990262d7e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8594e expref: 6 pid: 17241 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639287.793860:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae375ef5200/0x25c454990262d7e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8594e expref: 6 pid: 17241 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639287.793873:0:17227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae35294cb00) 00010000:00010000:1.0:1788639287.793878:0:17227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262d88e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639287.793887:0:17227:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262d88e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639287.793895:0:17227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262d88e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639287.793922:0:17227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:3.0:1788639287.793923:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788639287.793974:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae380297b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64907637-38d0-4ad4-9e99-06074f162345+5:2408:x1875523754127360:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 188us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639287.793982:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 15 00010000:00010000:2.0:1788639287.794157:0:17242:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262d88e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.794166:0:17242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262d88e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.794189:0:17242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23000/0x25c454990262d895 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.794199:0:17242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23000/0x25c454990262d895 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.794207:0:17242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23000/0x25c454990262d895 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.796411:0:17242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9ec00/0x25c454990262d89c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.796431:0:17242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9ec00/0x25c454990262d89c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.796451:0:17242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9ec00/0x25c454990262d89c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788639287.796467:0:17242:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001beabaf7 reply state 0000000027e4a5e9 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9ec00/0x25c454990262d89c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.796478:0:17242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9ec00/0x25c454990262d89c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.796484:0:17242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ae242375600) 00010000:00010000:3.0:1788639287.796487:0:17242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788639287.796491:0:17242:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788639287.796496:0:17242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788639287.796503:0:17242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262d88e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.796510:0:17242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262d88e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.796526:0:17242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262d88e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.796532:0:17242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3750fb400 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639287.796536:0:17242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262d88e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.796553:0:17242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262d88e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.796562:0:17242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae35294cb00) 00010000:00010000:3.0:1788639287.796565:0:17242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788639287.796569:0:17242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262d88e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.796575:0:17242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262d88e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788639287.796593:0:17242:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001beabaf7 reply state 0000000027e4a5e9 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23000/0x25c454990262d895 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.796602:0:17242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23000/0x25c454990262d895 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.796607:0:17242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ae242358200) 00010000:00010000:3.0:1788639287.796610:0:17242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788639287.796612:0:17242:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788639287.796719:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae380296d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f164030-9448-43be-b8f2-64db35b5d669+10:15618:x1875523754127232:12345-192.168.206.18@tcp:36:lfs.0 Request processed in 12648us (14948us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788639287.796727:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 28 00000100:00100000:3.0:1788639287.864124:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639287.864448:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754127488 00000100:00100000:0.0:1788639287.864458:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754127488 00000100:00100000:0.0:1788639287.864514:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 29 00000100:00100000:0.0:1788639287.864523:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae380297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f164030-9448-43be-b8f2-64db35b5d669+10:15626:x1875523754127488:12345-192.168.206.18@tcp:101:lctl.0 00010000:00010000:0.0:1788639287.864577:0:17240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639287.864599:0:17240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262d8a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85978 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.864684:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd600/0x25c454990262d8aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.864697:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd600/0x25c454990262d8aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.864708:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd600/0x25c454990262d8aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788639287.864746:0:17240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788639287.864751:0:17240:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788639287.864789:0:17240:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd600/0x25c454990262d8aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.865129:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262d8a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85978 expref: 12 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.865150:0:17240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd600/0x25c454990262d8aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85978 expref: 11 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.865160:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae242376b00) 00010000:00010000:0.0:1788639287.865162:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788639287.865166:0:17240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3748dd600, rc 0) 00000100:00100000:0.0:1788639287.865231:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae380297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f164030-9448-43be-b8f2-64db35b5d669+11:15626:x1875523754127488:12345-192.168.206.18@tcp:101:lctl.0 Request processed in 708us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639287.865239:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 29 00000100:00100000:1.0:1788639287.887821:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639287.887904:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754127616 00000100:00100000:0.0:1788639287.887915:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754127616 00000100:00100000:0.0:1788639287.888027:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 30 00000100:00100000:0.0:1788639287.888038:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64907637-38d0-4ad4-9e99-06074f162345+5:15627:x1875523754127616:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:0.0:1788639287.888059:0:17241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639287.888079:0:17241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262d8b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e8597f expref: -99 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.888142:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc000/0x25c454990262d8b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.888157:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc000/0x25c454990262d8b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.888168:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc000/0x25c454990262d8b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788639287.888212:0:17241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788639287.888216:0:17241:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788639287.888235:0:17241:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc000/0x25c454990262d8b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.888259:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262d8b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8597f expref: 7 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.888276:0:17241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc000/0x25c454990262d8b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8597f expref: 6 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.888285:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae242376b00) 00010000:00010000:0.0:1788639287.888289:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788639287.888300:0:17241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3748dc000, rc 0) 00000100:00100000:0.0:1788639287.888369:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64907637-38d0-4ad4-9e99-06074f162345+6:15627:x1875523754127616:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 333us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639287.888377:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 30 00000100:00100000:1.0:1788639287.896610:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639287.896743:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754127744 00000100:00100000:0.0:1788639287.896753:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754127744 00000100:00100000:0.0:1788639287.896821:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 31 00000100:00100000:0.0:1788639287.896831:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64907637-38d0-4ad4-9e99-06074f162345+6:15627:x1875523754127744:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:0.0:1788639287.896858:0:18565:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639287.896878:0:18565:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262d8bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85986 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.896945:0:18565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262d8c6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.896958:0:18565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262d8c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.896969:0:18565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262d8c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.896979:0:18565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd400/0x25c454990262d8cd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.896986:0:18565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd400/0x25c454990262d8cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.896991:0:18565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd400/0x25c454990262d8cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.897086:0:18565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc600/0x25c454990262d8d4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.897106:0:18565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc600/0x25c454990262d8d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.897114:0:18565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc600/0x25c454990262d8d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788639287.897150:0:18565:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788639287.897154:0:18565:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788639287.897172:0:18565:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc600/0x25c454990262d8d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.897184:0:18565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262d8c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.897190:0:18565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262d8c6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.897197:0:18565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262d8c6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.897203:0:18565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3748dca00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639287.897207:0:18565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262d8c6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.897214:0:18565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262d8c6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.897225:0:18565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae242376b00) 00010000:00010000:0.0:1788639287.897228:0:18565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639287.897233:0:18565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262d8c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.897250:0:18565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262d8c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.897263:0:18565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd400/0x25c454990262d8cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.897269:0:18565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd400/0x25c454990262d8cd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.897275:0:18565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd400/0x25c454990262d8cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.897280:0:18565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3748dd400 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639287.897283:0:18565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd400/0x25c454990262d8cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.897290:0:18565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd400/0x25c454990262d8cd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.897298:0:18565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ae242358200) 00010000:00010000:0.0:1788639287.897300:0:18565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639287.897303:0:18565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd400/0x25c454990262d8cd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.897309:0:18565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd400/0x25c454990262d8cd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.897332:0:18565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262d8bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85986 expref: 8 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.897356:0:18565:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc600/0x25c454990262d8d4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85986 expref: 7 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.897364:0:18565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ae242375600) 00010000:00010000:0.0:1788639287.897367:0:18565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788639287.897369:0:18565:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3748dc600, rc 0) 00000100:00100000:0.0:1788639287.897429:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64907637-38d0-4ad4-9e99-06074f162345+7:15627:x1875523754127744:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 599us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639287.897436:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 31 00000100:00100000:2.0:1788639287.903663:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639287.903797:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754127872 00000100:00100000:3.0:1788639287.903806:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754127872 00000100:00100000:3.0:1788639287.903937:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 6 00000100:00100000:3.0:1788639287.903948:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:64907637-38d0-4ad4-9e99-06074f162345+5:15627:x1875523754127872:12345-192.168.206.18@tcp:900:lfs.0 00000100:00100000:3.0:1788639287.904048:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:64907637-38d0-4ad4-9e99-06074f162345+5:15627:x1875523754127872:12345-192.168.206.18@tcp:900:lfs.0 Request processed in 102us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639287.904056:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 6 00000100:00080000:2.0:1788639287.905163:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788639287.910172:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639287.910539:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754128128 00000100:00100000:3.0:1788639287.910559:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754128128 00000100:00100000:3.0:1788639287.910646:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 32 00000100:00100000:3.0:1788639287.910658:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae24233d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64907637-38d0-4ad4-9e99-06074f162345+7:15627:x1875523754128128:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:3.0:1788639287.910678:0:17242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639287.910699:0:17242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9e800/0x25c454990262d8db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e8598d expref: -99 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788639287.910790:0:17242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788639287.910886:0:17242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9e800/0x25c454990262d8db lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8598d expref: 9 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.910899:0:17242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae242376b00) 00010000:00010000:3.0:1788639287.910902:0:17242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788639287.910907:0:17242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9e800/0x25c454990262d8db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8598d expref: 9 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.910921:0:17242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f9e800, rc 0) 00000100:00100000:3.0:1788639287.910983:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae24233d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64907637-38d0-4ad4-9e99-06074f162345+8:15627:x1875523754128128:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 328us (819us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1788639287.911003:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 32 00000100:00100000:1.0:1788639287.915273:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639287.917667:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754128384 00000100:00100000:0.0:1788639287.917681:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754128384 00000100:00100000:0.0:1788639287.917773:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 33 00000100:00100000:0.0:1788639287.917783:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae374871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64907637-38d0-4ad4-9e99-06074f162345+8:15627:x1875523754128384:12345-192.168.206.18@tcp:36:lfs.0 00010000:00010000:0.0:1788639287.917849:0:18565:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788639287.917873:0:18565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc600/0x25c454990262d8d4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85986 expref: 8 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.917892:0:18565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ae242375600) 00010000:00010000:0.0:1788639287.917896:0:18565:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788639287.917915:0:18565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262d8e9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.917926:0:18565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262d8e9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.917935:0:18565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262d8e9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788639287.918127:0:18565:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000486fa9b5 reply state 0000000063e83ff4 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262d8e9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.918139:0:18565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262d8e9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639287.918146:0:18565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ae242375600) 00010000:00010000:0.0:1788639287.918148:0:18565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1788639287.918151:0:18565:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788639287.918158:0:18565:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788639287.918242:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae374871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64907637-38d0-4ad4-9e99-06074f162345+9:15627:x1875523754128384:12345-192.168.206.18@tcp:36:lfs.0 Request processed in 460us (2978us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788639287.918249:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 33 00000100:00100000:2.0:1788639287.921173:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639287.921379:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754128640 00000100:00100000:1.0:1788639287.921388:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754128640 00000100:00100000:1.0:1788639287.921432:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 2 00000100:00100000:1.0:1788639287.921439:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64907637-38d0-4ad4-9e99-06074f162345+9:15627:x1875523754128640:12345-192.168.206.18@tcp:35:lfs.0 00000100:00100000:1.0:1788639287.921679:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64907637-38d0-4ad4-9e99-06074f162345+10:15627:x1875523754128640:12345-192.168.206.18@tcp:35:lfs.0 Request processed in 238us (514us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788639287.921686:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 2 00000100:00100000:1.0:1788639287.929333:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639287.929496:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754128896 00000100:00100000:3.0:1788639287.929505:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754128896 00000100:00100000:3.0:1788639287.929567:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 34 00000100:00100000:3.0:1788639287.929576:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae374873800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64907637-38d0-4ad4-9e99-06074f162345+10:15627:x1875523754128896:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:3.0:1788639287.929597:0:17242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639287.929643:0:17242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9e800/0x25c454990262d8f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85994 expref: -99 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.929710:0:17242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9f200/0x25c454990262d8f7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.929722:0:17242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9f200/0x25c454990262d8f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.929732:0:17242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9f200/0x25c454990262d8f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.929741:0:17242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9ee00/0x25c454990262d8fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.929747:0:17242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9ee00/0x25c454990262d8fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.929752:0:17242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9ee00/0x25c454990262d8fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788639287.930384:0:17242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788639287.930456:0:17242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9f200/0x25c454990262d8f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.930465:0:17242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9f200/0x25c454990262d8f7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.930472:0:17242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9f200/0x25c454990262d8f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.930478:0:17242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9f200 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639287.930482:0:17242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9f200/0x25c454990262d8f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.930489:0:17242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9f200/0x25c454990262d8f7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.930502:0:17242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae242376b00) 00010000:00010000:2.0:1788639287.930505:0:17242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639287.930509:0:17242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9f200/0x25c454990262d8f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.930516:0:17242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9f200/0x25c454990262d8f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.930528:0:17242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9ee00/0x25c454990262d8fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.930563:0:17242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9ee00/0x25c454990262d8fe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.930568:0:17242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9ee00/0x25c454990262d8fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.930572:0:17242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9ee00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639287.930575:0:17242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9ee00/0x25c454990262d8fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.930580:0:17242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9ee00/0x25c454990262d8fe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.930587:0:17242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ae242358200) 00010000:00010000:2.0:1788639287.930589:0:17242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639287.930592:0:17242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9ee00/0x25c454990262d8fe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.930597:0:17242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9ee00/0x25c454990262d8fe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.930673:0:17242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9e800/0x25c454990262d8f0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85994 expref: 12 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.930683:0:17242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae242376b00) 00010000:00010000:2.0:1788639287.930685:0:17242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788639287.930688:0:17242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9e800/0x25c454990262d8f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85994 expref: 12 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.930706:0:17242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f9e800, rc 0) 00000100:00100000:2.0:1788639287.930764:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae374873800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64907637-38d0-4ad4-9e99-06074f162345+11:15627:x1875523754128896:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 1189us (1440us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1788639287.930771:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 34 00000100:00100000:2.0:1788639287.934654:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639287.934709:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754129024 00000100:00100000:3.0:1788639287.934718:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754129024 00000100:00100000:3.0:1788639287.934766:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 35 00000100:00100000:3.0:1788639287.934787:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64907637-38d0-4ad4-9e99-06074f162345+11:15627:x1875523754129024:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:3.0:1788639287.934808:0:17240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639287.934826:0:17240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9e400/0x25c454990262d90c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e8599b expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.934922:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9fe00/0x25c454990262d913 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.934936:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9fe00/0x25c454990262d913 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.934949:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9fe00/0x25c454990262d913 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788639287.934974:0:17240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788639287.934978:0:17240:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788639287.934997:0:17240:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9fe00/0x25c454990262d913 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.935022:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9e400/0x25c454990262d90c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8599b expref: 13 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.935040:0:17240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9fe00/0x25c454990262d913 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8599b expref: 12 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639287.935060:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ae242375600) 00010000:00010000:3.0:1788639287.935064:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788639287.935068:0:17240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f9fe00, rc 0) 00000100:00100000:3.0:1788639287.935128:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64907637-38d0-4ad4-9e99-06074f162345+12:15627:x1875523754129024:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 343us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639287.935145:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 35 00000100:00100000:0.0:1788639287.939104:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639287.939285:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754129152 00000100:00100000:1.0:1788639287.939295:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754129152 00000100:00100000:1.0:1788639287.939350:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 3 00000100:00100000:1.0:1788639287.939360:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244035f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64907637-38d0-4ad4-9e99-06074f162345+12:15627:x1875523754129152:12345-192.168.206.18@tcp:37:lfs.0 00000100:00100000:0.0:1788639287.944816:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244035f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64907637-38d0-4ad4-9e99-06074f162345+12:15627:x1875523754129152:12345-192.168.206.18@tcp:37:lfs.0 Request processed in 5447us (5767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639287.944830:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 3 00000100:00100000:2.0:1788639287.949025:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639287.949312:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754129408 00000100:00100000:0.0:1788639287.949322:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754129408 00000100:00100000:0.0:1788639287.949378:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 4 00000100:00100000:0.0:1788639287.949388:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae376f84850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64907637-38d0-4ad4-9e99-06074f162345+12:15627:x1875523754129408:12345-192.168.206.18@tcp:35:lfs.0 00000100:00100000:0.0:1788639287.949648:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae376f84850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64907637-38d0-4ad4-9e99-06074f162345+13:15627:x1875523754129408:12345-192.168.206.18@tcp:35:lfs.0 Request processed in 229us (598us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788639287.949656:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 4 00000040:00080000:0.0:1788639287.989527:0:17279:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788639287.990023:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae380295180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773082752:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788639287.990100:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639287.990847:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773082752 00000100:00100000:3.0:1788639287.990856:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773082752 00000100:00100000:3.0:1788639287.990910:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788639287.990919:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523773082752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788639287.990950:0:18751:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788639287.991007:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875523773082752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639287.991014:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788639287.991068:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae380295180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875523773082752:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788639287.995162:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639287.995369:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754129536 00000100:00100000:0.0:1788639287.995378:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754129536 00000100:00100000:2.0:1788639287.995500:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 36 00000100:00100000:2.0:1788639287.995510:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f164030-9448-43be-b8f2-64db35b5d669+11:15633:x1875523754129536:12345-192.168.206.18@tcp:101:bash.0 00010000:00010000:2.0:1788639287.995530:0:17242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639287.995557:0:17242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22800/0x25c454990262d91a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e859a2 expref: -99 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.995649:0:17242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22400/0x25c454990262d921 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.995664:0:17242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22400/0x25c454990262d921 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.995676:0:17242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22400/0x25c454990262d921 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.995687:0:17242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22200/0x25c454990262d928 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.995707:0:17242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22200/0x25c454990262d928 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.995713:0:17242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22200/0x25c454990262d928 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.995787:0:17242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22600/0x25c454990262d92f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.995801:0:17242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22600/0x25c454990262d92f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.995810:0:17242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22600/0x25c454990262d92f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788639287.995842:0:17242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788639287.995846:0:17242:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788639287.996271:0:17242:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22600/0x25c454990262d92f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.996285:0:17242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22400/0x25c454990262d921 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.996292:0:17242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22400/0x25c454990262d921 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.996299:0:17242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22400/0x25c454990262d921 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.996305:0:17242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f22400 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639287.996417:0:17242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22400/0x25c454990262d921 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.996432:0:17242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22400/0x25c454990262d921 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.996443:0:17242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae242376b00) 00010000:00010000:2.0:1788639287.996446:0:17242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639287.996450:0:17242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22400/0x25c454990262d921 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.996460:0:17242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22400/0x25c454990262d921 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.996472:0:17242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22200/0x25c454990262d928 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.996478:0:17242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22200/0x25c454990262d928 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.996483:0:17242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22200/0x25c454990262d928 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.996488:0:17242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f22200 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:2.0:1788639287.996490:0:17242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22200/0x25c454990262d928 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.996495:0:17242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22200/0x25c454990262d928 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.996500:0:17242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ae242358200) 00010000:00010000:2.0:1788639287.996502:0:17242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788639287.996505:0:17242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22200/0x25c454990262d928 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.996772:0:17242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22200/0x25c454990262d928 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.996803:0:17242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22800/0x25c454990262d91a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859a2 expref: 13 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.996816:0:17242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22600/0x25c454990262d92f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859a2 expref: 12 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639287.996824:0:17242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ae242375600) 00010000:00010000:2.0:1788639287.996826:0:17242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788639287.996829:0:17242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f22600, rc 0) 00000100:00100000:2.0:1788639287.996896:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f164030-9448-43be-b8f2-64db35b5d669+12:15633:x1875523754129536:12345-192.168.206.18@tcp:101:bash.0 Request processed in 1387us (1746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639287.996904:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 36 00000100:00100000:3.0:1788639288.000588:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639288.001297:0:17252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754129664 00000100:00100000:1.0:1788639288.001308:0:17252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754129664 00000100:00100000:1.0:1788639288.001400:0:17252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 7 00000100:00100000:1.0:1788639288.001411:0:17252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae380295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5f164030-9448-43be-b8f2-64db35b5d669+5:15633:x1875523754129664:12345-192.168.206.18@tcp:900:bash.0 00000100:00100000:1.0:1788639288.001487:0:17252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae380295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5f164030-9448-43be-b8f2-64db35b5d669+5:15633:x1875523754129664:12345-192.168.206.18@tcp:900:bash.0 Request processed in 78us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639288.001495:0:17252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 7 00000100:00100000:1.0:1788639288.006611:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639288.007816:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754129920 00000100:00100000:0.0:1788639288.007830:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754129920 00000100:00100000:0.0:1788639288.007899:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 37 00000100:00100000:0.0:1788639288.007910:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae374872680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f164030-9448-43be-b8f2-64db35b5d669+12:15633:x1875523754129920:12345-192.168.206.18@tcp:101:bash.0 00010000:00010000:0.0:1788639288.008170:0:18565:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639288.008205:0:18565:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd400/0x25c454990262d936 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e859a9 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.008311:0:18565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262d93d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.008496:0:18565:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9fe00/0x25c454990262d913 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8599b expref: 12 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.008506:0:18565:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262d93d lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.008558:0:18565:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9fe00/0x25c454990262d913 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8599b expref: 12 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.008573:0:18565:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9fe00/0x25c454990262d913 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8599b expref: 12 pid: 17240 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639288.008586:0:18565:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244035f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18565:1875523773082880:192.168.206.18@tcp:104: 00000100:00100000:0.0:1788639288.008693:0:18565:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36a011a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788639288.014144:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639288.014242:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754130048 00000100:00100000:1.0:1788639288.014251:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754130048 00010000:00010000:1.0:1788639288.014292:0:17226:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9fe00/0x25c454990262d913 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8599b expref: 13 pid: 17240 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639288.014369:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 16 00000100:00100000:1.0:1788639288.014380:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243b14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64907637-38d0-4ad4-9e99-06074f162345+13:2408:x1875523754130048:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788639288.014405:0:17226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788639288.014413:0:17226:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9fe00/0x25c454990262d913 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8599b expref: 13 pid: 17240 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639288.014427:0:17226:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9fe00/0x25c454990262d913 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8599b expref: 13 pid: 17240 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639288.014449:0:17226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ae242375600) 00010000:00010000:1.0:1788639288.014455:0:17226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262d93d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639288.014465:0:17226:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262d93d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639288.014473:0:17226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262d93d lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639288.014494:0:17226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788639288.014558:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243b14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64907637-38d0-4ad4-9e99-06074f162345+13:2408:x1875523754130048:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 180us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639288.014565:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 16 00010000:00010000:0.0:1788639288.015656:0:18565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9fe00/0x25c454990262d913 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e8599b expref: 12 pid: 17240 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639288.015679:0:18565:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244035f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18565:1875523773082880:192.168.206.18@tcp:104: 00010000:00010000:0.0:1788639288.015711:0:18565:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262d93d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.015721:0:18565:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262d93d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.015726:0:18565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262d93d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.015756:0:18565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc600/0x25c454990262d944 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.015767:0:18565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc600/0x25c454990262d944 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.015776:0:18565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc600/0x25c454990262d944 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.016578:0:18565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd000/0x25c454990262d94b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.016591:0:18565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd000/0x25c454990262d94b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.016600:0:18565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd000/0x25c454990262d94b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788639288.016611:0:18565:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788639288.016667:0:18565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262d93d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.016676:0:18565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262d93d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.016697:0:18565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262d93d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.016703:0:18565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3748dca00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639288.016708:0:18565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262d93d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.016716:0:18565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262d93d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.016729:0:18565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ae242375600) 00010000:00010000:0.0:1788639288.016732:0:18565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639288.016736:0:18565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262d93d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.016742:0:18565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262d93d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788639288.016753:0:18565:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e7b2b758 reply state 000000004ae1597f transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc600/0x25c454990262d944 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.016764:0:18565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc600/0x25c454990262d944 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.016770:0:18565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9ae242376d00) 00010000:00010000:0.0:1788639288.016772:0:18565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788639288.016775:0:18565:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788639288.016808:0:18565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd400/0x25c454990262d936 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859a9 expref: 15 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.016822:0:18565:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd000/0x25c454990262d94b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859a9 expref: 14 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.016835:0:18565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae242376300) 00010000:00010000:0.0:1788639288.016838:0:18565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788639288.016840:0:18565:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3748dd000, rc 0) 00000100:00100000:0.0:1788639288.016905:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae374872680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f164030-9448-43be-b8f2-64db35b5d669+15:15633:x1875523754129920:12345-192.168.206.18@tcp:101:bash.0 Request processed in 8996us (10302us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788639288.016913:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 37 00000100:00100000:2.0:1788639288.035000:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639288.035473:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754130176 00000100:00100000:0.0:1788639288.035484:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754130176 00000100:00100000:0.0:1788639288.035588:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 38 00000100:00100000:0.0:1788639288.035600:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243152d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f164030-9448-43be-b8f2-64db35b5d669+15:15633:x1875523754130176:12345-192.168.206.18@tcp:101:bash.0 00010000:00010000:0.0:1788639288.035671:0:17241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639288.035693:0:17241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd400/0x25c454990262d959 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e859b0 expref: -99 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.035757:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262d960 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.035771:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262d960 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.035784:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262d960 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788639288.035829:0:17241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788639288.035833:0:17241:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788639288.035853:0:17241:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262d960 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.035885:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262d960 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.035911:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd400/0x25c454990262d959 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859b0 expref: 17 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.036325:0:17241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262d960 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859b0 expref: 16 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.036336:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae242376300) 00010000:00010000:0.0:1788639288.036339:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788639288.036343:0:17241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3748dca00, rc 0) 00000100:00100000:0.0:1788639288.036410:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243152d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f164030-9448-43be-b8f2-64db35b5d669+16:15633:x1875523754130176:12345-192.168.206.18@tcp:101:bash.0 Request processed in 812us (1420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639288.036418:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 38 00000100:00100000:3.0:1788639288.043215:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639288.043325:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754130432 00000100:00100000:1.0:1788639288.043335:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754130432 00000100:00100000:1.0:1788639288.043399:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 5 00000100:00100000:1.0:1788639288.043410:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae380296a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f164030-9448-43be-b8f2-64db35b5d669+16:15633:x1875523754130432:12345-192.168.206.18@tcp:35:bash.0 00000100:00100000:1.0:1788639288.043716:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae380296a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f164030-9448-43be-b8f2-64db35b5d669+17:15633:x1875523754130432:12345-192.168.206.18@tcp:35:bash.0 Request processed in 307us (509us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1788639288.043723:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 5 00000100:00100000:3.0:1788639288.167483:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639288.167676:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754130688 00000100:00100000:0.0:1788639288.167687:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754130688 00000100:00100000:0.0:1788639288.167809:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 39 00000100:00100000:0.0:1788639288.167820:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae380297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f164030-9448-43be-b8f2-64db35b5d669+17:15643:x1875523754130688:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:0.0:1788639288.167841:0:17240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639288.167872:0:17240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd400/0x25c454990262d967 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e859b7 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788639288.167966:0:17240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788639288.168057:0:17240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd400/0x25c454990262d967 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859b7 expref: 19 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.168228:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ae242376b00) 00010000:00010000:0.0:1788639288.168234:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788639288.168241:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd400/0x25c454990262d967 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859b7 expref: 19 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.168256:0:17240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3748dd400, rc 0) 00000100:00100000:0.0:1788639288.168315:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae380297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f164030-9448-43be-b8f2-64db35b5d669+18:15643:x1875523754130688:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 497us (840us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1788639288.168322:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 39 00000100:00100000:1.0:1788639288.173593:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639288.173918:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754130944 00000100:00100000:0.0:1788639288.173929:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754130944 00000100:00100000:0.0:1788639288.174172:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 6 00000100:00100000:0.0:1788639288.174183:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae374871c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f164030-9448-43be-b8f2-64db35b5d669+18:15643:x1875523754130944:12345-192.168.206.18@tcp:35:lfs.0 00000100:00100000:0.0:1788639288.174425:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae374871c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f164030-9448-43be-b8f2-64db35b5d669+19:15643:x1875523754130944:12345-192.168.206.18@tcp:35:lfs.0 Request processed in 243us (849us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788639288.174432:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 6 00000100:00100000:3.0:1788639288.248326:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639288.248444:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754131200 00000100:00100000:2.0:1788639288.248454:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754131200 00000100:00100000:2.0:1788639288.248516:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 40 00000100:00100000:2.0:1788639288.248527:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae380295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f164030-9448-43be-b8f2-64db35b5d669+19:15646:x1875523754131200:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:2.0:1788639288.248561:0:17242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639288.248584:0:17242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22800/0x25c454990262d975 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e859be expref: -99 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639288.248715:0:17242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22200/0x25c454990262d97c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639288.248742:0:17242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22200/0x25c454990262d97c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639288.248757:0:17242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22200/0x25c454990262d97c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788639288.248770:0:17242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788639288.248889:0:17242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22800/0x25c454990262d975 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859be expref: 22 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639288.248908:0:17242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22200/0x25c454990262d97c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859be expref: 21 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639288.248917:0:17242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae242376300) 00010000:00010000:2.0:1788639288.248920:0:17242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788639288.248923:0:17242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f22200, rc 0) 00000100:00100000:2.0:1788639288.248976:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae380295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f164030-9448-43be-b8f2-64db35b5d669+21:15646:x1875523754131200:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 451us (660us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788639288.248983:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 40 00000100:00100000:1.0:1788639288.257085:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639288.257187:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754131328 00000100:00100000:0.0:1788639288.257197:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754131328 00000100:00100000:0.0:1788639288.257260:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 41 00000100:00100000:0.0:1788639288.257282:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae374873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f164030-9448-43be-b8f2-64db35b5d669+21:15646:x1875523754131328:12345-192.168.206.18@tcp:54:lfs.0 00010000:00010000:0.0:1788639288.257347:0:18565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd400/0x25c454990262d98a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.257381:0:18565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd400/0x25c454990262d98a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.257411:0:18565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd400/0x25c454990262d98a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.257447:0:18565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd400/0x25c454990262d98a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.257454:0:18565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd400/0x25c454990262d98a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.257461:0:18565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd400/0x25c454990262d98a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.257467:0:18565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3748dd400 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639288.257471:0:18565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd400/0x25c454990262d98a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.257479:0:18565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd400/0x25c454990262d98a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.257490:0:18565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae242376300) 00010000:00010000:0.0:1788639288.257493:0:18565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788639288.257498:0:18565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd400/0x25c454990262d98a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.257504:0:18565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd400/0x25c454990262d98a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639288.257599:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae374873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f164030-9448-43be-b8f2-64db35b5d669+21:15646:x1875523754131328:12345-192.168.206.18@tcp:54:lfs.0 Request processed in 329us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639288.257606:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 41 00000100:00100000:1.0:1788639288.262310:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639288.262677:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754131456 00000100:00100000:3.0:1788639288.262687:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754131456 00000100:00100000:3.0:1788639288.262751:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 0 00000100:00100000:3.0:1788639288.262761:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae374870380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f164030-9448-43be-b8f2-64db35b5d669+21:2408:x1875523754131456:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788639288.262776:0:17227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639288.262802:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22200/0x25c454990262d97c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859be expref: 21 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639288.262820:0:17227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae242376300) 00010000:00010000:3.0:1788639288.262825:0:17227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639288.262879:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae374870380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f164030-9448-43be-b8f2-64db35b5d669+20:2408:x1875523754131456:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 119us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639288.262899:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 0 00000100:00100000:3.0:1788639288.263818:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639288.263903:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754131712 00000100:00100000:3.0:1788639288.263910:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754131712 00000100:00100000:3.0:1788639288.263946:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 7 00000100:00100000:3.0:1788639288.263955:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f164030-9448-43be-b8f2-64db35b5d669+20:15646:x1875523754131712:12345-192.168.206.18@tcp:35:lfs.0 00000100:00100000:3.0:1788639288.266799:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f164030-9448-43be-b8f2-64db35b5d669+21:15646:x1875523754131712:12345-192.168.206.18@tcp:35:lfs.0 Request processed in 2624us (2764us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1788639288.266813:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 7 00000100:00100000:3.0:1788639288.290116:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639288.290159:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639288.290192:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639288.290223:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639288.290248:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639288.290250:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754132096 00000100:00100000:0.0:1788639288.290260:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754132096 00000100:00100000:3.0:1788639288.290266:0:19077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754132352 00000100:00100000:3.0:1788639288.290269:0:19077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754132352 00000100:00100000:1.0:1788639288.290334:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754131968 00000100:00100000:1.0:1788639288.290339:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754131968 00000100:00100000:2.0:1788639288.290396:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754131840 00000100:00100000:2.0:1788639288.290400:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754131840 00000100:00100000:2.0:1788639288.290441:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 164 00000100:00100000:2.0:1788639288.290450:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae37f79e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+13:2407:x1875523754131840:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788639288.290515:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae37f79e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:275bd2a8-d41f-46f3-a45e-0fd5ecc7f6d3+13:2407:x1875523754131840:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 66us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639288.290522:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 164 00000100:00100000:0.0:1788639288.290590:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754132224 00000100:00100000:0.0:1788639288.290594:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754132224 00000100:00100000:3.0:1788639288.291703:0:19077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 19 00000100:00100000:3.0:1788639288.291714:0:19077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f164030-9448-43be-b8f2-64db35b5d669+5:2407:x1875523754132096:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639288.291770:0:19077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f164030-9448-43be-b8f2-64db35b5d669+5:2407:x1875523754132096:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 58us (1610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639288.291778:0:19077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 19 00000100:00100000:3.0:1788639288.291795:0:19077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 20 00000100:00100000:3.0:1788639288.291802:0:19077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64907637-38d0-4ad4-9e99-06074f162345+5:2407:x1875523754132352:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788639288.291827:0:19077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64907637-38d0-4ad4-9e99-06074f162345+5:2407:x1875523754132352:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 26us (1635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639288.291862:0:19077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 20 00000100:00100000:1.0:1788639288.296719:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 21 00000100:00100000:1.0:1788639288.296738:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f164030-9448-43be-b8f2-64db35b5d669+5:2407:x1875523754131968:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:1.0:1788639288.296816:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f164030-9448-43be-b8f2-64db35b5d669+5:2407:x1875523754131968:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 86us (6592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639288.296823:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 21 00000100:00080000:2.0:1788639288.303029:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788639288.303062:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788639288.303251:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 22 00000100:00100000:0.0:1788639288.303263:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64907637-38d0-4ad4-9e99-06074f162345+5:2407:x1875523754132224:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788639288.303346:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64907637-38d0-4ad4-9e99-06074f162345+5:2407:x1875523754132224:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 84us (13096us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639288.303353:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 22 00010000:00010000:2.0:1788639288.631965:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788639288.672423:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639288.672532:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754132608 00000100:00100000:2.0:1788639288.672552:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754132608 00000100:00100000:2.0:1788639288.672611:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 42 00000100:00100000:2.0:1788639288.672651:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f164030-9448-43be-b8f2-64db35b5d669+21:15677:x1875523754132608:12345-192.168.206.18@tcp:101:cat.0 00010000:00010000:2.0:1788639288.672672:0:17242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788639288.672692:0:17242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22400/0x25c454990262d991 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e859c5 expref: -99 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639288.672793:0:17242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23c00/0x25c454990262d998 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639288.672808:0:17242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23c00/0x25c454990262d998 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639288.672819:0:17242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23c00/0x25c454990262d998 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788639288.672830:0:17242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788639288.672944:0:17242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f22400/0x25c454990262d991 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859c5 expref: 24 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639288.672962:0:17242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23c00/0x25c454990262d998 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859c5 expref: 23 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639288.672970:0:17242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae242376300) 00010000:00010000:2.0:1788639288.672973:0:17242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788639288.672976:0:17242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f23c00, rc 0) 00000100:00100000:2.0:1788639288.673033:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f164030-9448-43be-b8f2-64db35b5d669+23:15677:x1875523754132608:12345-192.168.206.18@tcp:101:cat.0 Request processed in 385us (619us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1788639288.673052:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 42 00000100:00100000:2.0:1788639288.679502:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639288.679559:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639288.679656:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754132992 00000100:00100000:1.0:1788639288.679666:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754132992 00000100:00100000:1.0:1788639288.679725:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 8 00000100:00100000:1.0:1788639288.679736:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f164030-9448-43be-b8f2-64db35b5d669+23:15677:x1875523754132992:12345-192.168.206.18@tcp:35:cat.0 00000100:00100000:1.0:1788639288.680005:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f164030-9448-43be-b8f2-64db35b5d669+24:15677:x1875523754132992:12345-192.168.206.18@tcp:35:cat.0 Request processed in 269us (443us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1788639288.680013:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 8 00000100:00100000:0.0:1788639288.680091:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754132736 00000100:00100000:0.0:1788639288.680096:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754132736 00000100:00100000:0.0:1788639288.680139:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 1 00000100:00100000:0.0:1788639288.680146:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243150a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f164030-9448-43be-b8f2-64db35b5d669+24:2408:x1875523754132736:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788639288.680156:0:17228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788639288.680178:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23c00/0x25c454990262d998 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859c5 expref: 24 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.680194:0:17228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae242376300) 00010000:00010000:0.0:1788639288.680198:0:17228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788639288.680220:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243150a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f164030-9448-43be-b8f2-64db35b5d669+23:2408:x1875523754132736:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 76us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639288.680227:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 1 00000040:00080000:3.0:1788639288.694455:0:17999:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788639288.763841:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639288.764561:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754133248 00000100:00100000:0.0:1788639288.764572:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754133248 00000100:00100000:0.0:1788639288.764667:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 43 00000100:00100000:0.0:1788639288.764678:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f164030-9448-43be-b8f2-64db35b5d669+23:15683:x1875523754133248:12345-192.168.206.18@tcp:101:dd.0 00010000:00010000:0.0:1788639288.764702:0:18565:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639288.764737:0:18565:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd400/0x25c454990262d9a6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e859cc expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.764837:0:18565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dde00/0x25c454990262d9ad lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.764853:0:18565:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd000/0x25c454990262d94b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859a9 expref: 24 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.764861:0:18565:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262d960 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859b0 expref: 24 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.764870:0:18565:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dde00/0x25c454990262d9ad lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.764915:0:18565:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262d960 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859b0 expref: 24 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.764929:0:18565:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262d960 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859b0 expref: 24 pid: 17241 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639288.764943:0:18565:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244035f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18565:1875523773083008:192.168.206.18@tcp:104: 00010000:00010000:0.0:1788639288.765179:0:18565:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd000/0x25c454990262d94b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859a9 expref: 24 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.765190:0:18565:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd000/0x25c454990262d94b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859a9 expref: 24 pid: 18565 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639288.765200:0:18565:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244035500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18565:1875523773083136:192.168.206.18@tcp:104: 00000100:00100000:0.0:1788639288.765235:0:18565:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae36a011f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788639288.771033:0:18565:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244035f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18565:1875523773083008:192.168.206.18@tcp:104: 00000100:00100000:0.0:1788639288.771051:0:18565:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244035500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18565:1875523773083136:192.168.206.18@tcp:104: 00010000:00010000:0.0:1788639288.771075:0:18565:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dde00/0x25c454990262d9ad lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639288.773412:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639288.773595:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754133376 00000100:00100000:1.0:1788639288.773605:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754133376 00010000:00010000:1.0:1788639288.773678:0:17226:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262d960 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859b0 expref: 25 pid: 17241 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639288.773721:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 17 00000100:00100000:1.0:1788639288.773743:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f164030-9448-43be-b8f2-64db35b5d669+25:2407:x1875523754133376:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788639288.773757:0:17226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788639288.773765:0:17226:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262d960 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859b0 expref: 25 pid: 17241 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639288.773780:0:17226:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262d960 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859b0 expref: 25 pid: 17241 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639288.773801:0:17226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dca00/0x25c454990262d960 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859b0 expref: 25 pid: 17241 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639288.773820:0:17226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae242376300) 00010000:00010000:1.0:1788639288.773824:0:17226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dde00/0x25c454990262d9ad lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639288.773833:0:17226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dde00/0x25c454990262d9ad lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639288.773839:0:17226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788639288.773907:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f164030-9448-43be-b8f2-64db35b5d669+24:2407:x1875523754133376:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 165us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639288.773915:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 17 00000100:00100000:2.0:1788639288.782579:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639288.782965:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754133504 00000100:00100000:1.0:1788639288.782975:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754133504 00010000:00010000:1.0:1788639288.783015:0:17227:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd000/0x25c454990262d94b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859a9 expref: 24 pid: 18565 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639288.783062:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 18 00000100:00100000:1.0:1788639288.783087:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3820c3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f164030-9448-43be-b8f2-64db35b5d669+24:2407:x1875523754133504:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788639288.783101:0:17227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788639288.783108:0:17227:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd000/0x25c454990262d94b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859a9 expref: 24 pid: 18565 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639288.783121:0:17227:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd000/0x25c454990262d94b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859a9 expref: 24 pid: 18565 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639288.783142:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd000/0x25c454990262d94b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859a9 expref: 24 pid: 18565 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639288.783158:0:17227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae242376300) 00010000:00010000:1.0:1788639288.783162:0:17227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dde00/0x25c454990262d9ad lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639288.783171:0:17227:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dde00/0x25c454990262d9ad lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639288.783178:0:17227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dde00/0x25c454990262d9ad lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639288.783212:0:17227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788639288.783267:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3820c3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f164030-9448-43be-b8f2-64db35b5d669+23:2407:x1875523754133504:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 181us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639288.783274:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 18 00010000:00010000:0.0:1788639288.783366:0:18565:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dde00/0x25c454990262d9ad lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.783375:0:18565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dde00/0x25c454990262d9ad lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788639288.783393:0:18565:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788639288.783528:0:18565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd400/0x25c454990262d9a6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859cc expref: 24 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.783555:0:18565:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dde00/0x25c454990262d9ad lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859cc expref: 23 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.783563:0:18565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae242376300) 00010000:00010000:0.0:1788639288.783566:0:18565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788639288.783568:0:18565:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3748dde00, rc 0) 00000100:00100000:0.0:1788639288.783609:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f164030-9448-43be-b8f2-64db35b5d669+23:15683:x1875523754133248:12345-192.168.206.18@tcp:101:dd.0 Request processed in 18934us (19776us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1788639288.783655:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 43 00000100:00100000:2.0:1788639288.788074:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639288.791457:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754133632 00000100:00100000:1.0:1788639288.791471:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754133632 00000100:00100000:1.0:1788639288.791603:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 44 00000100:00100000:1.0:1788639288.791629:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f164030-9448-43be-b8f2-64db35b5d669+23:15683:x1875523754133632:12345-192.168.206.18@tcp:101:dd.0 00010000:00010000:1.0:1788639288.791668:0:17242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639288.791689:0:17242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262d9bb lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e859d3 expref: -99 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639288.791724:0:17242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262d9c2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639288.791737:0:17242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262d9c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639288.791748:0:17242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262d9c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639288.791854:0:17242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262d9bb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859d3 expref: 25 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639288.791872:0:17242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262d9c2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859d3 expref: 24 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639288.791891:0:17242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae242376300) 00010000:00010000:1.0:1788639288.791894:0:17242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788639288.791898:0:17242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fb600, rc 0) 00000100:00100000:1.0:1788639288.791964:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f164030-9448-43be-b8f2-64db35b5d669+24:15683:x1875523754133632:12345-192.168.206.18@tcp:101:dd.0 Request processed in 352us (3899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639288.791971:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 44 00000100:00100000:2.0:1788639288.805992:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639288.806073:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754133888 00000100:00100000:3.0:1788639288.806082:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754133888 00000100:00100000:3.0:1788639288.806147:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 45 00000100:00100000:3.0:1788639288.806156:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f164030-9448-43be-b8f2-64db35b5d669+24:15683:x1875523754133888:12345-192.168.206.18@tcp:36:dd.0 00010000:00010000:3.0:1788639288.806355:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9f000/0x25c454990262d9c9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639288.806372:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9f000/0x25c454990262d9c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639288.806383:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9f000/0x25c454990262d9c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788639288.806419:0:17240:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1788639288.806606:0:17240:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e37c8b74 reply state 00000000264dde1a transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9f000/0x25c454990262d9c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639288.806650:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9f000/0x25c454990262d9c9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639288.806657:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae242376300) 00010000:00010000:3.0:1788639288.806660:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788639288.806663:0:17240:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788639288.806747:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f164030-9448-43be-b8f2-64db35b5d669+27:15683:x1875523754133888:12345-192.168.206.18@tcp:36:dd.0 Request processed in 592us (764us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1788639288.806768:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 45 00000020:00080000:3.0:1788639288.806772:0:17240:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788639288.813991:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639288.814366:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754134016 00000100:00100000:1.0:1788639288.814376:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754134016 00000100:00100000:1.0:1788639288.814438:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 46 00000100:00100000:1.0:1788639288.814448:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243152680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f164030-9448-43be-b8f2-64db35b5d669+27:15683:x1875523754134016:12345-192.168.206.18@tcp:101:dd.0 00010000:00010000:1.0:1788639288.814484:0:17241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639288.814504:0:17241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262d9d0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e859da expref: -99 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639288.814570:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262d9d0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859da expref: 28 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639288.814585:0:17241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262d9d0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859da expref: 28 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639288.814603:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae242376300) 00010000:00010000:1.0:1788639288.814606:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788639288.814610:0:17241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fb400, rc 0) 00000100:00100000:1.0:1788639288.814705:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243152680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f164030-9448-43be-b8f2-64db35b5d669+28:15683:x1875523754134016:12345-192.168.206.18@tcp:101:dd.0 Request processed in 258us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639288.814712:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 46 00000100:00100000:2.0:1788639288.843902:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639288.844204:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754134272 00000100:00100000:0.0:1788639288.844214:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754134272 00000100:00100000:0.0:1788639288.846306:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 2 00000100:00100000:0.0:1788639288.846341:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243151c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f164030-9448-43be-b8f2-64db35b5d669+28:15683:x1875523754134272:12345-192.168.206.18@tcp:103:dd.0 00010000:00010000:0.0:1788639288.846359:0:17228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788639288.846396:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262d9d0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859da expref: 28 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.846416:0:17228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae242376300) 00010000:00010000:0.0:1788639288.846421:0:17228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788639288.846482:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243151c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f164030-9448-43be-b8f2-64db35b5d669+27:15683:x1875523754134272:12345-192.168.206.18@tcp:103:dd.0 Request processed in 149us (2587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639288.846489:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 2 00000100:00100000:2.0:1788639288.851412:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639288.851501:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754134400 00000100:00100000:0.0:1788639288.851510:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754134400 00000100:00100000:0.0:1788639288.851583:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 47 00000100:00100000:0.0:1788639288.851593:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243151180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f164030-9448-43be-b8f2-64db35b5d669+27:15683:x1875523754134400:12345-192.168.206.18@tcp:58:dd.0 00010000:00010000:0.0:1788639288.851741:0:18565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd400/0x25c454990262d9d7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.851758:0:18565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd400/0x25c454990262d9d7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639288.851769:0:18565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd400/0x25c454990262d9d7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788639288.855564:0:18565:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788639288.855603:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1788639288.855809:0:18565:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1788639288.855923:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243151180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f164030-9448-43be-b8f2-64db35b5d669+27:15683:x1875523754134400:12345-192.168.206.18@tcp:58:dd.0 Request processed in 4318us (4505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639288.855934:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 47 00000100:00100000:2.0:1788639288.859661:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639288.859813:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754134528 00000100:00100000:1.0:1788639288.859823:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754134528 00000100:00100000:1.0:1788639288.859891:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 48 00000100:00100000:1.0:1788639288.859901:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243151880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f164030-9448-43be-b8f2-64db35b5d669+27:15683:x1875523754134528:12345-192.168.206.18@tcp:101:dd.0 00010000:00010000:1.0:1788639288.859922:0:17242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639288.859942:0:17242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb200/0x25c454990262d9de lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e859e1 expref: -99 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639288.860005:0:17242:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd400/0x25c454990262d9d7 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639288.860020:0:17242:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb200/0x25c454990262d9de lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859e1 expref: 28 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639288.860053:0:17242:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd400/0x25c454990262d9d7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639288.860068:0:17242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb200/0x25c454990262d9de lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859e1 expref: 28 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639288.860082:0:17242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae242376300) 00010000:00010000:1.0:1788639288.860084:0:17242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788639288.860088:0:17242:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb200/0x25c454990262d9de lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859e1 expref: 28 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639288.860097:0:17242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3750fb200, rc 0) 00000100:00100000:1.0:1788639288.860155:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243151880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f164030-9448-43be-b8f2-64db35b5d669+28:15683:x1875523754134528:12345-192.168.206.18@tcp:101:dd.0 Request processed in 256us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639288.860162:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 48 00000040:00080000:2.0:1788639289.013324:0:17279:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788639289.013332:0:17279:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788639289.013370:0:17279:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788639289.013378:0:17279:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788639289.013510:0:17279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243153b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17279:1875523773083264:192.168.206.18@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788639289.013605:0:17279:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae370ec96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788639289.018980:0:17279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243153b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17279:1875523773083264:192.168.206.18@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788639289.022581:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639289.023034:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754134656 00000100:00100000:0.0:1788639289.023053:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754134656 00000100:00100000:0.0:1788639289.023128:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 49 00000100:00100000:0.0:1788639289.023138:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f164030-9448-43be-b8f2-64db35b5d669+28:15684:x1875523754134656:12345-192.168.206.18@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788639289.023164:0:17240:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788639289.023271:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f164030-9448-43be-b8f2-64db35b5d669+28:15684:x1875523754134656:12345-192.168.206.18@tcp:53:lhsmtool_posix.0 Request processed in 134us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639289.023279:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 49 00000100:00080000:2.0:1788639289.025221:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788639289.031352:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639289.031781:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754134784 00000100:00100000:0.0:1788639289.031790:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754134784 00000100:00100000:0.0:1788639289.031856:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 50 00000100:00100000:0.0:1788639289.031868:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243153800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f164030-9448-43be-b8f2-64db35b5d669+28:15684:x1875523754134784:12345-192.168.206.18@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788639289.031936:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748ddc00/0x25c454990262d9e5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.031953:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748ddc00/0x25c454990262d9e5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.031965:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748ddc00/0x25c454990262d9e5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.032044:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dcc00/0x25c454990262d9ec lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.032053:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dcc00/0x25c454990262d9ec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.032059:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dcc00/0x25c454990262d9ec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.032585:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd200/0x25c454990262d9f3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.032598:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd200/0x25c454990262d9f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.032605:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd200/0x25c454990262d9f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788639289.032674:0:17241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788639289.032678:0:17241:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788639289.032693:0:17241:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd200/0x25c454990262d9f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.032703:0:17241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748ddc00/0x25c454990262d9e5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.032709:0:17241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748ddc00/0x25c454990262d9e5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.032715:0:17241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748ddc00/0x25c454990262d9e5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.032722:0:17241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3748ddc00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639289.032725:0:17241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748ddc00/0x25c454990262d9e5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.032733:0:17241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748ddc00/0x25c454990262d9e5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.032743:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ae242375500) 00010000:00010000:0.0:1788639289.032752:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639289.032757:0:17241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748ddc00/0x25c454990262d9e5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.032764:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748ddc00/0x25c454990262d9e5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.032777:0:17241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dcc00/0x25c454990262d9ec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.032783:0:17241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dcc00/0x25c454990262d9ec lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.032789:0:17241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dcc00/0x25c454990262d9ec lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.032794:0:17241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3748dcc00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639289.032797:0:17241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dcc00/0x25c454990262d9ec lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.032803:0:17241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dcc00/0x25c454990262d9ec lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.032811:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9ae242376a00) 00010000:00010000:0.0:1788639289.032813:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639289.032816:0:17241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dcc00/0x25c454990262d9ec lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.032821:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dcc00/0x25c454990262d9ec lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.032836:0:17241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd200/0x25c454990262d9f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.032848:0:17241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd200/0x25c454990262d9f3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.032853:0:17241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd200/0x25c454990262d9f3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.032858:0:17241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3748dd200 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639289.032861:0:17241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd200/0x25c454990262d9f3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.032867:0:17241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd200/0x25c454990262d9f3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.032875:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae242376300) 00010000:00010000:0.0:1788639289.032878:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639289.032880:0:17241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd200/0x25c454990262d9f3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.032885:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd200/0x25c454990262d9f3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639289.032978:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243153800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f164030-9448-43be-b8f2-64db35b5d669+28:15684:x1875523754134784:12345-192.168.206.18@tcp:34:lhsmtool_posix.0 Request processed in 1111us (1633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639289.032987:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 50 00000100:00100000:3.0:1788639289.041355:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639289.041410:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754135040 00000100:00100000:0.0:1788639289.041424:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754135040 00000100:00100000:0.0:1788639289.041558:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 51 00000100:00100000:0.0:1788639289.041568:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f164030-9448-43be-b8f2-64db35b5d669+28:15684:x1875523754135040:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788639289.041587:0:17240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639289.041736:0:17240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc800/0x25c454990262d9fa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e859e8 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.041827:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc200/0x25c454990262da01 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.041840:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc200/0x25c454990262da01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.041850:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc200/0x25c454990262da01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788639289.041860:0:17240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788639289.041932:0:17240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc200/0x25c454990262da01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.041939:0:17240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc200/0x25c454990262da01 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.041944:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc200/0x25c454990262da01 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.041949:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3748dc200 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639289.041953:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc200/0x25c454990262da01 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.041960:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc200/0x25c454990262da01 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.041970:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae242376300) 00010000:00010000:0.0:1788639289.041972:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788639289.041976:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc200/0x25c454990262da01 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.041990:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc200/0x25c454990262da01 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.042045:0:17240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc800/0x25c454990262d9fa lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859e8 expref: 30 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.042054:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ae242375500) 00010000:00010000:0.0:1788639289.042056:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788639289.042060:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc800/0x25c454990262d9fa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859e8 expref: 30 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.042067:0:17240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3748dc800, rc 0) 00000100:00100000:0.0:1788639289.043588:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f164030-9448-43be-b8f2-64db35b5d669+29:15684:x1875523754135040:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 2011us (2232us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1788639289.043599:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 51 00000100:00100000:3.0:1788639289.054756:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639289.056057:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754135168 00000100:00100000:1.0:1788639289.056078:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754135168 00000100:00100000:1.0:1788639289.056338:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 52 00000100:00100000:1.0:1788639289.056349:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f164030-9448-43be-b8f2-64db35b5d669+29:15684:x1875523754135168:12345-192.168.206.18@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788639289.056393:0:17242:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788639289.056524:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f164030-9448-43be-b8f2-64db35b5d669+29:15684:x1875523754135168:12345-192.168.206.18@tcp:53:lhsmtool_posix.0 Request processed in 176us (1776us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639289.058679:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 52 00000100:00100000:2.0:1788639289.071589:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639289.073170:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754135424 00000100:00100000:1.0:1788639289.073183:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754135424 00000100:00100000:1.0:1788639289.073257:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 53 00000100:00100000:1.0:1788639289.073281:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f164030-9448-43be-b8f2-64db35b5d669+29:15684:x1875523754135424:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788639289.073302:0:18565:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639289.073323:0:18565:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262da0f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e859ef expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788639289.073717:0:18565:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =27 00000004:00080000:1.0:1788639289.073724:0:18565:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+27 in llog 00000004:00080000:1.0:1788639289.073743:0:18565:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:1.0:1788639289.073885:0:18565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262da16 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.073900:0:18565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262da16 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.073912:0:18565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262da16 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.073966:0:18565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb400/0x25c454990262da0f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859ef expref: 32 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.073983:0:18565:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262da16 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859ef expref: 31 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.073992:0:18565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ae362514600) 00010000:00010000:1.0:1788639289.073995:0:18565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788639289.073998:0:18565:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f8800, rc 0) 00000100:00100000:1.0:1788639289.074068:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f164030-9448-43be-b8f2-64db35b5d669+31:15684:x1875523754135424:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 789us (2487us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1788639289.074075:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 53 00000100:00100000:3.0:1788639289.086781:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639289.086881:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754135680 00000100:00100000:1.0:1788639289.086892:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754135680 00000100:00100000:1.0:1788639289.086955:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 54 00000100:00100000:1.0:1788639289.086965:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f164030-9448-43be-b8f2-64db35b5d669+31:15684:x1875523754135680:12345-192.168.206.18@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788639289.087017:0:17242:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788639289.087064:0:17242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262da16 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859ef expref: 31 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.087081:0:17242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ae362514600) 00010000:00010000:1.0:1788639289.087458:0:17242:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788639289.087483:0:17242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262da24 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.087498:0:17242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262da24 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.087508:0:17242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262da24 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.087521:0:17242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262da2b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x95f9fe42 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.087528:0:17242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262da2b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x95f9fe42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.087543:0:17242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262da2b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x95f9fe42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.087585:0:17242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262da24 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.087609:0:17242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262da24 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.087863:0:17242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262da24 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.087869:0:17242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f8400 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639289.087873:0:17242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262da24 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.087880:0:17242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262da24 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.087890:0:17242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ae242375600) 00010000:00010000:1.0:1788639289.087892:0:17242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639289.087896:0:17242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262da24 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.087901:0:17242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262da24 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.087911:0:17242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262da2b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x95f9fe42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.087917:0:17242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262da2b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x95f9fe42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.087922:0:17242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262da2b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x95f9fe42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.087926:0:17242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f9600 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639289.087937:0:17242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262da2b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x95f9fe42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.087944:0:17242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262da2b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x95f9fe42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.087951:0:17242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x95f9fe42 (ffff9ae362514900) 00010000:00010000:1.0:1788639289.087954:0:17242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639289.087957:0:17242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262da2b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x95f9fe42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.087961:0:17242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262da2b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x95f9fe42 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639289.088068:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f164030-9448-43be-b8f2-64db35b5d669+30:15684:x1875523754135680:12345-192.168.206.18@tcp:36:lhsmtool_posix.0 Request processed in 1103us (1294us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788639289.088076:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 54 00000100:00100000:3.0:1788639289.093247:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639289.096656:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754135808 00000100:00100000:0.0:1788639289.096671:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754135808 00000100:00100000:0.0:1788639289.096735:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 55 00000100:00100000:0.0:1788639289.096746:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375f36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f164030-9448-43be-b8f2-64db35b5d669+30:15684:x1875523754135808:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788639289.096764:0:17240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639289.096787:0:17240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc800/0x25c454990262da32 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e859f6 expref: -99 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.096823:0:17240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc200/0x25c454990262da39 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.096836:0:17240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc200/0x25c454990262da39 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.096862:0:17240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc200/0x25c454990262da39 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.096972:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc800/0x25c454990262da32 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859f6 expref: 32 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.097454:0:17240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc200/0x25c454990262da39 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859f6 expref: 31 pid: 17240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.097464:0:17240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ae242376a00) 00010000:00010000:0.0:1788639289.097466:0:17240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788639289.097470:0:17240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3748dc200, rc 0) 00000100:00100000:0.0:1788639289.097547:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375f36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f164030-9448-43be-b8f2-64db35b5d669+31:15684:x1875523754135808:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 803us (4309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639289.097554:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 55 00000100:00100000:2.0:1788639289.104335:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639289.104393:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754136064 00000100:00100000:0.0:1788639289.104403:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754136064 00000100:00100000:0.0:1788639289.104464:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 56 00000100:00100000:0.0:1788639289.104474:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243152a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f164030-9448-43be-b8f2-64db35b5d669+31:15684:x1875523754136064:12345-192.168.206.18@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788639289.104563:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc800/0x25c454990262da40 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.104589:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc800/0x25c454990262da40 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.104602:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc800/0x25c454990262da40 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788639289.104799:0:17241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1788639289.104808:0:17241:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 547899191246ns, next at 548899188961ns, rc = 0 00000004:00010000:0.0:1788639289.104851:0:17241:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d130592e reply state 00000000a9e9f572 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc800/0x25c454990262da40 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.104864:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc800/0x25c454990262da40 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.104871:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ae242376a00) 00010000:00010000:0.0:1788639289.104874:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788639289.104878:0:17241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788639289.104964:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243152a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f164030-9448-43be-b8f2-64db35b5d669+33:15684:x1875523754136064:12345-192.168.206.18@tcp:36:lhsmtool_posix.0 Request processed in 491us (638us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1788639289.104971:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 56 00000100:00100000:3.0:1788639289.108919:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639289.109295:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754136192 00000100:00100000:1.0:1788639289.109305:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754136192 00000100:00100000:1.0:1788639289.109374:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 57 00000100:00100000:1.0:1788639289.109384:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f164030-9448-43be-b8f2-64db35b5d669+33:15684:x1875523754136192:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788639289.109408:0:18565:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639289.109428:0:18565:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262da47 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e859fd expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.109485:0:18565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262da47 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859fd expref: 34 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.109501:0:18565:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262da47 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859fd expref: 34 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.109546:0:18565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ae242376a00) 00010000:00010000:1.0:1788639289.109549:0:18565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788639289.109553:0:18565:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f9600, rc 0) 00000100:00100000:1.0:1788639289.109611:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f164030-9448-43be-b8f2-64db35b5d669+34:15684:x1875523754136192:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 229us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639289.109658:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 57 00000100:00100000:3.0:1788639289.119818:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639289.119998:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754136320 00000100:00100000:1.0:1788639289.120008:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754136320 00000100:00100000:1.0:1788639289.120076:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 26 00000100:00100000:1.0:1788639289.120087:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f164030-9448-43be-b8f2-64db35b5d669+5:2407:x1875523754136320:12345-192.168.206.18@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788639289.121611:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f164030-9448-43be-b8f2-64db35b5d669+6:2407:x1875523754136320:12345-192.168.206.18@tcp:2:lhsmtool_posix.0 Request processed in 1517us (1794us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1788639289.121840:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 26 00000100:00100000:2.0:1788639289.125546:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639289.125647:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754136576 00000100:00100000:1.0:1788639289.125658:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754136576 00000100:00100000:1.0:1788639289.125757:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 9 00000100:00100000:1.0:1788639289.125767:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243153b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f164030-9448-43be-b8f2-64db35b5d669+34:15684:x1875523754136576:12345-192.168.206.18@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788639289.125984:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243153b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f164030-9448-43be-b8f2-64db35b5d669+35:15684:x1875523754136576:12345-192.168.206.18@tcp:35:lhsmtool_posix.0 Request processed in 218us (456us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1788639289.125992:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 9 00000100:00100000:3.0:1788639289.135352:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639289.135571:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754136832 00000100:00100000:0.0:1788639289.135580:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754136832 00000100:00100000:0.0:1788639289.135667:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 58 00000100:00100000:0.0:1788639289.135678:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f164030-9448-43be-b8f2-64db35b5d669+35:15684:x1875523754136832:12345-192.168.206.18@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788639289.135772:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f164030-9448-43be-b8f2-64db35b5d669+35:15684:x1875523754136832:12345-192.168.206.18@tcp:57:lhsmtool_posix.0 Request processed in 96us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639289.135780:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 58 00000100:00100000:0.0:1788639289.140592:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639289.140934:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754136960 00000100:00100000:1.0:1788639289.140943:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754136960 00000100:00100000:1.0:1788639289.141012:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 59 00000100:00100000:1.0:1788639289.141023:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244035500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f164030-9448-43be-b8f2-64db35b5d669+35:15684:x1875523754136960:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788639289.141062:0:18565:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639289.141083:0:18565:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262da4e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85a04 expref: -99 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.141145:0:18565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262da55 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.141159:0:18565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262da55 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.141170:0:18565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262da55 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788639289.141212:0:18565:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788639289.141230:0:18565:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262da55 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.141254:0:18565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262da4e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85a04 expref: 37 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.141271:0:18565:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262da55 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85a04 expref: 36 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.141279:0:18565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ae242376a00) 00010000:00010000:1.0:1788639289.141282:0:18565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788639289.141284:0:18565:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f8800, rc 0) 00000100:00100000:1.0:1788639289.146669:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244035500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f164030-9448-43be-b8f2-64db35b5d669+36:15684:x1875523754136960:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 4977us (5413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639289.146684:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 59 00000100:00100000:2.0:1788639289.149761:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639289.149880:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754137088 00000100:00100000:0.0:1788639289.149890:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754137088 00000100:00100000:0.0:1788639289.149943:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 27 00000100:00100000:0.0:1788639289.149954:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243150a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f164030-9448-43be-b8f2-64db35b5d669+6:2408:x1875523754137088:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788639289.150005:0:18749:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788639289.150304:0:18749:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4bbcbd1/0x25c454990262da5c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85a0b expref: -99 pid: 18749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788639289.150328:0:18749:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c7839, blocks: 0x0 00010000:00010000:0.0:1788639289.150346:0:18749:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=547s v=(0 0) 00010000:00010000:0.0:1788639289.150350:0:18749:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788639289.150359:0:18749:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4bbcbd1/0x25c454990262da5c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85a0b expref: 7 pid: 18749 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.150379:0:18749:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b4bbcbd1/0x25c454990262da5c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85a0b expref: 7 pid: 18749 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.150465:0:18749:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae3748dcc00, rc 0) 00000100:00100000:0.0:1788639289.150522:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243150a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f164030-9448-43be-b8f2-64db35b5d669+7:2408:x1875523754137088:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 570us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639289.150529:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 27 00000100:00100000:3.0:1788639289.156235:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639289.156660:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754137344 00000100:00100000:0.0:1788639289.156674:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754137344 00000100:00100000:0.0:1788639289.156751:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 60 00000100:00100000:0.0:1788639289.156765:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f164030-9448-43be-b8f2-64db35b5d669+36:15684:x1875523754137344:12345-192.168.206.18@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788639289.156899:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f164030-9448-43be-b8f2-64db35b5d669+36:15684:x1875523754137344:12345-192.168.206.18@tcp:57:lhsmtool_posix.0 Request processed in 137us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639289.156908:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 60 00000100:00100000:2.0:1788639289.159812:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639289.160567:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754137472 00000100:00100000:0.0:1788639289.160598:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754137472 00000100:00100000:0.0:1788639289.161315:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 61 00000100:00100000:0.0:1788639289.161332:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f164030-9448-43be-b8f2-64db35b5d669+36:15684:x1875523754137472:12345-192.168.206.18@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788639289.164808:0:17221:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1788639289.164831:0:17221:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:0.0:1788639289.164942:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23000/0x25c454990262d895 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.164957:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23000/0x25c454990262d895 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.164966:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23000/0x25c454990262d895 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.164973:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f23000 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639289.164979:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23000/0x25c454990262d895 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.164988:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23000/0x25c454990262d895 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.165009:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ae242358200) 00010000:00010000:0.0:1788639289.165012:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639289.165018:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23000/0x25c454990262d895 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.165024:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f23000/0x25c454990262d895 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.165061:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9ec00/0x25c454990262d89c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.165068:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9ec00/0x25c454990262d89c lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.165089:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9ec00/0x25c454990262d89c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.165094:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9ec00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639289.165098:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9ec00/0x25c454990262d89c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.165105:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9ec00/0x25c454990262d89c lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.165114:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ae242375600) 00010000:00010000:0.0:1788639289.165117:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639289.165120:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9ec00/0x25c454990262d89c lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.165127:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9ec00/0x25c454990262d89c lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.165144:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc600/0x25c454990262d944 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.165150:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc600/0x25c454990262d944 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.165156:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc600/0x25c454990262d944 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.165161:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3748dc600 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639289.165164:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc600/0x25c454990262d944 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.165180:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc600/0x25c454990262d944 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.165189:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9ae242376d00) 00010000:00010000:0.0:1788639289.165192:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639289.165195:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc600/0x25c454990262d944 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.165201:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc600/0x25c454990262d944 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.165218:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9f000/0x25c454990262d9c9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.165224:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9f000/0x25c454990262d9c9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.165230:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9f000/0x25c454990262d9c9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.165235:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f9f000 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639289.165238:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9f000/0x25c454990262d9c9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.165244:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9f000/0x25c454990262d9c9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.165253:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae242376300) 00010000:00010000:0.0:1788639289.165255:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788639289.165258:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9f000/0x25c454990262d9c9 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.165269:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9f000/0x25c454990262d9c9 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.165282:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc800/0x25c454990262da40 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.165288:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc800/0x25c454990262da40 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.165294:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc800/0x25c454990262da40 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.165299:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3748dc800 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639289.165302:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc800/0x25c454990262da40 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.165309:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc800/0x25c454990262da40 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.165317:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ae242376a00) 00010000:00010000:0.0:1788639289.165319:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788639289.165322:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc800/0x25c454990262da40 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.165328:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dc800/0x25c454990262da40 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639289.165665:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375fb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773083392:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788639289.165752:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:1.0:1788639289.166207:0:17221:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:1.0:1788639289.166273:0:19077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773083392 00000100:00100000:1.0:1788639289.166284:0:19077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773083392 00000100:00100000:1.0:1788639289.166355:0:19077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788639289.166368:0:19077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244035f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875523773083392:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1788639289.166821:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262d8e9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639289.166834:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262d8e9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639289.166841:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262d8e9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639289.166847:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3748dda00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:3.0:1788639289.166851:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262d8e9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639289.166860:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262d8e9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639289.166876:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ae242375600) 00010000:00010000:3.0:1788639289.166878:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788639289.166896:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262d8e9 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639289.166902:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dda00/0x25c454990262d8e9 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788639289.167233:0:19077:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788639289.167238:0:19077:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788639289.167241:0:19077:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788639289.167243:0:19077:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788639289 -> 1788639289 00002000:00010000:1.0:1788639289.167246:0:19077:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788639289.168549:0:19077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244035f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3641:x1875523773083392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2165us (2778us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788639289.168565:0:19077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000004:00080000:0.0:1788639289.168645:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ae375fb3100/2, rc 0, transno 8589934596 00000100:00100000:0.0:1788639289.168721:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375fb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875523773083392:0@lo:2:osp-syn-0-0.0 00000100:00080000:1.0:1788639289.168903:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788639289.169103:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f164030-9448-43be-b8f2-64db35b5d669+15:15684:x1875523754137472:12345-192.168.206.18@tcp:44:lhsmtool_posix.0 Request processed in 7773us (9301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639289.169113:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 61 00000100:00100000:2.0:1788639289.172286:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639289.172411:0:18747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754137600 00000100:00100000:3.0:1788639289.172423:0:18747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754137600 00000100:00100000:3.0:1788639289.172557:0:18747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 29 00000100:00100000:3.0:1788639289.172570:0:18747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f164030-9448-43be-b8f2-64db35b5d669+7:2407:x1875523754137600:12345-192.168.206.18@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788639289.172754:0:18747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f164030-9448-43be-b8f2-64db35b5d669+7:2407:x1875523754137600:12345-192.168.206.18@tcp:16:lhsmtool_posix.0 Request processed in 187us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639289.172764:0:18747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 29 00000100:00100000:3.0:1788639289.176970:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639289.177144:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754137856 00000100:00100000:1.0:1788639289.177156:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754137856 00000100:00100000:1.0:1788639289.177233:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 62 00000100:00100000:1.0:1788639289.177244:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f164030-9448-43be-b8f2-64db35b5d669+15:15684:x1875523754137856:12345-192.168.206.18@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788639289.177317:0:17242:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788639289.177352:0:17242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262da55 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85a04 expref: 15 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.177374:0:17242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ae242376a00) 00010000:00010000:1.0:1788639289.177389:0:17242:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788639289.177427:0:17242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262da63 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.177464:0:17242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262da63 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.177476:0:17242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262da63 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788639289.177736:0:17242:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001c8d54f1 reply state 00000000f618e58f transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262da63 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.177751:0:17242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8400/0x25c454990262da63 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.177758:0:17242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ae242376a00) 00010000:00010000:1.0:1788639289.177760:0:17242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788639289.177763:0:17242:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788639289.178009:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f164030-9448-43be-b8f2-64db35b5d669+16:15684:x1875523754137856:12345-192.168.206.18@tcp:36:lhsmtool_posix.0 Request processed in 765us (1052us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1788639289.178017:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 62 00000100:00100000:2.0:1788639289.183925:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639289.184011:0:19077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754137984 00000100:00100000:1.0:1788639289.184024:0:19077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754137984 00000100:00100000:1.0:1788639289.184108:0:19077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 30 00000100:00100000:1.0:1788639289.184121:0:19077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f164030-9448-43be-b8f2-64db35b5d669+7:15684:x1875523754137984:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788639289.184146:0:19077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788639289.184169:0:19077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fc2fbef/0x25c454990262da6a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85a12 expref: -99 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.184213:0:19077:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4bbcbd1/0x25c454990262da5c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85a0b expref: 8 pid: 18749 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.184245:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639289.184250:0:19077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639289.184257:0:19077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fc2fbef/0x25c454990262da6a lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85a12 expref: 8 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.184304:0:19077:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b4bbcbd1/0x25c454990262da5c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85a0b expref: 8 pid: 18749 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.184320:0:19077:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b4bbcbd1/0x25c454990262da5c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85a0b expref: 8 pid: 18749 timeout: 647 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639289.184336:0:19077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae374870380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:19077:1875523773083520:192.168.206.18@tcp:104: 00000100:00100000:1.0:1788639289.184448:0:19077:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae34b331e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788639289.186792:0:19077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae374870380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:19077:1875523773083520:192.168.206.18@tcp:104: 00010000:00010000:1.0:1788639289.186840:0:19077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003fc2fbef/0x25c454990262da6a lrc: 3/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85a12 expref: 8 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.186867:0:19077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae2421f8a00, rc 0) 00000100:00100000:1.0:1788639289.186926:0:19077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f164030-9448-43be-b8f2-64db35b5d669+8:15684:x1875523754137984:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 2809us (3016us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639289.186935:0:19077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 30 00000100:00100000:3.0:1788639289.188781:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639289.188904:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754138112 00000100:00100000:1.0:1788639289.188914:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754138112 00010000:00010000:1.0:1788639289.188974:0:17226:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b4bbcbd1/0x25c454990262da5c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85a0b expref: 8 pid: 18749 timeout: 647 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639289.189065:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 19 00000100:00100000:1.0:1788639289.189078:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f164030-9448-43be-b8f2-64db35b5d669+8:2407:x1875523754138112:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788639289.189105:0:17226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788639289.189138:0:17226:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b4bbcbd1/0x25c454990262da5c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85a0b expref: 8 pid: 18749 timeout: 647 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.189155:0:17226:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b4bbcbd1/0x25c454990262da5c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85a0b expref: 8 pid: 18749 timeout: 647 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.189182:0:17226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4bbcbd1/0x25c454990262da5c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85a0b expref: 8 pid: 18749 timeout: 647 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.189203:0:17226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639289.189208:0:17226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639289.189216:0:17226:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003fc2fbef/0x25c454990262da6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85a12 expref: 7 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.189227:0:17226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fc2fbef/0x25c454990262da6a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85a12 expref: 7 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.189273:0:17226:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003fc2fbef/0x25c454990262da6a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85a12 expref: 7 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639289.189304:0:17226:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae374870380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:17226:1875523773083648:192.168.206.18@tcp:105: 00000100:00100000:1.0:1788639289.189461:0:17226:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae34b331e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788639289.193328:0:17226:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae374870380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:17226:1875523773083648:192.168.206.18@tcp:105: 00010000:00010000:1.0:1788639289.193364:0:17226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788639289.193438:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f164030-9448-43be-b8f2-64db35b5d669+7:2407:x1875523754138112:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 4362us (4668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639289.193451:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 19 00000100:00100000:2.0:1788639289.196250:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639289.196358:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754138240 00000100:00100000:0.0:1788639289.196369:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754138240 00000100:00100000:0.0:1788639289.196442:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 31 00000100:00100000:0.0:1788639289.196454:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f164030-9448-43be-b8f2-64db35b5d669+7:2405:x1875523754138240:12345-192.168.206.18@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788639289.196745:0:18749:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788639289.196750:0:18749:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788639289 00002000:00010000:0.0:1788639289.196753:0:18749:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788639288 00002000:00010000:0.0:1788639289.196755:0:18749:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788639289 -> 1788639289 00002000:00010000:0.0:1788639289.196757:0:18749:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788639289.196828:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f164030-9448-43be-b8f2-64db35b5d669+8:2405:x1875523754138240:12345-192.168.206.18@tcp:2:lhsmtool_posix.0 Request processed in 375us (594us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788639289.196835:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 31 00000100:00100000:3.0:1788639289.199920:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788639289.200051:0:18750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754138368 00000100:00100000:2.0:1788639289.200078:0:18750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754138368 00000100:00100000:2.0:1788639289.200196:0:18750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 32 00000100:00100000:2.0:1788639289.200209:0:18750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f164030-9448-43be-b8f2-64db35b5d669+8:2408:x1875523754138368:12345-192.168.206.18@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788639289.200264:0:18750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a3f1d952/0x25c454990262da71 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639289.200288:0:18750:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003fc2fbef/0x25c454990262da6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85a12 expref: 8 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639289.200297:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788639289.200301:0:18750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788639289.200307:0:18750:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3f1d952/0x25c454990262da71 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639289.200353:0:18750:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003fc2fbef/0x25c454990262da6a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85a12 expref: 8 pid: 19077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639289.200369:0:18750:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003fc2fbef/0x25c454990262da6a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85a12 expref: 8 pid: 19077 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639289.200397:0:18750:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375fb0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:18750:1875523773083776:192.168.206.18@tcp:104: 00000100:00100000:2.0:1788639289.200501:0:18750:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae370ec9300 going to sleep for 11 seconds 00000100:00100000:3.0:1788639289.203876:0:18750:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375fb0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:18750:1875523773083776:192.168.206.18@tcp:104: 00010000:00010000:3.0:1788639289.203918:0:18750:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a3f1d952/0x25c454990262da71 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639289.205826:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639289.206354:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754138496 00000100:00100000:0.0:1788639289.206367:0:17228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754138496 00010000:00010000:0.0:1788639289.206421:0:17228:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003fc2fbef/0x25c454990262da6a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85a12 expref: 9 pid: 19077 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639289.206470:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 20 00000100:00100000:0.0:1788639289.206481:0:17228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae3505d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f164030-9448-43be-b8f2-64db35b5d669+9:2408:x1875523754138496:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788639289.206499:0:17228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788639289.206526:0:17228:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003fc2fbef/0x25c454990262da6a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85a12 expref: 9 pid: 19077 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.206569:0:17228:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003fc2fbef/0x25c454990262da6a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85a12 expref: 9 pid: 19077 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.206595:0:17228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fc2fbef/0x25c454990262da6a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85a12 expref: 9 pid: 19077 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.206666:0:17228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=1s v=(1 0) 00010000:00010000:0.0:1788639289.206671:0:17228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 1) 00010000:00010000:0.0:1788639289.206679:0:17228:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a3f1d952/0x25c454990262da71 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.206691:0:17228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3f1d952/0x25c454990262da71 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.206728:0:17228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788639289.206793:0:17228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f164030-9448-43be-b8f2-64db35b5d669+8:2408:x1875523754138496:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 313us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639289.206801:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 20 00010000:00010000:0.0:1788639289.206835:0:18750:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a3f1d952/0x25c454990262da71 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.206845:0:18750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3f1d952/0x25c454990262da71 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.206869:0:18750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a3f1d952/0x25c454990262da71 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.206885:0:18750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3f1d952/0x25c454990262da71 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.206893:0:18750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3f1d952/0x25c454990262da71 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.206900:0:18750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae242f23e00 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:0.0:1788639289.206905:0:18750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3f1d952/0x25c454990262da71 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.206916:0:18750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3f1d952/0x25c454990262da71 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.206929:0:18750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3f1d952/0x25c454990262da71 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.206936:0:18750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3f1d952/0x25c454990262da71 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639289.206985:0:18750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae3505d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f164030-9448-43be-b8f2-64db35b5d669+7:2408:x1875523754138368:12345-192.168.206.18@tcp:1:lhsmtool_posix.0 Request processed in 6780us (7080us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639289.206993:0:18750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 32 00000100:00100000:2.0:1788639289.215054:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639289.215355:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754138752 00000100:00100000:1.0:1788639289.215368:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754138752 00000100:00100000:1.0:1788639289.215489:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 63 00000100:00100000:1.0:1788639289.215502:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f164030-9448-43be-b8f2-64db35b5d669+16:15684:x1875523754138752:12345-192.168.206.18@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788639289.215671:0:18565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262da78 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.215692:0:18565:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262d9c2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859d3 expref: 16 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.215701:0:18565:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262da78 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.215744:0:18565:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262d9c2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859d3 expref: 16 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.215759:0:18565:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262d9c2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859d3 expref: 16 pid: 17242 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639289.215799:0:18565:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae374870380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18565:1875523773083904:192.168.206.18@tcp:104: 00000100:00100000:1.0:1788639289.215903:0:18565:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae34b3313c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788639289.225479:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639289.225677:0:18565:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae374870380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18565:1875523773083904:192.168.206.18@tcp:104: 00010000:00010000:1.0:1788639289.225714:0:18565:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262da78 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639289.225899:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754138880 00000100:00100000:3.0:1788639289.225908:0:17226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754138880 00010000:00010000:3.0:1788639289.225957:0:17226:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262d9c2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859d3 expref: 17 pid: 17242 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639289.225999:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 21 00000100:00100000:3.0:1788639289.226010:0:17226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244035c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f164030-9448-43be-b8f2-64db35b5d669+17:2408:x1875523754138880:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788639289.226059:0:17226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639289.226067:0:17226:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262d9c2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859d3 expref: 17 pid: 17242 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639289.226083:0:17226:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262d9c2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859d3 expref: 17 pid: 17242 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639289.226114:0:17226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb600/0x25c454990262d9c2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859d3 expref: 17 pid: 17242 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639289.226132:0:17226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae242376300) 00010000:00010000:3.0:1788639289.226137:0:17226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb200/0x25c454990262d9de lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859e1 expref: 16 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639289.226148:0:17226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262da78 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639289.226157:0:17226:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262da78 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639289.226165:0:17226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262da78 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639289.226196:0:17226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639289.226317:0:17226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244035c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f164030-9448-43be-b8f2-64db35b5d669+16:2408:x1875523754138880:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 307us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639289.226325:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 21 00010000:00010000:1.0:1788639289.226980:0:18565:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262da78 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.226991:0:18565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262da78 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.227284:0:18565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8c00/0x25c454990262da7f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.227300:0:18565:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262da47 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859fd expref: 16 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.227309:0:18565:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8c00/0x25c454990262da7f lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.227350:0:18565:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262da47 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859fd expref: 16 pid: 18565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.227368:0:18565:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262da47 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859fd expref: 16 pid: 18565 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639289.227386:0:18565:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae374870380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18565:1875523773084032:192.168.206.18@tcp:104: 00000100:00100000:1.0:1788639289.227473:0:18565:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae34b331e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788639289.236443:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639289.236529:0:17227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754139008 00000100:00100000:3.0:1788639289.236551:0:17227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754139008 00010000:00010000:3.0:1788639289.236672:0:17227:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262da47 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859fd expref: 17 pid: 18565 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639289.236719:0:17227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 22 00000100:00100000:3.0:1788639289.236730:0:17227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244035880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f164030-9448-43be-b8f2-64db35b5d669+17:2407:x1875523754139008:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788639289.236750:0:17227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788639289.236757:0:17227:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262da47 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859fd expref: 17 pid: 18565 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639289.236774:0:17227:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262da47 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859fd expref: 17 pid: 18565 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639289.236802:0:17227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ae242376a00) 00010000:00010000:3.0:1788639289.236808:0:17227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8c00/0x25c454990262da7f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639289.236820:0:17227:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8c00/0x25c454990262da7f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639289.236835:0:17227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8c00/0x25c454990262da7f lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639289.236859:0:17227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788639289.236931:0:17227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244035880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f164030-9448-43be-b8f2-64db35b5d669+17:2407:x1875523754139008:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 202us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639289.236939:0:17227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 22 00010000:00010000:1.0:1788639289.237583:0:18565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262da47 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859fd expref: 16 pid: 18565 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639289.237606:0:18565:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae374870380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18565:1875523773084032:192.168.206.18@tcp:104: 00010000:00010000:1.0:1788639289.237676:0:18565:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8c00/0x25c454990262da7f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.237686:0:18565:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8c00/0x25c454990262da7f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.237692:0:18565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8c00/0x25c454990262da7f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788639289.237827:0:18565:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1788639289.237953:0:18565:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1788639289.237991:0:18565:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1788639289.238090:0:18565:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae374870380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18565:1875523773084160:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788639289.238153:0:18565:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639289.238189:0:18565:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae34b331d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788639289.240030:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773084160 00000100:00100000:2.0:1788639289.240052:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773084160 00000100:00100000:2.0:1788639289.240123:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788639289.240132:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae374871880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18565:x1875523773084160:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788639289.240769:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae374871880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18565:x1875523773084160:12345-0@lo:1000:mdt00_003.0 Request processed in 634us (2612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639289.240779:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788639289.241273:0:18565:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae374870380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18565:1875523773084160:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1788639289.241880:0:18565:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1788639289.241982:0:18565:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244036300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18565:1875523773084288:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788639289.242147:0:18565:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639289.242190:0:18565:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3461baf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788639289.242286:0:17981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773084288 00000100:00100000:2.0:1788639289.242294:0:17981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773084288 00000100:00100000:2.0:1788639289.242348:0:17981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788639289.242358:0:17981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244037100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:18565:x1875523773084288:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788639289.242926:0:17981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244037100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:18565:x1875523773084288:12345-0@lo:1000:mdt00_003.0 Request processed in 566us (776us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1788639289.242935:0:17981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788639289.243274:0:18565:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244036300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18565:1875523773084288:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1788639289.243328:0:18565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8c00/0x25c454990262da7f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.243340:0:18565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8c00/0x25c454990262da7f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.243349:0:18565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8c00/0x25c454990262da7f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.243356:0:18565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f8c00 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639289.243361:0:18565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8c00/0x25c454990262da7f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.243371:0:18565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8c00/0x25c454990262da7f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.243603:0:18565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ae242376a00) 00010000:00010000:0.0:1788639289.243607:0:18565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788639289.243757:0:18565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8c00/0x25c454990262da7f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.243767:0:18565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8c00/0x25c454990262da7f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.243809:0:18565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd400/0x25c454990262d9d7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.243833:0:18565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd400/0x25c454990262d9d7 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.243840:0:18565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd400/0x25c454990262d9d7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.243846:0:18565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3748dd400 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:0.0:1788639289.243849:0:18565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd400/0x25c454990262d9d7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.243856:0:18565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd400/0x25c454990262d9d7 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.243866:0:18565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae242376300) 00010000:00010000:0.0:1788639289.243869:0:18565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788639289.243877:0:18565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb200/0x25c454990262d9de lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859e1 expref: 19 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.243891:0:18565:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb200/0x25c454990262d9de lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859e1 expref: 19 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.243902:0:18565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb200/0x25c454990262d9de lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859e1 expref: 19 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.243974:0:18565:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3750fb200/0x25c454990262d9de lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e859e1 expref: 19 pid: 17242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788639289.243989:0:18565:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244037b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18565:1875523773084416:192.168.206.18@tcp:105: 00000100:00100000:0.0:1788639289.244569:0:18565:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ae3461bab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788639289.253137:0:18565:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244037b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18565:1875523773084416:192.168.206.18@tcp:105: 00010000:00010000:1.0:1788639289.253176:0:18565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd400/0x25c454990262d9d7 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.253191:0:18565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae3748dd400/0x25c454990262d9d7 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.253232:0:18565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262da86 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.253272:0:18565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262da86 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.253285:0:18565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262da86 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.253299:0:18565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262da86 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.253306:0:18565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262da86 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.253313:0:18565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262da86 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.253319:0:18565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f9600 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639289.253324:0:18565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262da86 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.253332:0:18565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262da86 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.253346:0:18565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae242376300) 00010000:00010000:1.0:1788639289.253349:0:18565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788639289.253354:0:18565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262da86 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.253360:0:18565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9600/0x25c454990262da86 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.253371:0:18565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262da78 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.253384:0:18565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262da78 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.253390:0:18565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262da78 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.253396:0:18565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f8800 already unused, calling callback (ffffffffc192f4f0) 00010000:00010000:1.0:1788639289.253399:0:18565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262da78 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.253404:0:18565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262da78 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.253413:0:18565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae242376300) 00010000:00010000:1.0:1788639289.253415:0:18565:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788639289.253418:0:18565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262da78 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.253423:0:18565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f8800/0x25c454990262da78 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18565 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639289.253712:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f164030-9448-43be-b8f2-64db35b5d669+19:15684:x1875523754138752:12345-192.168.206.18@tcp:57:lhsmtool_posix.0 Request processed in 38211us (38683us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1788639289.253726:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 63 00000020:00080000:1.0:1788639289.253733:0:18565:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788639289.254729:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639289.254977:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754139136 00000100:00100000:1.0:1788639289.254988:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754139136 00000100:00100000:1.0:1788639289.255058:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 10 00000100:00100000:1.0:1788639289.255070:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae376f84050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f164030-9448-43be-b8f2-64db35b5d669+19:15683:x1875523754139136:12345-192.168.206.18@tcp:49:dd.0 00000100:00100000:1.0:1788639289.255233:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae376f84050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f164030-9448-43be-b8f2-64db35b5d669+19:15683:x1875523754139136:12345-192.168.206.18@tcp:49:dd.0 Request processed in 164us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639289.255241:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 10 00000100:00100000:3.0:1788639289.256348:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639289.256458:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754139392 00000100:00100000:1.0:1788639289.256467:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754139392 00000100:00100000:1.0:1788639289.256506:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 11 00000100:00100000:1.0:1788639289.256517:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f164030-9448-43be-b8f2-64db35b5d669+19:15684:x1875523754139392:12345-192.168.206.18@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788639289.256918:0:17243:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788639289.256957:0:17243:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:1.0:1788639289.256995:0:17243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9000/0x25c454990262da8d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.257014:0:17243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9000/0x25c454990262da8d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.257028:0:17243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9000/0x25c454990262da8d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.257114:0:17243:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9000/0x25c454990262da8d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.257122:0:17243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9000/0x25c454990262da8d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.257129:0:17243:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9000/0x25c454990262da8d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.257151:0:17243:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788639289.257198:0:17229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788639289.257204:0:17229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9000/0x25c454990262da8d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.257217:0:17229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f9000 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:1.0:1788639289.257222:0:17229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9000/0x25c454990262da8d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.257231:0:17229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9000/0x25c454990262da8d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.257245:0:17229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ae242376a00) 00010000:00010000:1.0:1788639289.257248:0:17229:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788639289.257253:0:17229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9000/0x25c454990262da8d lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.257260:0:17229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae2421f9000/0x25c454990262da8d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.257273:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639289.257274:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788639289.257276:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639289.257341:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f164030-9448-43be-b8f2-64db35b5d669+21:15684:x1875523754139392:12345-192.168.206.18@tcp:35:lhsmtool_posix.0 Request processed in 825us (1001us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1788639289.257349:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 11 00000020:00080000:1.0:1788639289.257354:0:17243:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788639289.257935:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788639289.258034:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754139520 00000100:00100000:3.0:1788639289.258049:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754139520 00000100:00100000:3.0:1788639289.258094:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 64 00000100:00100000:3.0:1788639289.258103:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f164030-9448-43be-b8f2-64db35b5d669+21:15683:x1875523754139520:12345-192.168.206.18@tcp:101:dd.0 00010000:00010000:3.0:1788639289.258120:0:17241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788639289.258137:0:17241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9f600/0x25c454990262da94 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e9111ade9e85a19 expref: -99 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639289.258170:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9fa00/0x25c454990262da9b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639289.258183:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9fa00/0x25c454990262da9b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639289.258193:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9fa00/0x25c454990262da9b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639289.258301:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9f600/0x25c454990262da94 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85a19 expref: 23 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639289.258319:0:17241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ae242f9fa00/0x25c454990262da9b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x3e9111ade9e85a19 expref: 22 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788639289.258329:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ae242376300) 00010000:00010000:3.0:1788639289.258332:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788639289.258335:0:17241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ae242f9fa00, rc 0) 00000100:00100000:3.0:1788639289.258377:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f164030-9448-43be-b8f2-64db35b5d669+22:15683:x1875523754139520:12345-192.168.206.18@tcp:101:dd.0 Request processed in 275us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639289.258393:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 64 00000040:00080000:1.0:1788639289.263249:0:17279:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788639289.263260:0:17279:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788639289.263296:0:17279:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788639289.263307:0:17279:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788639289.423509:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788639289.424343:0:18753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754139648 00000100:00100000:0.0:1788639289.424361:0:18753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754139648 00000100:00100000:0.0:1788639289.424544:0:18753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 0 00000100:00100000:0.0:1788639289.424560:0:18753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5f164030-9448-43be-b8f2-64db35b5d669+7:2406:x1875523754139648:12345-192.168.206.18@tcp:4:dd.0 00002000:00010000:0.0:1788639289.425182:0:18753:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a9c7839, atime: 0x6a9c7838, ctime: 0x6a9c7839, blocks: 0x0 00010000:00010000:0.0:1788639289.425197:0:18753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c31eb95/0x25c454990262daa2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.425219:0:18753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=548s v=(0 0) 00010000:00010000:0.0:1788639289.425224:0:18753:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788639289.425232:0:18753:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c31eb95/0x25c454990262daa2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788639289.425249:0:18753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c31eb95/0x25c454990262daa2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788639289.428415:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788639289.434206:0:18755:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1788639289.434226:0:18755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1788639289.437130:0:18755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523754139776 00000100:00100000:3.0:1788639289.437149:0:18755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523754139776 00000100:00100000:1.0:1788639289.437816:0:20381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 1 00000100:00100000:1.0:1788639289.437831:0:20381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243a90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5f164030-9448-43be-b8f2-64db35b5d669+9:2406:x1875523754139776:12345-192.168.206.18@tcp:4:dd.0 00010000:00010000:1.0:1788639289.437892:0:20381:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf1ab88a/0x25c454990262daa9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.437915:0:20381:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639289.437920:0:20381:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788639289.437928:0:20381:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf1ab88a/0x25c454990262daa9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.437946:0:20381:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf1ab88a/0x25c454990262daa9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788639289.529603:0:18744:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:3.0:1788639289.529645:0:18744:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:2.0:1788639289.539101:0:18753:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:2.0:1788639289.539111:0:18753:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1788639289 -> 1788639290 00002000:00010000:2.0:1788639289.539113:0:18753:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788639289 -> 1788639290 00002000:00010000:2.0:1788639289.539116:0:18753:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 14952 00010000:00010000:2.0:1788639289.539133:0:18753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c31eb95/0x25c454990262daa2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639289.539145:0:18753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c31eb95/0x25c454990262daa2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639289.539153:0:18753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c31eb95/0x25c454990262daa2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639289.539225:0:18753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae3748dc600 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:2.0:1788639289.539231:0:18753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c31eb95/0x25c454990262daa2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639289.539262:0:18753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c31eb95/0x25c454990262daa2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639289.539283:0:18753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c31eb95/0x25c454990262daa2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788639289.539290:0:18753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c31eb95/0x25c454990262daa2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788639289.539456:0:18753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5f164030-9448-43be-b8f2-64db35b5d669+9:2406:x1875523754139648:12345-192.168.206.18@tcp:4:dd.0 Request processed in 114895us (115958us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788639289.539470:0:18753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 0 00000001:00080000:0.0:1788639289.550136:0:18744:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00010000:00010000:1.0:1788639289.550378:0:20381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf1ab88a/0x25c454990262daa9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.550393:0:20381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf1ab88a/0x25c454990262daa9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.550403:0:20381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf1ab88a/0x25c454990262daa9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.550410:0:20381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ae2421f9000 already unused, calling callback (ffffffffc0d214f0) 00010000:00010000:1.0:1788639289.550415:0:20381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf1ab88a/0x25c454990262daa9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.550424:0:20381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf1ab88a/0x25c454990262daa9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.550466:0:20381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf1ab88a/0x25c454990262daa9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788639289.550474:0:20381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf1ab88a/0x25c454990262daa9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788639289.550591:0:20381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243a90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5f164030-9448-43be-b8f2-64db35b5d669+5:2406:x1875523754139776:12345-192.168.206.18@tcp:4:dd.0 Request processed in 112759us (122186us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1788639289.550602:0:20381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 1 00010000:00010000:0.0:1788639289.652778:0:17230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788639290.036861:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788639290.036885:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244036a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773084544:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788639290.036969:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639290.041206:0:18751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773084544 00000100:00100000:3.0:1788639290.041222:0:18751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773084544 00000100:00100000:3.0:1788639290.041368:0:18751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788639290.041379:0:18751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae374871c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773084544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788639290.041405:0:18751:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923505152 avail 3684278272 00000100:00100000:3.0:1788639290.041503:0:18751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae374871c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773084544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 125us (4533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639290.041510:0:18751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788639290.041633:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244036a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773084544:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788639290.043933:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788639290.549265:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375fb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773084672:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788639290.549347:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639290.552387:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773084672 00000100:00100000:1.0:1788639290.552399:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773084672 00000100:00100000:1.0:1788639290.552451:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788639290.552459:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae244036a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773084672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788639290.552491:0:17245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1788639290.552572:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae244036a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773084672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (3225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639290.552579:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788639290.552985:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375fb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773084672:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788639290.676786:0:18396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788639291.046392:0:20418:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:1.0:1788639291.064667:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788639291.064690:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243a90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773084800:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788639291.064760:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788639291.064834:0:17981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773084800 00000100:00100000:3.0:1788639291.064843:0:17981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773084800 00000100:00100000:3.0:1788639291.064901:0:17981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788639291.064911:0:17981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae374870000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523773084800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788639291.064944:0:17981:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788639291.065011:0:17981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae374870000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523773084800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788639291.065019:0:17981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788639291.065090:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243a90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773084800:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788639291.700993:0:17229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788639291.765423:0:17999:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788639292.086743:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae375fb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773084928:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788639292.086840:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788639292.086921:0:18752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773084928 00000100:00100000:2.0:1788639292.086930:0:18752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773084928 00000100:00100000:2.0:1788639292.087198:0:18752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788639292.087215:0:18752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae375fb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773084928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788639292.087254:0:18752:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788639292.087331:0:18752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae375fb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875523773084928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 120us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788639292.087340:0:18752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788639292.087538:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae375fb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875523773084928:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788639292.088266:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788639292.088362:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae374870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773085056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788639292.088580:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788639292.088651:0:18752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773085056 00000100:00100000:1.0:1788639292.088658:0:18752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773085056 00000100:00100000:1.0:1788639292.088704:0:18752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788639292.088713:0:18752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae374870a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773085056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788639292.088737:0:18752:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788639292.088779:0:18752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae374870a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773085056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639292.088786:0:18752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1788639292.088807:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788639292.088836:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae374870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773085056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788639292.093448:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244036680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4d225031-35be-4b74-b245-637fda218215:3643:1875523773085184:0@lo:400:kworker.0 00000100:00100000:0.0:1788639292.093569:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639292.093640:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244034700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773085696:0@lo:400:kworker.0 00000100:00100000:0.0:1788639292.093671:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639292.093694:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244034e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875523773086208:0@lo:400:kworker.0 00000100:00100000:0.0:1788639292.093720:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639292.093750:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788639292.093755:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244035180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773085312:0@lo:400:kworker.0 00000100:00100000:0.0:1788639292.093774:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639292.093792:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244037480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773085824:0@lo:400:kworker.0 00000100:00100000:0.0:1788639292.093812:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639292.093826:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae243953b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875523773086336:0@lo:400:kworker.0 00000100:00100000:0.0:1788639292.093843:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639292.093878:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773085184 00000100:00100000:0.0:1788639292.093887:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773085184 00000100:00100000:0.0:1788639292.093962:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788639292.093973:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae243192050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+24:3643:x1875523773085184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639292.094047:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae243192050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d225031-35be-4b74-b245-637fda218215+24:3643:x1875523773085184:12345-0@lo:400:kworker.0 Request processed in 75us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639292.094055:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788639292.094096:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773086208 00000100:00100000:0.0:1788639292.094100:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773086208 00000100:00100000:0.0:1788639292.094143:0:17240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773086336 00000100:00100000:0.0:1788639292.094146:0:17240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773086336 00000100:00100000:0.0:1788639292.094169:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788639292.094175:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875523773086208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639292.094209:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875523773086208:12345-0@lo:400:kworker.0 Request processed in 34us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639292.094224:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788639292.094236:0:17240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788639292.094241:0:17240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875523773086336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639292.094269:0:17240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875523773086336:12345-0@lo:400:kworker.0 Request processed in 28us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639292.094275:0:17240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788639292.094295:0:17981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773085696 00000100:00100000:0.0:1788639292.094298:0:17981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773085696 00000100:00100000:0.0:1788639292.094323:0:17981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773085312 00000100:00100000:0.0:1788639292.094326:0:17981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773085312 00000100:00100000:0.0:1788639292.094337:0:17981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788639292.094343:0:17981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae2438cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773085696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639292.094374:0:17981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae2438cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773085696:12345-0@lo:400:kworker.0 Request processed in 32us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639292.094381:0:17981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788639292.094392:0:17981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788639292.094398:0:17981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523773085312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639292.094423:0:17981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875523773085312:12345-0@lo:400:kworker.0 Request processed in 26us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639292.094429:0:17981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788639292.094448:0:18749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773085824 00000100:00100000:0.0:1788639292.094452:0:18749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773085824 00000100:00100000:0.0:1788639292.094486:0:18749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788639292.094493:0:18749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773085824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639292.094538:0:18749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875523773085824:12345-0@lo:400:kworker.0 Request processed in 46us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639292.094554:0:18749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788639292.094643:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244035180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875523773085312:0@lo:400:kworker.0 00000100:00100000:0.0:1788639292.094659:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244037480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773085824:0@lo:400:kworker.0 00000100:00100000:0.0:1788639292.094669:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae243953b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875523773086336:0@lo:400:kworker.0 00000100:00100000:0.0:1788639292.094679:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244036680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4d225031-35be-4b74-b245-637fda218215:3643:1875523773085184:0@lo:400:kworker.0 00000100:00100000:0.0:1788639292.094687:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244034700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875523773085696:0@lo:400:kworker.0 00010000:00080000:0.0:1788639292.094700:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae244034e00 x1875523773086208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639292.094711:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244034e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875523773086208:0@lo:400:kworker.0 00000100:00100000:0.0:1788639292.094794:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244034a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875523773085568:0@lo:400:kworker.0 00000100:00100000:0.0:1788639292.094832:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639292.094856:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244037800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875523773086080:0@lo:400:kworker.0 00000100:00100000:0.0:1788639292.094879:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639292.094899:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788639292.094906:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244037b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773085440:0@lo:400:kworker.0 00000100:00100000:0.0:1788639292.094930:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639292.094955:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae244034380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523773085952:0@lo:400:kworker.0 00000100:00100000:0.0:1788639292.094978:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639292.094990:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ae2438cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875523773086464:0@lo:400:kworker.0 00000100:00100000:0.0:1788639292.095012:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788639292.095035:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773085568 00000100:00100000:0.0:1788639292.095046:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773085568 00000100:00100000:0.0:1788639292.095069:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773086080 00000100:00100000:0.0:1788639292.095072:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773086080 00000100:00100000:0.0:1788639292.095085:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773085952 00000100:00100000:0.0:1788639292.095088:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773085952 00000100:00100000:0.0:1788639292.095099:0:17242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773086464 00000100:00100000:0.0:1788639292.095101:0:17242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773086464 00000100:00100000:0.0:1788639292.095116:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788639292.095124:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875523773085568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639292.095164:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875523773085568:12345-0@lo:400:kworker.0 Request processed in 41us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639292.095171:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788639292.095184:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788639292.095191:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875523773086080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639292.095218:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875523773086080:12345-0@lo:400:kworker.0 Request processed in 28us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639292.095225:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788639292.095236:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788639292.095242:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523773085952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639292.095270:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875523773085952:12345-0@lo:400:kworker.0 Request processed in 28us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639292.095276:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788639292.095288:0:17242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788639292.095294:0:17242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875523773086464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788639292.095322:0:17242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875523773086464:12345-0@lo:400:kworker.0 Request processed in 29us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788639292.095328:0:17242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788639292.095377:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244034380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875523773085952:0@lo:400:kworker.0 00010000:00080000:0.0:1788639292.095389:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ae2438cc700 x1875523773086464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788639308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788639292.095400:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae2438cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875523773086464:0@lo:400:kworker.0 00000100:00100000:0.0:1788639292.095411:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244034a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875523773085568:0@lo:400:kworker.0 00000100:00100000:0.0:1788639292.095422:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244037800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875523773086080:0@lo:400:kworker.0 00000100:00080000:2.0:1788639292.097722:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788639292.097735:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788639292.097740:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788639292.098451:0:19077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523773085440 00000100:00100000:1.0:1788639292.098464:0:19077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523773085440 00000100:00100000:1.0:1788639292.098599:0:19077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788639292.098611:0:19077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ae242f08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773085440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788639292.098738:0:19077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ae242f08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1875523773085440:12345-0@lo:400:kworker.0 Request processed in 129us (3806us total) trans 0 rc 0/0 00000100:00100000:1.0:1788639292.098746:0:19077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788639292.098807:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:1.0:1788639292.098813:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ae375fb3100, transno 8589934596 00000004:00080000:1.0:1788639292.098826:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:1.0:1788639292.098852:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ae244037b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875523773085440:0@lo:400:kworker.0 00000100:00080000:2.0:1788639292.106543:0:17237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 Debug log: 42105 lines, 42105 kept, 0 dropped, 0 bad.